How to Extract LoRA from FLUX Fine Tuning / DreamBooth Training Full Tutorial and Comparison Between Fine Tuning vs Extraction vs LoRA Training
text
How to Extract LoRA from FLUX Fine Tuning / DreamBooth Training Full Tutorial and Comparison Between Fine Tuning vs Extraction vs LoRA Training
new_line
new_line
Full article is here public post : 
text
Full article is here public post : 
https://www.patreon.com/posts/112335162
https://www.patreon.com/posts/112335162
link
new_line
new_line
This was short on length so check out the full article - public post
text
This was short on length so check out the full article - public post
new_line
new_line
Conclusions as below
text
Conclusions as below
new_line
new_line
Conclusions
text
Conclusions
new_line
With same training dataset (15 images used), same number of steps (all compared trainings are 150 epoch thus 2250 steps), almost same training duration, Fine Tuning / DreamBooth training of FLUX yields the very best results
text
With same training dataset (15 images used), same number of steps (all compared trainings are 150 epoch thus 2250 steps), almost same training duration, Fine Tuning / DreamBooth training of FLUX yields the very best results
new_line
new_line
So yes Fine Tuning is the much better than LoRA training itself
text
So yes Fine Tuning is the much better than LoRA training itself
new_line
new_line
Amazing resemblance, quality with least amount of overfitting issue
text
Amazing resemblance, quality with least amount of overfitting issue
new_line
new_line
Moreover, extracting a LoRA from Fine Tuned full checkpoint, yields way better results from LoRA training itself
text
Moreover, extracting a LoRA from Fine Tuned full checkpoint, yields way better results from LoRA training itself
new_line
new_line
Extracting LoRA from full trained checkpoints were yielding way better results in SD 1.5 and SDXL as well
text
Extracting LoRA from full trained checkpoints were yielding way better results in SD 1.5 and SDXL as well
new_line
new_line
Comparison of these 3 is made in Image 5 (check very top of the images to see)
text
Comparison of these 3 is made in Image 5 (check very top of the images to see)
new_line
new_line
640 Network Dimension (Rank) FP16 LoRA takes 6.1 GB disk space
text
640 Network Dimension (Rank) FP16 LoRA takes 6.1 GB disk space
new_line
new_line
You can also try 128 Network Dimension (Rank) FP16 and different LoRA strengths during inference to make it closer to Fine Tuned model
text
You can also try 128 Network Dimension (Rank) FP16 and different LoRA strengths during inference to make it closer to Fine Tuned model
new_line
new_line
Moreover, you can try Resize LoRA feature of Kohya GUI but hopefully it will be my another research and article later
text
Moreover, you can try Resize LoRA feature of Kohya GUI but hopefully it will be my another research and article later
new_line
new_line
Image Raw Links
text
Image Raw Links
new_line
Image 1 : 
text
Image 1 : 
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_1.png
MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests
model
resource
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_1.png
new_line
new_line
Image 2 : 
text
Image 2 : 
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_2.jfif
MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests
model
resource
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_2.jfif
new_line
new_line
Image 3 : 
text
Image 3 : 
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_3.jfif
MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests
model
resource
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_3.jfif
new_line
new_line
Image 4 : 
text
Image 4 : 
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_4.jfif
MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests
model
resource
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_4.jfif
new_line
new_line
Image 5 : 
text
Image 5 : 
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_5.jpg
MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests
model
resource
https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_5.jpg
new_line
How to Extract LoRA from FLUX Fine Tuning / DreamBooth Training Full Tutorial and Comparison Between Fine Tuning vs Extraction vs LoRA Training

Full article is here public post : https://www.patreon.com/posts/112335162

This was short on length so check out the full article - public post

Conclusions as below

Conclusions
With same training dataset (15 images used), same number of steps (all compared trainings are 150 epoch thus 2250 steps), almost same training duration, Fine Tuning / DreamBooth training of FLUX yields the very best results

So yes Fine Tuning is the much better than LoRA training itself

Amazing resemblance, quality with least amount of overfitting issue

Moreover, extracting a LoRA from Fine Tuned full checkpoint, yields way better results from LoRA training itself

Extracting LoRA from full trained checkpoints were yielding way better results in SD 1.5 and SDXL as well

Comparison of these 3 is made in Image 5 (check very top of the images to see)

640 Network Dimension (Rank) FP16 LoRA takes 6.1 GB disk space

You can also try 128 Network Dimension (Rank) FP16 and different LoRA strengths during inference to make it closer to Fine Tuned model

Moreover, you can try Resize LoRA feature of Kohya GUI but hopefully it will be my another research and article later

Image Raw Links
Image 1 : https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_1.png

Image 2 : https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_2.jfif

Image 3 : https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_3.jfif

Image 4 : https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_4.jfif

Image 5 : https://huggingface.co/MonsterMMORPG/FLUX-Fine-Tuning-Grid-Tests/resolve/main/Image_5.jpg

👀
MonsterMMORPG John6666 InnovaSphereAI robolamp
👍
MonsterMMORPG sasikiran DarkMoonDragon Vigilence
🔥
MonsterMMORPG
🚀
MonsterMMORPG
❤️
MonsterMMORPG
🤗
MonsterMMORPG
😎
MonsterMMORPG
➕
MonsterMMORPG
🧠
MonsterMMORPG
🤝
MonsterMMORPG
🤯
MonsterMMORPG