MegaTronX commited on
Commit
9db11cb
·
verified ·
1 Parent(s): 86c4ee1

Upload folder using huggingface_hub

Browse files
Files changed (50) hide show
  1. MetartLoRA.safetensors +3 -0
  2. MetartLoRA_000001000.safetensors +3 -0
  3. MetartLoRA_000001250.safetensors +3 -0
  4. MetartLoRA_000001500.safetensors +3 -0
  5. MetartLoRA_000001750.safetensors +3 -0
  6. README.md +54 -0
  7. config.yaml +72 -0
  8. optimizer.pt +3 -0
  9. samples/.ipynb_checkpoints/1741618732128__000000250_0-checkpoint.jpg +0 -0
  10. samples/.ipynb_checkpoints/1741618745780__000000250_1-checkpoint.jpg +0 -0
  11. samples/.ipynb_checkpoints/1741618759475__000000250_2-checkpoint.jpg +0 -0
  12. samples/.ipynb_checkpoints/1741618973757__000000500_0-checkpoint.jpg +0 -0
  13. samples/.ipynb_checkpoints/1741618987714__000000500_1-checkpoint.jpg +0 -0
  14. samples/.ipynb_checkpoints/1741619001597__000000500_2-checkpoint.jpg +0 -0
  15. samples/.ipynb_checkpoints/1741619206860__000000750_0-checkpoint.jpg +0 -0
  16. samples/.ipynb_checkpoints/1741619220590__000000750_1-checkpoint.jpg +0 -0
  17. samples/.ipynb_checkpoints/1741619234377__000000750_2-checkpoint.jpg +0 -0
  18. samples/.ipynb_checkpoints/1741619446719__000001000_0-checkpoint.jpg +0 -0
  19. samples/.ipynb_checkpoints/1741619460455__000001000_1-checkpoint.jpg +0 -0
  20. samples/.ipynb_checkpoints/1741619474262__000001000_2-checkpoint.jpg +0 -0
  21. samples/.ipynb_checkpoints/1741619685916__000001250_0-checkpoint.jpg +0 -0
  22. samples/.ipynb_checkpoints/1741619699569__000001250_1-checkpoint.jpg +0 -0
  23. samples/.ipynb_checkpoints/1741619713279__000001250_2-checkpoint.jpg +0 -0
  24. samples/.ipynb_checkpoints/1741619931719__000001500_0-checkpoint.jpg +0 -0
  25. samples/.ipynb_checkpoints/1741619945553__000001500_1-checkpoint.jpg +0 -0
  26. samples/.ipynb_checkpoints/1741619959361__000001500_2-checkpoint.jpg +0 -0
  27. samples/1741618732128__000000250_0.jpg +0 -0
  28. samples/1741618745780__000000250_1.jpg +0 -0
  29. samples/1741618759475__000000250_2.jpg +0 -0
  30. samples/1741618973757__000000500_0.jpg +0 -0
  31. samples/1741618987714__000000500_1.jpg +0 -0
  32. samples/1741619001597__000000500_2.jpg +0 -0
  33. samples/1741619206860__000000750_0.jpg +0 -0
  34. samples/1741619220590__000000750_1.jpg +0 -0
  35. samples/1741619234377__000000750_2.jpg +0 -0
  36. samples/1741619446719__000001000_0.jpg +0 -0
  37. samples/1741619460455__000001000_1.jpg +0 -0
  38. samples/1741619474262__000001000_2.jpg +0 -0
  39. samples/1741619685916__000001250_0.jpg +0 -0
  40. samples/1741619699569__000001250_1.jpg +0 -0
  41. samples/1741619713279__000001250_2.jpg +0 -0
  42. samples/1741619931719__000001500_0.jpg +0 -0
  43. samples/1741619945553__000001500_1.jpg +0 -0
  44. samples/1741619959361__000001500_2.jpg +0 -0
  45. samples/1741620176488__000001750_0.jpg +0 -0
  46. samples/1741620190172__000001750_1.jpg +0 -0
  47. samples/1741620203851__000001750_2.jpg +0 -0
  48. samples/1741620417978__000002000_0.jpg +0 -0
  49. samples/1741620431711__000002000_1.jpg +0 -0
  50. samples/1741620445535__000002000_2.jpg +0 -0
MetartLoRA.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67b8d7e144051bd90f5ffd53ef0585a8f3db69740e2bf42605cb002032d39818
3
+ size 2360824
MetartLoRA_000001000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f53644e44e3c32a988c795bfa047e088a1c381848209627f5e720c0200de1ec4
3
+ size 2360824
MetartLoRA_000001250.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e6c109afd4bb94850152ee6e9059d0e6c55c3cbd6350601e9185510d14d1e4d
3
+ size 2360824
MetartLoRA_000001500.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f9f0d9b8964c307c5c62e667fa6a20bc242ea33e2a46dc92ab25d856ac2b4d1
3
+ size 2360824
MetartLoRA_000001750.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8ba7dfa7560db66f0db6f4a3ac3218e4eca3c53f79cc498956c85c3167205d0
3
+ size 2360824
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-image
4
+ - flux
5
+ - lora
6
+ - diffusers
7
+ - template:sd-lora
8
+ - ai-toolkit
9
+ widget:
10
+ - text: '[metart] young woman holding a sign that says ''I LOVE PROMPTS!'''
11
+ output:
12
+ url: samples/1741620417978__000002000_0.jpg
13
+ - text: woman with red hair and green eyes playing chess in the nude at the park
14
+ output:
15
+ url: samples/1741620431711__000002000_1.jpg
16
+ - text: nude girl with black hair and sparkling blue eyes playing the guitar, on
17
+ stage, singing a song
18
+ output:
19
+ url: samples/1741620445535__000002000_2.jpg
20
+ base_model: black-forest-labs/FLUX.1-dev
21
+ instance_prompt: metart
22
+ license: other
23
+ license_name: flux-1-dev-non-commercial-license
24
+ license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
25
+ ---
26
+
27
+ # MetartLoRA
28
+ Model trained with [AI Toolkit by Ostris](https://github.com/ostris/ai-toolkit)
29
+ <Gallery />
30
+
31
+ ## Trigger words
32
+
33
+ You should use `metart` to trigger the image generation.
34
+
35
+ ## Download model and use it with ComfyUI, AUTOMATIC1111, SD.Next, Invoke AI, etc.
36
+
37
+ Weights for this model are available in Safetensors format.
38
+
39
+ [Download](/MegaTronX/MetartLoRA/tree/main) them in the Files & versions tab.
40
+
41
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
42
+
43
+ ```py
44
+ from diffusers import AutoPipelineForText2Image
45
+ import torch
46
+
47
+ pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.bfloat16).to('cuda')
48
+ pipeline.load_lora_weights('MegaTronX/MetartLoRA', weight_name='MetartLoRA.safetensors')
49
+ image = pipeline('[metart] young woman holding a sign that says 'I LOVE PROMPTS!'').images[0]
50
+ image.save("my_image.png")
51
+ ```
52
+
53
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
54
+
config.yaml ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ job: extension
2
+ config:
3
+ name: MetartLoRA
4
+ process:
5
+ - type: sd_trainer
6
+ training_folder: output
7
+ device: cuda:0
8
+ trigger_word: metart
9
+ network:
10
+ type: lora
11
+ linear: 16
12
+ linear_alpha: 16
13
+ network_kwargs:
14
+ only_if_contains:
15
+ - transformer.single_transformer_blocks.7.proj_out
16
+ - transformer.single_transformer_blocks.12.proj_out
17
+ - transformer.single_transformer_blocks.16.proj_out
18
+ - transformer.single_transformer_blocks.20.proj_out
19
+ save:
20
+ dtype: float16
21
+ save_every: 250
22
+ max_step_saves_to_keep: 4
23
+ push_to_hub: true
24
+ hf_repo_id: MegaTronX/MetartLoRA
25
+ hf_private: true
26
+ datasets:
27
+ - folder_path: /data/ai-toolkit/metart
28
+ caption_ext: txt
29
+ caption_dropout_rate: 0.05
30
+ shuffle_tokens: false
31
+ cache_latents_to_disk: true
32
+ resolution:
33
+ - 512
34
+ - 768
35
+ - 1024
36
+ train:
37
+ batch_size: 1
38
+ steps: 2000
39
+ gradient_accumulation_steps: 1
40
+ train_unet: true
41
+ train_text_encoder: false
42
+ gradient_checkpointing: true
43
+ noise_scheduler: flowmatch
44
+ optimizer: adamw8bit
45
+ lr: 0.0001
46
+ skip_first_sample: true
47
+ ema_config:
48
+ use_ema: true
49
+ ema_decay: 0.99
50
+ dtype: bf16
51
+ model:
52
+ name_or_path: black-forest-labs/FLUX.1-dev
53
+ is_flux: true
54
+ quantize: true
55
+ sample:
56
+ sampler: flowmatch
57
+ sample_every: 250
58
+ width: 1024
59
+ height: 1024
60
+ prompts:
61
+ - '[metart] young woman holding a sign that says ''I LOVE PROMPTS!'''
62
+ - woman with red hair and green eyes playing chess in the nude at the park
63
+ - nude girl with black hair and sparkling blue eyes playing the guitar, on stage,
64
+ singing a song
65
+ neg: ''
66
+ seed: 42
67
+ walk_seed: true
68
+ guidance_scale: 4
69
+ sample_steps: 20
70
+ meta:
71
+ name: MetartLoRA
72
+ version: '1.0'
optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2cc46027b137ff22a309b89262e1dd1ffb0763debea4986d0fc7dc80b4be6b4
3
+ size 2408572
samples/.ipynb_checkpoints/1741618732128__000000250_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741618745780__000000250_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741618759475__000000250_2-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741618973757__000000500_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741618987714__000000500_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619001597__000000500_2-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619206860__000000750_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619220590__000000750_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619234377__000000750_2-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619446719__000001000_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619460455__000001000_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619474262__000001000_2-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619685916__000001250_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619699569__000001250_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619713279__000001250_2-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619931719__000001500_0-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619945553__000001500_1-checkpoint.jpg ADDED
samples/.ipynb_checkpoints/1741619959361__000001500_2-checkpoint.jpg ADDED
samples/1741618732128__000000250_0.jpg ADDED
samples/1741618745780__000000250_1.jpg ADDED
samples/1741618759475__000000250_2.jpg ADDED
samples/1741618973757__000000500_0.jpg ADDED
samples/1741618987714__000000500_1.jpg ADDED
samples/1741619001597__000000500_2.jpg ADDED
samples/1741619206860__000000750_0.jpg ADDED
samples/1741619220590__000000750_1.jpg ADDED
samples/1741619234377__000000750_2.jpg ADDED
samples/1741619446719__000001000_0.jpg ADDED
samples/1741619460455__000001000_1.jpg ADDED
samples/1741619474262__000001000_2.jpg ADDED
samples/1741619685916__000001250_0.jpg ADDED
samples/1741619699569__000001250_1.jpg ADDED
samples/1741619713279__000001250_2.jpg ADDED
samples/1741619931719__000001500_0.jpg ADDED
samples/1741619945553__000001500_1.jpg ADDED
samples/1741619959361__000001500_2.jpg ADDED
samples/1741620176488__000001750_0.jpg ADDED
samples/1741620190172__000001750_1.jpg ADDED
samples/1741620203851__000001750_2.jpg ADDED
samples/1741620417978__000002000_0.jpg ADDED
samples/1741620431711__000002000_1.jpg ADDED
samples/1741620445535__000002000_2.jpg ADDED