Text-to-Image
Diffusers
Safetensors
English
Chinese
QwenImage21Pipeline
bitsandbytes
int8
image-generation
image-editing
rgba
8-bit precision
Instructions to use ixim/Image21-INT8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use ixim/Image21-INT8 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("ixim/Image21-INT8", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Release verified Image21-INT8 conversion
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +105 -0
- EDITING_UPDATE.md +45 -0
- benchmarks/editing-v2.json +52 -0
- cards/huggingface.md +7 -2
- cards/modelscope.md +2 -2
- docs/editing-audit-20260924.md +83 -0
- evaluation/editing-v2/AUDIT.md +78 -0
- evaluation/editing-v2/audit/decode-bf16-full/decoded-alpha.png +3 -0
- evaluation/editing-v2/audit/decode-bf16-full/decoded-black.png +3 -0
- evaluation/editing-v2/audit/decode-bf16-full/decoded-checker.png +3 -0
- evaluation/editing-v2/audit/decode-bf16-full/decoded-white.png +3 -0
- evaluation/editing-v2/audit/decode-bf16-full/decoded.png +3 -0
- evaluation/editing-v2/audit/decode-bf16-full/record.json +30 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/decoded-alpha.png +3 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/decoded-black.png +3 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/decoded-checker.png +3 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/decoded-white.png +3 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/decoded.png +3 -0
- evaluation/editing-v2/audit/decode-fp32-tiled/record.json +30 -0
- evaluation/editing-v2/audit/decoder-compare-all.jpg +0 -0
- evaluation/editing-v2/audit/decoder-crops.png +3 -0
- evaluation/editing-v2/audit/decoder-processes.jsonl +3 -0
- evaluation/editing-v2/audit/decoder-summary.json +82 -0
- evaluation/editing-v2/audit/int8-crops.png +3 -0
- evaluation/editing-v2/audit/latent-2048/COMPLETE.json +1 -0
- evaluation/editing-v2/audit/latent-2048/bird_background-s1000042-decode.pt +3 -0
- evaluation/editing-v2/audit/latent-2048/bird_background-s1000042.png +3 -0
- evaluation/editing-v2/audit/latent-2048/cases.json +12 -0
- evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-alpha.png +3 -0
- evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-black.png +3 -0
- evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-checker.png +3 -0
- evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-white.png +3 -0
- evaluation/editing-v2/audit/latent-2048/environment.json +199 -0
- evaluation/editing-v2/audit/latent-2048/records.jsonl +1 -0
- evaluation/editing-v2/audit/paired-birds.png +3 -0
- evaluation/editing-v2/audit/paired-cups.jpg +0 -0
- evaluation/editing-v2/audit/probe/bird_background-1024-s1000042.jpg +0 -0
- evaluation/editing-v2/audit/probe/bird_background-1024-s1000042.png +3 -0
- evaluation/editing-v2/audit/probe/bird_background-2048-s1000042.jpg +0 -0
- evaluation/editing-v2/audit/probe/bird_background-2048-s1000042.png +3 -0
- evaluation/editing-v2/audit/probe/cup-preview.jpg +0 -0
- evaluation/editing-v2/audit/probe/cup_material-2048-s1000042.png +3 -0
- evaluation/editing-v2/audit/probe/records.jsonl +3 -0
- evaluation/editing-v2/bf16/COMPLETE.json +1 -0
- evaluation/editing-v2/bf16/bird_background-s1000042-decode.pt +3 -0
- evaluation/editing-v2/bf16/bird_background-s1000042.png +3 -0
- evaluation/editing-v2/bf16/bird_background-s1000123-decode.pt +3 -0
- evaluation/editing-v2/bf16/bird_background-s1000123.png +3 -0
- evaluation/editing-v2/bf16/bird_remove_background-s1000042-decode.pt +3 -0
- evaluation/editing-v2/bf16/bird_remove_background-s1000042.png +3 -0
.gitattributes
CHANGED
|
@@ -122,3 +122,108 @@ evaluation/editing/inputs/portrait_recolor.png filter=lfs diff=lfs merge=lfs -te
|
|
| 122 |
evaluation/editing/int8/bird_background-s42.png filter=lfs diff=lfs merge=lfs -text
|
| 123 |
evaluation/editing/int8/cup_material-s42.png filter=lfs diff=lfs merge=lfs -text
|
| 124 |
evaluation/editing/int8/portrait_recolor-s42.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
evaluation/editing/int8/bird_background-s42.png filter=lfs diff=lfs merge=lfs -text
|
| 123 |
evaluation/editing/int8/cup_material-s42.png filter=lfs diff=lfs merge=lfs -text
|
| 124 |
evaluation/editing/int8/portrait_recolor-s42.png filter=lfs diff=lfs merge=lfs -text
|
| 125 |
+
evaluation/editing-v2/audit/decode-bf16-full/decoded-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 126 |
+
evaluation/editing-v2/audit/decode-bf16-full/decoded-black.png filter=lfs diff=lfs merge=lfs -text
|
| 127 |
+
evaluation/editing-v2/audit/decode-bf16-full/decoded-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 128 |
+
evaluation/editing-v2/audit/decode-bf16-full/decoded-white.png filter=lfs diff=lfs merge=lfs -text
|
| 129 |
+
evaluation/editing-v2/audit/decode-bf16-full/decoded.png filter=lfs diff=lfs merge=lfs -text
|
| 130 |
+
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 131 |
+
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-black.png filter=lfs diff=lfs merge=lfs -text
|
| 132 |
+
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 133 |
+
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-white.png filter=lfs diff=lfs merge=lfs -text
|
| 134 |
+
evaluation/editing-v2/audit/decode-fp32-tiled/decoded.png filter=lfs diff=lfs merge=lfs -text
|
| 135 |
+
evaluation/editing-v2/audit/decoder-crops.png filter=lfs diff=lfs merge=lfs -text
|
| 136 |
+
evaluation/editing-v2/audit/int8-crops.png filter=lfs diff=lfs merge=lfs -text
|
| 137 |
+
evaluation/editing-v2/audit/latent-2048/bird_background-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 138 |
+
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 139 |
+
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 140 |
+
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 141 |
+
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 142 |
+
evaluation/editing-v2/audit/paired-birds.png filter=lfs diff=lfs merge=lfs -text
|
| 143 |
+
evaluation/editing-v2/audit/probe/bird_background-1024-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 144 |
+
evaluation/editing-v2/audit/probe/bird_background-2048-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 145 |
+
evaluation/editing-v2/audit/probe/cup_material-2048-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 146 |
+
evaluation/editing-v2/bf16/bird_background-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 147 |
+
evaluation/editing-v2/bf16/bird_background-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 148 |
+
evaluation/editing-v2/bf16/bird_remove_background-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 149 |
+
evaluation/editing-v2/bf16/bird_remove_background-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 150 |
+
evaluation/editing-v2/bf16/cup_identity-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 151 |
+
evaluation/editing-v2/bf16/cup_identity-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 152 |
+
evaluation/editing-v2/bf16/cup_material-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 153 |
+
evaluation/editing-v2/bf16/cup_material-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 154 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 155 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 156 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 157 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 158 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 159 |
+
evaluation/editing-v2/bf16/diagnostics/bird_background-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 160 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000042-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 161 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 162 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 163 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 164 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000123-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 165 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 166 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 167 |
+
evaluation/editing-v2/bf16/diagnostics/bird_remove_background-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 168 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 169 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 170 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 171 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 172 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 173 |
+
evaluation/editing-v2/bf16/diagnostics/cup_identity-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 174 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 175 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 176 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 177 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 178 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 179 |
+
evaluation/editing-v2/bf16/diagnostics/cup_material-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 180 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 181 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 182 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 183 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 184 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 185 |
+
evaluation/editing-v2/bf16/diagnostics/portrait_recolor-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 186 |
+
evaluation/editing-v2/bf16/portrait_recolor-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 187 |
+
evaluation/editing-v2/bf16/portrait_recolor-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 188 |
+
evaluation/editing-v2/inputs/bird_background.png filter=lfs diff=lfs merge=lfs -text
|
| 189 |
+
evaluation/editing-v2/inputs/cup_material.png filter=lfs diff=lfs merge=lfs -text
|
| 190 |
+
evaluation/editing-v2/inputs/portrait_recolor.png filter=lfs diff=lfs merge=lfs -text
|
| 191 |
+
evaluation/editing-v2/int8/bird_background-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 192 |
+
evaluation/editing-v2/int8/bird_background-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 193 |
+
evaluation/editing-v2/int8/bird_remove_background-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 194 |
+
evaluation/editing-v2/int8/bird_remove_background-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 195 |
+
evaluation/editing-v2/int8/cup_identity-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 196 |
+
evaluation/editing-v2/int8/cup_identity-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 197 |
+
evaluation/editing-v2/int8/cup_material-s1000042.png filter=lfs diff=lfs merge=lfs -text
|
| 198 |
+
evaluation/editing-v2/int8/cup_material-s1000123.png filter=lfs diff=lfs merge=lfs -text
|
| 199 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 200 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 201 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 202 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 203 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 204 |
+
evaluation/editing-v2/int8/diagnostics/bird_background-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 205 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000042-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 206 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 207 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 208 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 209 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000123-alpha.png filter=lfs diff=lfs merge=lfs -text
|
| 210 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 211 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 212 |
+
evaluation/editing-v2/int8/diagnostics/bird_remove_background-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 213 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 214 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 215 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 216 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 217 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 218 |
+
evaluation/editing-v2/int8/diagnostics/cup_identity-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 219 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 220 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 221 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 222 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 223 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 224 |
+
evaluation/editing-v2/int8/diagnostics/cup_material-s1000123-white.png filter=lfs diff=lfs merge=lfs -text
|
| 225 |
+
evaluation/editing-v2/int8/diagnostics/portrait_recolor-s1000042-black.png filter=lfs diff=lfs merge=lfs -text
|
| 226 |
+
evaluation/editing-v2/int8/diagnostics/portrait_recolor-s1000042-checker.png filter=lfs diff=lfs merge=lfs -text
|
| 227 |
+
evaluation/editing-v2/int8/diagnostics/portrait_recolor-s1000042-white.png filter=lfs diff=lfs merge=lfs -text
|
| 228 |
+
evaluation/editing-v2/int8/diagnostics/portrait_recolor-s1000123-black.png filter=lfs diff=lfs merge=lfs -text
|
| 229 |
+
evaluation/editing-v2/int8/diagnostics/portrait_recolor-s1000123-checker.png filter=lfs diff=lfs merge=lfs -text
|
EDITING_UPDATE.md
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
## Editing evaluation revision — 2026-09-24
|
| 2 |
+
|
| 3 |
+
**Weights are unchanged.** This update corrects the editing evaluation protocol and inference defaults.
|
| 4 |
+
Historical images, measurements and measured scripts remain available for reproduction.
|
| 5 |
+
|
| 6 |
+
The old seed-42 edits reused the source-generation seed. When the RNG stream and latent shape also
|
| 7 |
+
match, this can replay the source noise and confound editing quality. See the corrected discussion in
|
| 8 |
+
[Diffusers #14824](https://github.com/huggingface/diffusers/issues/14824).
|
| 9 |
+
Changing seed alone did **not** remove the artifacts in our 2048px tiled controls; the previous general
|
| 10 |
+
2048px recommendation is withdrawn.
|
| 11 |
+
|
| 12 |
+
**The short vertical stains were isolated to tiled VAE decoding in the audited 2048px example.**
|
| 13 |
+
Decoding the exact same saved latent with the same VAE checkpoint without tiling removes the
|
| 14 |
+
visible stains; FP32 decoding with tiling retains them. This does not repair the missing branch
|
| 15 |
+
or coarse bird detail already present in that failed edit. The quality suite therefore disables tiling.
|
| 16 |
+
|
| 17 |
+
The revised suite uses five cases × two independent editing seeds (1000042 / 1000123), paired BF16
|
| 18 |
+
and INT8, 1024px area scale, 40 steps, CFG=1, KV cache, model CPU offload and untiled VAE.
|
| 19 |
+
It adds actual transparent-background removal and an unchanged-image control. The complete matrix,
|
| 20 |
+
raw RGBA files, alpha maps, white/black/checker composites, hashes, schedules and decoder latents are
|
| 21 |
+
in [evaluation/editing-v2](evaluation/editing-v2). Inspect the
|
| 22 |
+
[visual audit](evaluation/editing-v2/AUDIT.md) and download
|
| 23 |
+
[comparison.html](evaluation/editing-v2/comparison.html) with its image folders for local viewing.
|
| 24 |
+
|
| 25 |
+
No filtering, sharpening or alpha cleanup was applied. These are informal samples, not an official
|
| 26 |
+
benchmark or a guarantee that all artifacts are resolved. Latent capture was enabled for diagnosis,
|
| 27 |
+
so this revision makes no latency/speedup claim.
|
| 28 |
+
|
| 29 |
+
In the revised samples, snowy-background replacement retains the bird and branch, and background
|
| 30 |
+
removal produces real transparency. Preservation is still imperfect: in the unchanged-image control,
|
| 31 |
+
seed 1000123 changes the green apple to yellow in both precisions. This failed control is retained.
|
| 32 |
+
|
| 33 |
+
Start editing with a seed independent of the source:
|
| 34 |
+
|
| 35 |
+
```bash
|
| 36 |
+
python -m scripts.infer --model . --input input.png --source-seed 42 --seed 1000042 --resolution 1024 --prompt "Change only the blue sweater to red. Preserve the person, lighting and background." --output edit.png
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
Omit `--source-seed` if unknown. Explicit seeds are never silently remapped; a known collision is
|
| 40 |
+
rejected. Omitting width/height preserves the last input's aspect ratio. `--resolution` controls
|
| 41 |
+
reference image area, while an explicit `--width` / `--height` pair controls output dimensions.
|
| 42 |
+
VAE tiling remains an optional memory tradeoff, not a quality improvement guarantee.
|
| 43 |
+
|
| 44 |
+
The sections below retain the historical v1 evaluation; their image-generation timings are not
|
| 45 |
+
pooled with this revised editing suite.
|
benchmarks/editing-v2.json
ADDED
|
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"id": "portrait_recolor",
|
| 4 |
+
"category": "clothing color",
|
| 5 |
+
"prompt": "Change only the cream sweater to a navy blue sweater. Preserve the same woman, face, hairstyle, pose, lighting and background.",
|
| 6 |
+
"input_file": "portrait_recolor.png",
|
| 7 |
+
"input_sha256": "00716ad4721f585be4b0bf0daf2413f4ab92b795f1eb4d08b4f1ecc604b075b8",
|
| 8 |
+
"source": "evaluation/young_woman/bf16/young_chinese_woman-s42.png",
|
| 9 |
+
"source_seed": 42,
|
| 10 |
+
"task": "opaque_edit"
|
| 11 |
+
},
|
| 12 |
+
{
|
| 13 |
+
"id": "cup_material",
|
| 14 |
+
"category": "material replacement",
|
| 15 |
+
"prompt": "Change only the middle blue ceramic cup into a brushed silver metal cup. Preserve its shape and position, the red and yellow cups, the green apple, the tabletop, lighting and background.",
|
| 16 |
+
"input_file": "cup_material.png",
|
| 17 |
+
"input_sha256": "91e967685fbbd79ba13daece22a0f72c863cb518db88d5d2a6f9aecfc5f292b1",
|
| 18 |
+
"source": "evaluation/bf16/composition-s42.png",
|
| 19 |
+
"source_seed": 42,
|
| 20 |
+
"task": "opaque_edit"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"id": "bird_background",
|
| 24 |
+
"category": "background replacement",
|
| 25 |
+
"prompt": "Replace only the blurred forest background with a softly blurred snowy winter forest. Preserve the same kingfisher, its colors and pose, the mossy branch, framing and foreground lighting.",
|
| 26 |
+
"input_file": "bird_background.png",
|
| 27 |
+
"input_sha256": "40a0f73bb407a394fa9e8a3f6922455df716b9725ad07437fa10c1daca2c2095",
|
| 28 |
+
"source": "evaluation/bf16/texture-s42.png",
|
| 29 |
+
"source_seed": 42,
|
| 30 |
+
"task": "opaque_edit"
|
| 31 |
+
},
|
| 32 |
+
{
|
| 33 |
+
"id": "bird_remove_background",
|
| 34 |
+
"category": "background removal",
|
| 35 |
+
"prompt": "Remove the background from <image1>. Keep the entire kingfisher and the mossy branch unchanged, including fine feather edges and feet. This is an RGBA image with transparency. The image has alpha channel and the background is transparent.",
|
| 36 |
+
"input_file": "bird_background.png",
|
| 37 |
+
"input_sha256": "40a0f73bb407a394fa9e8a3f6922455df716b9725ad07437fa10c1daca2c2095",
|
| 38 |
+
"source": "evaluation/bf16/texture-s42.png",
|
| 39 |
+
"source_seed": 42,
|
| 40 |
+
"task": "alpha_extraction"
|
| 41 |
+
},
|
| 42 |
+
{
|
| 43 |
+
"id": "cup_identity",
|
| 44 |
+
"category": "identity control",
|
| 45 |
+
"prompt": "Keep <image1> unchanged. Preserve all objects, colors, details, lighting and background exactly.",
|
| 46 |
+
"input_file": "cup_material.png",
|
| 47 |
+
"input_sha256": "91e967685fbbd79ba13daece22a0f72c863cb518db88d5d2a6f9aecfc5f292b1",
|
| 48 |
+
"source": "evaluation/bf16/composition-s42.png",
|
| 49 |
+
"source_seed": 42,
|
| 50 |
+
"task": "identity"
|
| 51 |
+
}
|
| 52 |
+
]
|
cards/huggingface.md
CHANGED
|
@@ -65,8 +65,9 @@ image.save("output.png")
|
|
| 65 |
```
|
| 66 |
|
| 67 |
The saved quantization configuration is detected automatically. Do not re-quantize
|
| 68 |
-
these weights at load time. For editing, use
|
| 69 |
-
|
|
|
|
| 70 |
For transparency, use the upstream RGBA prompt format and save PNG files.
|
| 71 |
|
| 72 |
Use the bundled loader on the pinned runtime: it loads/offloads the two INT8
|
|
@@ -76,6 +77,10 @@ this tested stack. The helper does not change the checkpoint or quantization.
|
|
| 76 |
|
| 77 |
## Informal release evaluation
|
| 78 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 79 |
**This community evaluation accompanies this model release and is provided for reference only. It does not represent any official evaluation by Qwen, Hugging Face, ModelScope, or their teams.** Results reflect a small, locally selected sample on one hardware/software configuration; they are not a standardized ranking or a guarantee of quality, speed, or memory requirements.
|
| 80 |
|
| 81 |
{{EVALUATION_EN}}
|
|
|
|
| 65 |
```
|
| 66 |
|
| 67 |
The saved quantization configuration is detected automatically. Do not re-quantize
|
| 68 |
+
these weights at load time. For editing, use a seed independent of the source image
|
| 69 |
+
(for example 1000042 when the source used 42), starting at output_resolution=1024.
|
| 70 |
+
The retained 2048px section is historical evidence, not a general recommendation.
|
| 71 |
For transparency, use the upstream RGBA prompt format and save PNG files.
|
| 72 |
|
| 73 |
Use the bundled loader on the pinned runtime: it loads/offloads the two INT8
|
|
|
|
| 77 |
|
| 78 |
## Informal release evaluation
|
| 79 |
|
| 80 |
+
Historical v1 editing reused the source seed 42. This confounds the 1024px editing
|
| 81 |
+
quality assessment through possible noise replay. See `EDITING_UPDATE.md` and
|
| 82 |
+
`evaluation/editing-v2/` when present for the revised independent-seed evaluation.
|
| 83 |
+
|
| 84 |
**This community evaluation accompanies this model release and is provided for reference only. It does not represent any official evaluation by Qwen, Hugging Face, ModelScope, or their teams.** Results reflect a small, locally selected sample on one hardware/software configuration; they are not a standardized ranking or a guarantee of quality, speed, or memory requirements.
|
| 85 |
|
| 86 |
{{EVALUATION_EN}}
|
cards/modelscope.md
CHANGED
|
@@ -65,8 +65,8 @@ image.save("output.png")
|
|
| 65 |
```
|
| 66 |
|
| 67 |
加载时会自动读取已保存的量化配置,无需再次指定量化参数。
|
| 68 |
-
图像编辑请使用
|
| 69 |
-
`output_resolution`
|
| 70 |
透明图生成使用官方 RGBA 提示词格式,并保存为 PNG 以保留透明通道。
|
| 71 |
|
| 72 |
在固定版本环境下请使用仓库附带的加载函数:它依次加载并卸载两个 INT8 组件,
|
|
|
|
| 65 |
```
|
| 66 |
|
| 67 |
加载时会自动读取已保存的量化配置,无需再次指定量化参数。
|
| 68 |
+
图像编辑请使用与源图独立的种子(如源图为 42 时编辑用 1000042),
|
| 69 |
+
从 `output_resolution=1024` 起步。下文 2048px 部分为历史证据,不是通用推荐。
|
| 70 |
透明图生成使用官方 RGBA 提示词格式,并保存为 PNG 以保留透明通道。
|
| 71 |
|
| 72 |
在固定版本环境下请使用仓库附带的加载函数:它依次加载并卸载两个 INT8 组件,
|
docs/editing-audit-20260924.md
ADDED
|
@@ -0,0 +1,83 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 改图评测审计(2026-09-24)
|
| 2 |
+
|
| 3 |
+
本次更新只修订推理入口、评测与说明,不修改、重新量化或重新下载模型权重。
|
| 4 |
+
历史评测文件及其测量实现保留。新协议名称为 `editing-v2`。
|
| 5 |
+
|
| 6 |
+
## 已确认的评测问题
|
| 7 |
+
|
| 8 |
+
1. 旧图像来源为 BF16、CPU generator、seed 42;旧编辑同样固定 seed 42。
|
| 9 |
+
相同随机流、种子和噪声张量形状会复用生成源图的初始噪声。
|
| 10 |
+
上游 issue #14824 的报告者确认换编辑种子后,其过锐化/光晕失效消失。
|
| 11 |
+
这使旧 1024px seed-42 编辑不能作为无混淆的质量结论。
|
| 12 |
+
2048px 改变了噪声形状,不能把它的所有瑕疵也都归因于精确噪声重放。
|
| 13 |
+
2. 旧 2048px 结果同时改变输出面积、参考图缩放、调度器序列长度对应的 sigma 和
|
| 14 |
+
VAE 分块,单个毛衣样例改善不足以支持统一推荐 2048px。
|
| 15 |
+
3. `output_resolution=width` 混淆面积尺度和横向像素数;非方形图固定输出尺寸还会
|
| 16 |
+
改变构图。新入口分开设置面积尺度与显式输出尺寸,并记录实际尺寸。
|
| 17 |
+
4. 背景替换不等于背景移除。旧雪林输出几乎不透明,不能用于透明边缘评价。
|
| 18 |
+
5. 旧编辑组只用一个种子,缺少独立背景移除、保持原图控制及 alpha/多底色检查。
|
| 19 |
+
|
| 20 |
+
## 核对过的实现和参数
|
| 21 |
+
|
| 22 |
+
- 固定 Diffusers 提交 `80c7ed262aeffbeb43ef13ae04baeb9b84515a69`。
|
| 23 |
+
2026-09-24 下载的官方 main 提交 `e0118ade2f60234c41bacf40330a7e2f61108849` 中,
|
| 24 |
+
QwenImage21 pipeline 与 transformer 源码与本地逐行相同;没有证据支持盲目升级依赖。
|
| 25 |
+
- 40 步、CFG=1、KV cache 是本次固定对照设置。未随意增加 CFG 或添加未生效的负面词。
|
| 26 |
+
- 输入 RGBA 保留;上游按训练约定只对白底合成视觉编码器副本,VAE 接收 RGBA。
|
| 27 |
+
不将 `.convert('RGB')` 作为抠图修复;不对输出阈值化、腐蚀、平滑或锐化。
|
| 28 |
+
- CPU 随机数生成器、模型 CPU 卸载、INT8 辅助张量修复均保持不变。
|
| 29 |
+
- VAE 分块是内存优化,必须与不分块对照区分。FP32 解码实验只改变解码器计算精度,
|
| 30 |
+
不会恢复已经在 BF16 编码/去噪阶段损失的信息。
|
| 31 |
+
|
| 32 |
+
## 修订协议
|
| 33 |
+
|
| 34 |
+
共同输入及其 SHA256 沿用历史评测。固定编辑种子 1000042/1000123,源图种子声明为 42;
|
| 35 |
+
发现种子冲突或重复、输入哈希变化、输出目录已存在则拒绝运行。
|
| 36 |
+
默认 1024 面积尺度、40 步、CFG=1、KV cache、不分块;BF16/INT8 在独立进程运行。
|
| 37 |
+
|
| 38 |
+
五类用例:人物衣服改色、杯子改材质、鸟图背景替换、鸟与枝干透明背景提取、杯子保持原图。
|
| 39 |
+
背景替换沿用原提示词;背景移除新增显式 RGBA 指令。保持原图结果是误改诊断,
|
| 40 |
+
不要求生成式编辑器逐像素无损返回输入。
|
| 41 |
+
|
| 42 |
+
每张保留原始 PNG、实际模式/尺寸、输入/输出哈希、真实 sigma 序列和 alpha 分布,
|
| 43 |
+
另存 alpha 图、黑底、白底、棋盘底,供 100% 放大检查羽毛/杯沿及平坦背景。
|
| 44 |
+
alpha≤5、alpha≥250 分别作为透明/近不透明的描述阈值,不作为成功判定。
|
| 45 |
+
没有真实 alpha 标注或目标区域 mask,故不宣称 matting SAD/边缘 F1/身份保持分数。
|
| 46 |
+
BF16/INT8 像素差异仅描述两种精度的偏移,不能替代编辑成功率。
|
| 47 |
+
|
| 48 |
+
本次审计开启 `--save-latents`,其保存开销使记录耗时不用于性能排名。
|
| 49 |
+
正常性能重测应去掉该开关,保留完整预热,并保持进程隔离。
|
| 50 |
+
|
| 51 |
+
## 单变量对照(已观察)
|
| 52 |
+
|
| 53 |
+
**短竖污损已定位到默认 VAE 分块解码路径。** 对同一个 2048px 去噪后潜变量:
|
| 54 |
+
BF16 分块有明显短竖痕迹;仅关闭分块后所检查背景的痕迹消失;FP32 保持分块仍有痕迹。
|
| 55 |
+
三个实验使用同一份 VAE checkpoint,未改变权重文件。重生成的故障 PNG 与初次探针逐字节一致。
|
| 56 |
+
这证明本例竖纹由分块解码引入,但不等于解决了同图的语义编辑失败。
|
| 57 |
+
不分块解码仍保留枝干丢失和鸟体粗糙细节,不能靠解码修复其上游编码/去噪结果。
|
| 58 |
+
|
| 59 |
+
固定 INT8、旧提示词、40 步、CFG=1、分块:
|
| 60 |
+
|
| 61 |
+
- 2048px 杯子从 seed 42 改为 1000042 后仍有细竖纹;换种子不等于解决全部污损。
|
| 62 |
+
- 2048px 鸟图改用 1000042 后仍出现白底、枝干丢失和粗糙细节。
|
| 63 |
+
- 同种子 1000042 改为 1024px 后,鸟与枝干得以保留,背景出现变化;这并不说明雪林
|
| 64 |
+
指令已被完整准确执行,也不能推广为所有素材的最佳分辨率。
|
| 65 |
+
|
| 66 |
+
完整新协议和同潜变量 VAE 对照结果以发布包的 `evaluation/editing-v2/AUDIT.md` 为准。
|
| 67 |
+
不能由当前证据断言所有剩余瑕疵均非权重/训练分布所致。
|
| 68 |
+
|
| 69 |
+
## 复现及发布准备
|
| 70 |
+
|
| 71 |
+
运行命令见根 README 的“修订改图评测(v2)”。
|
| 72 |
+
`scripts.editing_report` 会拒绝不完整矩阵、种子/参数/哈希不一致或伪造透明度记录。
|
| 73 |
+
`scripts.release` 对新评测核对模型身份、实测源码哈希和配对调度轨迹。
|
| 74 |
+
平台候选��保留历史数据,将 v2 放入独立目录并在模型卡顶部解释方法修正。
|
| 75 |
+
上传只做 `--dry-run`;实际发布仍使用经过校验的完整候选目录。
|
| 76 |
+
|
| 77 |
+
## 上游依据
|
| 78 |
+
|
| 79 |
+
- https://github.com/huggingface/diffusers/issues/14824 (包含后续更正,不能只读最初的故障描述)
|
| 80 |
+
- https://github.com/huggingface/diffusers/tree/e0118ade2f60234c41bacf40330a7e2f61108849
|
| 81 |
+
- https://github.com/QwenLM/Qwen-Image-2.1
|
| 82 |
+
|
| 83 |
+
下载快照、issue 评论与提交信息保存在 `artifacts/upstream-audit-20260924/`。
|
evaluation/editing-v2/AUDIT.md
ADDED
|
@@ -0,0 +1,78 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Editing v2 visual audit / 改图 v2 逐图审计
|
| 2 |
+
|
| 3 |
+
2026-09-24. Five cases, two seeds (1000042 and 1000123), BF16 and INT8: **20 outputs / 10 pairs**.
|
| 4 |
+
Weights, fixed dependency versions and CPU offload implementation are unchanged.
|
| 5 |
+
All measured runs completed with exit code 0. `process-isolation.jsonl` records launcher and actual
|
| 6 |
+
inference PIDs separately (Windows venv uses a launcher); original launcher records are retained
|
| 7 |
+
in `process-launchers-original.jsonl`. Actual PIDs are taken from each measured `environment.json`.
|
| 8 |
+
|
| 9 |
+
Parameters: 1024px area scale, 40 steps, CFG=1, KV cache enabled, untiled BF16 VAE, CPU generator.
|
| 10 |
+
All inputs are 1024px BF16-generated RGBA images with source seed 42, shared by both precisions.
|
| 11 |
+
Source seeds never equal edit seeds. Full warmup is excluded, but diagnostic latent saving adds
|
| 12 |
+
overhead, so times are **not** used for speed or latency claims.
|
| 13 |
+
|
| 14 |
+
## Observations / 观察
|
| 15 |
+
|
| 16 |
+
Every case/seed pair was inspected. Original PNGs and alpha/white/black/checker displays are linked
|
| 17 |
+
in `comparison.html`. Enlarged crops are display aids only; no scored output was retouched.
|
| 18 |
+
|
| 19 |
+
| Case | Both seeds, both precisions / 两种精度与两个种子的观察 |
|
| 20 |
+
|---|---|
|
| 21 |
+
| portrait_recolor | Cream sweater becomes navy. Broad face, pose and window lighting remain, but facial/hair/fabric details drift. / 毛衣改为藏蓝,大体保留人物与光线,五官、发丝、织物并非无损保持。 |
|
| 22 |
+
| cup_material | Middle cup becomes silver metal, while three-cup ordering and green apple remain. Inspected flat-background crops no longer show the conspicuous short vertical stains of the historical 2048px samples; subtle texture remains. / 中杯变为银色金属,排列与绿苹果保留;抽查平坦背景未见旧 2048px 样例的明显短竖污损,仍有细纹理。 |
|
| 23 |
+
| bird_background | Snowy/white blurred forest appears while bird and mossy branch remain. Background structure and feather/branch detail change. / 出现雪色虚化林景,保留鸟和苔藓枝干,背景布局、羽毛与枝干细节仍变化。 |
|
| 24 |
+
| bird_remove_background | Real transparent background; bird and branch retained. Inspected head/beak edges look substantially cleaner than the old 2048px white-background failure, but there is no ground-truth alpha mask to establish matting accuracy. / 真实透明背景,鸟与枝干保留,抽查头部与鸟喙边缘较旧白底失败样例规整;没有 alpha 真值,不能认定为精确抠图。 |
|
| 25 |
+
| cup_identity | Seed 1000042 broadly retains the scene. **Seed 1000123 changes the green apple to yellow in BOTH BF16 and INT8 despite the unchanged-image instruction.** This control fails and is not hidden. / seed 1000042 大体保持原图;**1000123 在两种精度下都误改了苹果颜色**,保留该失败,不将这一组宣称为无损编辑。 |
|
| 26 |
+
|
| 27 |
+
## Alpha inspection / 透明度检查
|
| 28 |
+
|
| 29 |
+
The four background-removal outputs have roughly 71.2–71.8% near-transparent pixels (alpha≤5/255),
|
| 30 |
+
and roughly 0.8% soft-alpha pixels (5<alpha<250). Exact values are in raw records.
|
| 31 |
+
These descriptive fractions are **not** quality scores: transparent area does not prove correct edges.
|
| 32 |
+
Opaque edit outputs have no near-transparent background in this suite.
|
| 33 |
+
|
| 34 |
+
四张背景移除图透明像素占比约 71.2%–71.8%,过渡像素约 0.8%。统计仅用来区分真实透明与白底,
|
| 35 |
+
不是质量评分;不能把本应保留的主体被删掉后得到的“大透明面积”当作成功。
|
| 36 |
+
|
| 37 |
+
## Methodological limits / 方法限制
|
| 38 |
+
|
| 39 |
+
- The historical 1024px seed-42 edit reused source noise; independent seeds remove this known confound.
|
| 40 |
+
Upstream explanation and corrections: https://github.com/huggingface/diffusers/issues/14824 .
|
| 41 |
+
- Seed change alone does not fix the retained 2048px tiled failures. Lower resolution and VAE tiling
|
| 42 |
+
are independent factors and must not be collapsed into a quantization conclusion.
|
| 43 |
+
- Source fixtures are generated by the same base model. This is a small regression set, not an
|
| 44 |
+
external-photograph benchmark, a human identity test, or a standardized editing ranking.
|
| 45 |
+
- No target-region masks, ground-truth alpha mattes, blinded ratings, OCR/CLIP/FID scores or
|
| 46 |
+
claims of universal artifact removal. Paired pixel differences only describe BF16/INT8 drift.
|
| 47 |
+
- Exact original source files for the historical main/editing suites remain shipped. New protocol
|
| 48 |
+
source hashes and upstream class hashes are recorded separately. No weights or scheduler configs
|
| 49 |
+
were changed to obtain these results.
|
| 50 |
+
|
| 51 |
+
原始故障图片、单变量分辨率/种子对照与同潜变量解码实验保留在本目录 `audit/`。
|
| 52 |
+
剩余失败不能一概排除模型权重、训练分布或生成式编辑本身的影响。
|
| 53 |
+
|
| 54 |
+
## Same-latent VAE diagnosis / 同潜变量 VAE 解码定位
|
| 55 |
+
|
| 56 |
+
The 2048px INT8 bird edit at seed 1000042 was reproduced in a fresh process with a PNG hash
|
| 57 |
+
identical to the initial probe. Its denormalized decoder input is retained in
|
| 58 |
+
`audit/latent-2048/bird_background-s1000042-decode.pt`.
|
| 59 |
+
|
| 60 |
+
| Decoder | Observed flat-background stains |
|
| 61 |
+
|---|---|
|
| 62 |
+
| BF16, default 256px tile / 192px stride | Obvious short vertical stains |
|
| 63 |
+
| BF16, tiling disabled | Stains absent in inspected matching background region |
|
| 64 |
+
| FP32, same tiling enabled | Stains remain |
|
| 65 |
+
|
| 66 |
+
Each decoder used the same saved latent hash and the same checkpoint bytes; no denoising was
|
| 67 |
+
rerun for the alternate decoders. The full BF16 decode and tiled FP32 decode both completed.
|
| 68 |
+
This isolates the visible short vertical stains in this sample to tiled VAE decoding, rather
|
| 69 |
+
than INT8 quantization or BF16 decoder arithmetic alone. It does not prove every artifact in
|
| 70 |
+
every image has the same cause. The missing branch and degraded bird texture persist after full
|
| 71 |
+
decoding, so they cannot be repaired by merely switching decoder precision or tiling.
|
| 72 |
+
|
| 73 |
+
三条解码路径使用同一潜变量和同一 checkpoint。短竖痕迹随分块开关变化,而不随单独提升
|
| 74 |
+
解码精度消失,因此本例可定位为分块解码伪影。语义失败仍保留,不把所有问题都归入该结论。
|
| 75 |
+
|
| 76 |
+
See `audit/decoder-compare-all.jpg`, `audit/decoder-crops.png` (unscaled matching crops),
|
| 77 |
+
individual raw PNGs and `audit/decoder-summary.json` for hashes and pairwise pixel differences.
|
| 78 |
+
No cleanup filter or postprocessing was applied to any raw output.
|
evaluation/editing-v2/audit/decode-bf16-full/decoded-alpha.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-bf16-full/decoded-black.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-bf16-full/decoded-checker.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-bf16-full/decoded-white.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-bf16-full/decoded.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-bf16-full/record.json
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"dtype": "bf16",
|
| 3 |
+
"tiling": false,
|
| 4 |
+
"seconds": 29.58638380000002,
|
| 5 |
+
"latents_sha256": "19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246",
|
| 6 |
+
"image_sha256": "a32e5d14545ea684005e1373a0308330682d15a6159a0db7020b74cafc1cb610",
|
| 7 |
+
"vae_source_sha256": "afb341db5e9d081e568ae4703119d1141d124aaf2fa9c061b3d4eb80ce73c15b",
|
| 8 |
+
"vae_weights": [
|
| 9 |
+
{
|
| 10 |
+
"path": "diffusion_pytorch_model.safetensors",
|
| 11 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 12 |
+
}
|
| 13 |
+
],
|
| 14 |
+
"image_mode": "RGBA",
|
| 15 |
+
"actual_size": [
|
| 16 |
+
2048,
|
| 17 |
+
2048
|
| 18 |
+
],
|
| 19 |
+
"alpha_min": 248,
|
| 20 |
+
"alpha_max": 255,
|
| 21 |
+
"alpha_transparent_fraction": 0.0,
|
| 22 |
+
"alpha_opaque_fraction": 0.9999995231628418,
|
| 23 |
+
"alpha_soft_fraction": 4.76837158203125e-07,
|
| 24 |
+
"alpha_thresholds": [
|
| 25 |
+
5,
|
| 26 |
+
250
|
| 27 |
+
],
|
| 28 |
+
"rgb_dx_mean": 0.020006714388728142,
|
| 29 |
+
"rgb_dy_mean": 0.019580036401748657
|
| 30 |
+
}
|
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-alpha.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-black.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-checker.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-fp32-tiled/decoded-white.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-fp32-tiled/decoded.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decode-fp32-tiled/record.json
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"dtype": "fp32",
|
| 3 |
+
"tiling": true,
|
| 4 |
+
"seconds": 18.333071200000177,
|
| 5 |
+
"latents_sha256": "19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246",
|
| 6 |
+
"image_sha256": "be79dfd73714a8be00e812af65d81aee0269a883be2fe895ec46a1a487e968a2",
|
| 7 |
+
"vae_source_sha256": "afb341db5e9d081e568ae4703119d1141d124aaf2fa9c061b3d4eb80ce73c15b",
|
| 8 |
+
"vae_weights": [
|
| 9 |
+
{
|
| 10 |
+
"path": "diffusion_pytorch_model.safetensors",
|
| 11 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 12 |
+
}
|
| 13 |
+
],
|
| 14 |
+
"image_mode": "RGBA",
|
| 15 |
+
"actual_size": [
|
| 16 |
+
2048,
|
| 17 |
+
2048
|
| 18 |
+
],
|
| 19 |
+
"alpha_min": 194,
|
| 20 |
+
"alpha_max": 255,
|
| 21 |
+
"alpha_transparent_fraction": 0.0,
|
| 22 |
+
"alpha_opaque_fraction": 0.998399019241333,
|
| 23 |
+
"alpha_soft_fraction": 0.0016009807586669922,
|
| 24 |
+
"alpha_thresholds": [
|
| 25 |
+
5,
|
| 26 |
+
250
|
| 27 |
+
],
|
| 28 |
+
"rgb_dx_mean": 0.018331428989768028,
|
| 29 |
+
"rgb_dy_mean": 0.018168220296502113
|
| 30 |
+
}
|
evaluation/editing-v2/audit/decoder-compare-all.jpg
ADDED
|
evaluation/editing-v2/audit/decoder-crops.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/decoder-processes.jsonl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"label": "latent-2048", "exit_code": 0, "args": ["-m", "scripts.benchmark_edits_v2", "--model", "models/int8", "--inputs", "artifacts\\editing-audit-20260924\\suite\\inputs", "--output", "artifacts\\editing-audit-20260924\\latent-2048", "--case", "bird_background", "--seeds", "1000042", "--resolution", "2048", "--vae-tiling", "--save-latents", "--no-warmup"]}
|
| 2 |
+
{"label": "decode-bf16-full", "exit_code": 0, "args": ["-m", "scripts.audit_vae_decode", "--model", "models/bf16", "--latents", "artifacts\\editing-audit-20260924\\latent-2048\\bird_background-s1000042-decode.pt", "--output", "artifacts\\editing-audit-20260924\\decode-bf16-full", "--dtype", "bf16"]}
|
| 3 |
+
{"label": "decode-fp32-tiled", "exit_code": 0, "args": ["-m", "scripts.audit_vae_decode", "--model", "models/bf16", "--latents", "artifacts\\editing-audit-20260924\\latent-2048\\bird_background-s1000042-decode.pt", "--output", "artifacts\\editing-audit-20260924\\decode-fp32-tiled", "--dtype", "fp32", "--tiling"]}
|
evaluation/editing-v2/audit/decoder-summary.json
ADDED
|
@@ -0,0 +1,82 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"decode-bf16-full": {
|
| 3 |
+
"dtype": "bf16",
|
| 4 |
+
"tiling": false,
|
| 5 |
+
"seconds": 29.58638380000002,
|
| 6 |
+
"latents_sha256": "19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246",
|
| 7 |
+
"image_sha256": "a32e5d14545ea684005e1373a0308330682d15a6159a0db7020b74cafc1cb610",
|
| 8 |
+
"vae_source_sha256": "afb341db5e9d081e568ae4703119d1141d124aaf2fa9c061b3d4eb80ce73c15b",
|
| 9 |
+
"vae_weights": [
|
| 10 |
+
{
|
| 11 |
+
"path": "diffusion_pytorch_model.safetensors",
|
| 12 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 13 |
+
}
|
| 14 |
+
],
|
| 15 |
+
"image_mode": "RGBA",
|
| 16 |
+
"actual_size": [
|
| 17 |
+
2048,
|
| 18 |
+
2048
|
| 19 |
+
],
|
| 20 |
+
"alpha_min": 248,
|
| 21 |
+
"alpha_max": 255,
|
| 22 |
+
"alpha_transparent_fraction": 0.0,
|
| 23 |
+
"alpha_opaque_fraction": 0.9999995231628418,
|
| 24 |
+
"alpha_soft_fraction": 4.76837158203125e-07,
|
| 25 |
+
"alpha_thresholds": [
|
| 26 |
+
5,
|
| 27 |
+
250
|
| 28 |
+
],
|
| 29 |
+
"rgb_dx_mean": 0.020006714388728142,
|
| 30 |
+
"rgb_dy_mean": 0.019580036401748657,
|
| 31 |
+
"vs_bf16_tiled": {
|
| 32 |
+
"rgb_mae_white": 0.007886896841228008,
|
| 33 |
+
"rgb_psnr_white_db": 33.39505014952212,
|
| 34 |
+
"alpha_mae": 0.00024037367256823927
|
| 35 |
+
}
|
| 36 |
+
},
|
| 37 |
+
"decode-fp32-tiled": {
|
| 38 |
+
"dtype": "fp32",
|
| 39 |
+
"tiling": true,
|
| 40 |
+
"seconds": 18.333071200000177,
|
| 41 |
+
"latents_sha256": "19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246",
|
| 42 |
+
"image_sha256": "be79dfd73714a8be00e812af65d81aee0269a883be2fe895ec46a1a487e968a2",
|
| 43 |
+
"vae_source_sha256": "afb341db5e9d081e568ae4703119d1141d124aaf2fa9c061b3d4eb80ce73c15b",
|
| 44 |
+
"vae_weights": [
|
| 45 |
+
{
|
| 46 |
+
"path": "diffusion_pytorch_model.safetensors",
|
| 47 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 48 |
+
}
|
| 49 |
+
],
|
| 50 |
+
"image_mode": "RGBA",
|
| 51 |
+
"actual_size": [
|
| 52 |
+
2048,
|
| 53 |
+
2048
|
| 54 |
+
],
|
| 55 |
+
"alpha_min": 194,
|
| 56 |
+
"alpha_max": 255,
|
| 57 |
+
"alpha_transparent_fraction": 0.0,
|
| 58 |
+
"alpha_opaque_fraction": 0.998399019241333,
|
| 59 |
+
"alpha_soft_fraction": 0.0016009807586669922,
|
| 60 |
+
"alpha_thresholds": [
|
| 61 |
+
5,
|
| 62 |
+
250
|
| 63 |
+
],
|
| 64 |
+
"rgb_dx_mean": 0.018331428989768028,
|
| 65 |
+
"rgb_dy_mean": 0.018168220296502113,
|
| 66 |
+
"vs_bf16_tiled": {
|
| 67 |
+
"rgb_mae_white": 0.0013088202103972435,
|
| 68 |
+
"rgb_psnr_white_db": 51.63176635617525,
|
| 69 |
+
"alpha_mae": 8.16673637018539e-05
|
| 70 |
+
}
|
| 71 |
+
},
|
| 72 |
+
"bf16_tiled": {
|
| 73 |
+
"image_sha256": "177fc897274faa4846659ec273d8ae39453d67526dc91d2bcc71407ce4ccd9da",
|
| 74 |
+
"repeat_png_identical": true,
|
| 75 |
+
"vae_weights": [
|
| 76 |
+
{
|
| 77 |
+
"path": "diffusion_pytorch_model.safetensors",
|
| 78 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 79 |
+
}
|
| 80 |
+
]
|
| 81 |
+
}
|
| 82 |
+
}
|
evaluation/editing-v2/audit/int8-crops.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/COMPLETE.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"records": 1, "records_sha256": "92c93e44d324bf3201a04c7ade2b725670793e05603430fe4e8bd78c47e08e4a"}
|
evaluation/editing-v2/audit/latent-2048/bird_background-s1000042-decode.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246
|
| 3 |
+
size 2099025
|
evaluation/editing-v2/audit/latent-2048/bird_background-s1000042.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/cases.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"id": "bird_background",
|
| 4 |
+
"category": "background replacement",
|
| 5 |
+
"prompt": "Replace only the blurred forest background with a softly blurred snowy winter forest. Preserve the same kingfisher, its colors and pose, the mossy branch, framing and foreground lighting.",
|
| 6 |
+
"input_file": "bird_background.png",
|
| 7 |
+
"input_sha256": "40a0f73bb407a394fa9e8a3f6922455df716b9725ad07437fa10c1daca2c2095",
|
| 8 |
+
"source": "evaluation/bf16/texture-s42.png",
|
| 9 |
+
"source_seed": 42,
|
| 10 |
+
"task": "opaque_edit"
|
| 11 |
+
}
|
| 12 |
+
]
|
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-alpha.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-black.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-checker.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/diagnostics/bird_background-s1000042-white.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/latent-2048/environment.json
ADDED
|
@@ -0,0 +1,199 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"python": "3.13.5",
|
| 3 |
+
"platform": "Windows-11-10.0.26200-SP0",
|
| 4 |
+
"gpu": "NVIDIA GeForce RTX 5090",
|
| 5 |
+
"cuda": "12.8",
|
| 6 |
+
"packages": {
|
| 7 |
+
"torch": "2.10.0+cu128",
|
| 8 |
+
"torchvision": "0.25.0+cu128",
|
| 9 |
+
"diffusers": "0.41.0.dev0",
|
| 10 |
+
"transformers": "5.17.0",
|
| 11 |
+
"accelerate": "1.15.0",
|
| 12 |
+
"bitsandbytes": "0.50.2",
|
| 13 |
+
"safetensors": "0.8.0",
|
| 14 |
+
"huggingface-hub": "1.32.0",
|
| 15 |
+
"tokenizers": "0.23.2",
|
| 16 |
+
"numpy": "2.2.6",
|
| 17 |
+
"pillow": "12.2.0",
|
| 18 |
+
"psutil": "7.0.0"
|
| 19 |
+
},
|
| 20 |
+
"protocol": "editing-v2",
|
| 21 |
+
"pid": 13924,
|
| 22 |
+
"before_load_memory": {
|
| 23 |
+
"allocated_bytes": 0,
|
| 24 |
+
"reserved_bytes": 0,
|
| 25 |
+
"cuda_free_bytes": 32496418816,
|
| 26 |
+
"cuda_total_bytes": 34162016256
|
| 27 |
+
},
|
| 28 |
+
"model_identity": {
|
| 29 |
+
"kind": "int8",
|
| 30 |
+
"base_revision": "b3179ad355be050328e483a9dfdd9e60cd62adfa",
|
| 31 |
+
"files": [
|
| 32 |
+
{
|
| 33 |
+
"path": "model_index.json",
|
| 34 |
+
"size": 447,
|
| 35 |
+
"sha256": "cf1ecd104ea090855d60d8cec0895c1e9d6ee41b2f87e231b678beecd1cf7809"
|
| 36 |
+
},
|
| 37 |
+
{
|
| 38 |
+
"path": "processor/added_tokens.json",
|
| 39 |
+
"size": 707,
|
| 40 |
+
"sha256": "c0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680"
|
| 41 |
+
},
|
| 42 |
+
{
|
| 43 |
+
"path": "processor/chat_template.jinja",
|
| 44 |
+
"size": 5292,
|
| 45 |
+
"sha256": "3636d0f0bd6bef02654cdffdc447b79cb2cef8ab02cc75267345946291a489e4"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"path": "processor/merges.txt",
|
| 49 |
+
"size": 1671853,
|
| 50 |
+
"sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"path": "processor/preprocessor_config.json",
|
| 54 |
+
"size": 782,
|
| 55 |
+
"sha256": "93585062a80db5e8ca038efc7726a3e6411d9db948472d81d63c6303993be8c5"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"path": "processor/special_tokens_map.json",
|
| 59 |
+
"size": 613,
|
| 60 |
+
"sha256": "76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd"
|
| 61 |
+
},
|
| 62 |
+
{
|
| 63 |
+
"path": "processor/tokenizer.json",
|
| 64 |
+
"size": 11422654,
|
| 65 |
+
"sha256": "aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4"
|
| 66 |
+
},
|
| 67 |
+
{
|
| 68 |
+
"path": "processor/tokenizer_config.json",
|
| 69 |
+
"size": 5445,
|
| 70 |
+
"sha256": "81ec7bb9530159b326c0bef1d0b6c33d392090524014ea3f0123a3c1eb9c2af5"
|
| 71 |
+
},
|
| 72 |
+
{
|
| 73 |
+
"path": "processor/video_preprocessor_config.json",
|
| 74 |
+
"size": 817,
|
| 75 |
+
"sha256": "59c5c9eb52182eb14c06ffb10ca9effd29adce5f238a95de23ca14a38dbd2cb1"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"path": "processor/vocab.json",
|
| 79 |
+
"size": 2776833,
|
| 80 |
+
"sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"path": "scheduler/scheduler_config.json",
|
| 84 |
+
"size": 485,
|
| 85 |
+
"sha256": "5895f3a167c14a967fe9ac70c64924ae5acc79799e0679fd12907e594a713cd1"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"path": "text_encoder/config.json",
|
| 89 |
+
"size": 2487,
|
| 90 |
+
"sha256": "da4f7a17ffbcaef0d09f9c31cab01d77e2c25905676818279254b5a8bb371150"
|
| 91 |
+
},
|
| 92 |
+
{
|
| 93 |
+
"path": "text_encoder/generation_config.json",
|
| 94 |
+
"size": 467,
|
| 95 |
+
"sha256": "7dc6dd5e325f76cd2f75d428d41049e1f8ac0c4775d0800c0885b88bfe3f4c7f"
|
| 96 |
+
},
|
| 97 |
+
{
|
| 98 |
+
"path": "text_encoder/model-00001-of-00003.safetensors",
|
| 99 |
+
"size": 4999822155,
|
| 100 |
+
"sha256": "9b8ae3bd2a1e4884abc48c659212427bbbae06fb1bc17e7173583704fc0f6bdd"
|
| 101 |
+
},
|
| 102 |
+
{
|
| 103 |
+
"path": "text_encoder/model-00002-of-00003.safetensors",
|
| 104 |
+
"size": 4996432636,
|
| 105 |
+
"sha256": "d28d1a8b3994a43582acc5e2da15ff38b632fae1466f41bc7710d27ec170aa9e"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"path": "text_encoder/model-00003-of-00003.safetensors",
|
| 109 |
+
"size": 27729689,
|
| 110 |
+
"sha256": "5896ffa9e2b2a52f9d496755fde050306f21c449bd66c2526b40979033c6e244"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"path": "text_encoder/model.safetensors.index.json",
|
| 114 |
+
"size": 139297,
|
| 115 |
+
"sha256": "d3fc335d23047182f40d458efec86a4b187a766e0d1639426b6a9b7ab5b1ab8a"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"path": "transformer/config.json",
|
| 119 |
+
"size": 1297,
|
| 120 |
+
"sha256": "1a941b5389b5985cd16314641d708a1333a65748bcd3f74b1b8b1cd74b828202"
|
| 121 |
+
},
|
| 122 |
+
{
|
| 123 |
+
"path": "transformer/diffusion_pytorch_model-00001-of-00002.safetensors",
|
| 124 |
+
"size": 4989447305,
|
| 125 |
+
"sha256": "0d77daaa3129860f026567e0178fec4ed776f3cf2463da76a0823b9c381c3468"
|
| 126 |
+
},
|
| 127 |
+
{
|
| 128 |
+
"path": "transformer/diffusion_pytorch_model-00002-of-00002.safetensors",
|
| 129 |
+
"size": 2267331623,
|
| 130 |
+
"sha256": "5e1b8ee3917833687adb662830438dc612ace2cf4bff7b8898515184a888fde1"
|
| 131 |
+
},
|
| 132 |
+
{
|
| 133 |
+
"path": "transformer/diffusion_pytorch_model.safetensors.index.json",
|
| 134 |
+
"size": 77984,
|
| 135 |
+
"sha256": "96963ae89098cbfdb83fb09bfe0b91e34d8dfe812c65da5e1fbe452878a79ebe"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"path": "vae/config.json",
|
| 139 |
+
"size": 2079,
|
| 140 |
+
"sha256": "9785d527b278cb8b210e9f48a8028d92a4190968ce7e24c8fc85d9d1b82f6ba2"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"path": "vae/diffusion_pytorch_model.safetensors",
|
| 144 |
+
"size": 1350989512,
|
| 145 |
+
"sha256": "a07a1b7c4ee2966a1b3bdc37de9b4f983d56937e46619f709a80b6e490675417"
|
| 146 |
+
}
|
| 147 |
+
],
|
| 148 |
+
"fingerprint": "df2eb85e5f936d6b172d71605502055db9be34cb8590447488ce60f7e9d8dc22"
|
| 149 |
+
},
|
| 150 |
+
"offload": "model",
|
| 151 |
+
"offload_aux_fix": true,
|
| 152 |
+
"warmup": false,
|
| 153 |
+
"generator_device": "cpu",
|
| 154 |
+
"seeds": [
|
| 155 |
+
1000042
|
| 156 |
+
],
|
| 157 |
+
"resolution": 2048,
|
| 158 |
+
"steps": 40,
|
| 159 |
+
"kv_cache": true,
|
| 160 |
+
"vae_tiling": true,
|
| 161 |
+
"cases_sha256": "bc5fae0b7a9e9102f34a8e56db4503c0c6d8903b5c873b67b37cdfa47438572a",
|
| 162 |
+
"source_sha256": {
|
| 163 |
+
"benchmark_edits_v2.py": "e03a4d623c382dc55183ff1beb4d7eb5ee5612ab6bb84341c45a8c08495313ad",
|
| 164 |
+
"editing_protocol.py": "a6e683f5bfba35fc19484567feb32a50edcde33ed06918fad63c23af1806d8c4",
|
| 165 |
+
"benchmark.py": "39544666c2e94a0d56de5057c7ab1e88df90dd5ba4d2cba2428c11f9d7c4d9fb",
|
| 166 |
+
"runtime.py": "26db92afa7d5c72324080480abe52c8e677b899844b369d99ac895e9bb1fb71c"
|
| 167 |
+
},
|
| 168 |
+
"scheduler_config": {
|
| 169 |
+
"num_train_timesteps": 1000,
|
| 170 |
+
"shift": 1.0,
|
| 171 |
+
"use_dynamic_shifting": true,
|
| 172 |
+
"base_shift": 0.5,
|
| 173 |
+
"max_shift": 0.9,
|
| 174 |
+
"base_image_seq_len": 256,
|
| 175 |
+
"max_image_seq_len": 8192,
|
| 176 |
+
"invert_sigmas": false,
|
| 177 |
+
"shift_terminal": 0.02,
|
| 178 |
+
"use_karras_sigmas": false,
|
| 179 |
+
"use_exponential_sigmas": false,
|
| 180 |
+
"use_beta_sigmas": false,
|
| 181 |
+
"time_shift_type": "exponential",
|
| 182 |
+
"stochastic_sampling": false,
|
| 183 |
+
"_class_name": "FlowMatchEulerDiscreteScheduler",
|
| 184 |
+
"_diffusers_version": "0.37.0.dev0"
|
| 185 |
+
},
|
| 186 |
+
"vae_dtype": "torch.bfloat16",
|
| 187 |
+
"upstream_source_sha256": {
|
| 188 |
+
"QwenImage21Pipeline": "6985b2f1f25e8dd09ef85c867ebcad184b981f10c0b4f80757ca9cc135b8fa5e",
|
| 189 |
+
"AutoencoderKLQwenImage21": "afb341db5e9d081e568ae4703119d1141d124aaf2fa9c061b3d4eb80ce73c15b",
|
| 190 |
+
"QwenImage21Transformer2DModel": "0eb0555e21ca93195e1fe9389113cafbf0e8822f6454c3001cebb3d21521ebd7",
|
| 191 |
+
"FlowMatchEulerDiscreteScheduler": "1af27be5b2f92b7d139d3c50239be5ce3eafc4a7eddf59c2d30689f8ec31e93d"
|
| 192 |
+
},
|
| 193 |
+
"vae_tiles": {
|
| 194 |
+
"tile_sample_min_height": 256,
|
| 195 |
+
"tile_sample_min_width": 256,
|
| 196 |
+
"tile_sample_stride_height": 192,
|
| 197 |
+
"tile_sample_stride_width": 192
|
| 198 |
+
}
|
| 199 |
+
}
|
evaluation/editing-v2/audit/latent-2048/records.jsonl
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"protocol": "editing-v2", "case_id": "bird_background", "category": "background replacement", "prompt": "Replace only the blurred forest background with a softly blurred snowy winter forest. Preserve the same kingfisher, its colors and pose, the mossy branch, framing and foreground lighting.", "seed": 1000042, "source_seed": 42, "input_file": "bird_background.png", "input_sha256": "40a0f73bb407a394fa9e8a3f6922455df716b9725ad07437fa10c1daca2c2095", "input_diagnostics": {"image_mode": "RGBA", "actual_size": [1024, 1024], "alpha_min": 251, "alpha_max": 255, "alpha_transparent_fraction": 0.0, "alpha_opaque_fraction": 1.0, "alpha_soft_fraction": 0.0, "alpha_thresholds": [5, 250], "rgb_dx_mean": 0.019595997408032417, "rgb_dy_mean": 0.019570155069231987}, "width": 2048, "height": 2048, "output_resolution": 2048, "steps": 40, "cfg": 1.0, "kv_cache": true, "vae_tiling": true, "offload": "model", "seconds": 202.94168359999958, "before_memory": {"allocated_bytes": 0, "reserved_bytes": 0, "cuda_free_bytes": 32496418816, "cuda_total_bytes": 34162016256}, "peak_allocated_bytes": 23254572544, "peak_reserved_bytes": 25222447104, "image": "bird_background-s1000042.png", "image_sha256": "177fc897274faa4846659ec273d8ae39453d67526dc91d2bcc71407ce4ccd9da", "sigmas": [1.0, 0.9926459789276123, 0.985012948513031, 0.9770848155021667, 0.9688441157341003, 0.9602718353271484, 0.9513477683067322, 0.9420496821403503, 0.9323535561561584, 0.9222333431243896, 0.9116604924201965, 0.9006039500236511, 0.8890299201011658, 0.8769010901451111, 0.8641765117645264, 0.850811243057251, 0.8367556929588318, 0.8219550251960754, 0.8063481450080872, 0.7898675203323364, 0.7724375128746033, 0.7539740204811096, 0.7343817949295044, 0.7135545015335083, 0.6913712024688721, 0.6676953434944153, 0.642370879650116, 0.6152193546295166, 0.5860357284545898, 0.5545830726623535, 0.5205857753753662, 0.4837222695350647, 0.44361412525177, 0.3998132348060608, 0.3517848253250122, 0.29888612031936646, 0.24033641815185547, 0.17517942190170288, 0.1022295355796814, 0.019999980926513672, 0.0], "latency_comparable": false, "image_mode": "RGBA", "actual_size": [2048, 2048], "alpha_min": 194, "alpha_max": 255, "alpha_transparent_fraction": 0.0, "alpha_opaque_fraction": 0.9984118938446045, "alpha_soft_fraction": 0.0015881061553955078, "alpha_thresholds": [5, 250], "rgb_dx_mean": 0.018379991874098778, "rgb_dy_mean": 0.018215516582131386, "decode_latents": "bird_background-s1000042-decode.pt", "decode_latents_sha256": "19746d2cebd5ebb888e1df24d7c2c07631fbb91fcf6f6650225caa6e84cb2246"}
|
evaluation/editing-v2/audit/paired-birds.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/paired-cups.jpg
ADDED
|
evaluation/editing-v2/audit/probe/bird_background-1024-s1000042.jpg
ADDED
|
evaluation/editing-v2/audit/probe/bird_background-1024-s1000042.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/probe/bird_background-2048-s1000042.jpg
ADDED
|
evaluation/editing-v2/audit/probe/bird_background-2048-s1000042.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/probe/cup-preview.jpg
ADDED
|
evaluation/editing-v2/audit/probe/cup_material-2048-s1000042.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/audit/probe/records.jsonl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"case": "cup_material", "size": 2048, "seed": 1000042, "steps": 40, "vae_tiling": true, "seconds": 205.40556079999988, "image": "cup_material-2048-s1000042.png", "sha256": "03c296f4cda7f737b068f6adb493265e1e207799ce3c92bd818999c34a70eee6"}
|
| 2 |
+
{"case": "bird_background", "size": 2048, "seed": 1000042, "steps": 40, "vae_tiling": true, "seconds": 187.8806442, "image": "bird_background-2048-s1000042.png", "sha256": "177fc897274faa4846659ec273d8ae39453d67526dc91d2bcc71407ce4ccd9da"}
|
| 3 |
+
{"case": "bird_background", "size": 1024, "seed": 1000042, "steps": 40, "vae_tiling": true, "seconds": 26.06802820000007, "image": "bird_background-1024-s1000042.png", "sha256": "7e51d43d20482ca2b42193b22bbe1285cd0a6175e5dc4f6338c813550b2d233f"}
|
evaluation/editing-v2/bf16/COMPLETE.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"records": 10, "records_sha256": "41a5088800126b52312677a119585febdb0ed6a17191f1853667e8af19f8be28"}
|
evaluation/editing-v2/bf16/bird_background-s1000042-decode.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5d60d06020654c11078db5eaec59f69f28eceefbee579b7959cf3d78494f6015
|
| 3 |
+
size 526161
|
evaluation/editing-v2/bf16/bird_background-s1000042.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/bf16/bird_background-s1000123-decode.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e27fae36bf5bd455912505dbc8944a8e5bb01d5ff98641074891533a86d2a2d
|
| 3 |
+
size 526161
|
evaluation/editing-v2/bf16/bird_background-s1000123.png
ADDED
|
Git LFS Details
|
evaluation/editing-v2/bf16/bird_remove_background-s1000042-decode.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:322370af42fb748668fb34d55f71b625b3b36f0ecb968836a34e702389c1ad0f
|
| 3 |
+
size 526210
|
evaluation/editing-v2/bf16/bird_remove_background-s1000042.png
ADDED
|
Git LFS Details
|