How to use OzzyGT/ERNIE_Image_Turbo_sdnq_dynamic_int8 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("OzzyGT/ERNIE_Image_Turbo_sdnq_dynamic_int8", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0]
This is an int8 quantized version of Baidu/ERNIE-Image-Turbo using SDNQ (SD.Next Quantization) with the dynamic option.
You can find ready-to-use scripts in the diffusers-recipes repository.