Skip to content

support StableDiffusionAdapterPipeline.from_single_file - #10552

Merged
yiyixuxu merged 2 commits into
huggingface:mainfrom
Teriks:sd_adapter_pipe_single_file_load
Jan 29, 2025
Merged

support StableDiffusionAdapterPipeline.from_single_file#10552
yiyixuxu merged 2 commits into
huggingface:mainfrom
Teriks:sd_adapter_pipe_single_file_load

Conversation

@Teriks

Copy link
Copy Markdown
Contributor

What does this PR do?

Adds support for from_single_file to StableDiffusionAdapterPipeline by inheriting FromSingleFileMixin

importdiffusersfromPILimportImagefromdiffusers.utilsimportload_imageimporttorch# checkpoint: https://civitai.com/api/download/models/74821?type=Model&format=SafeTensor&size=pruned&fp=fp16image=load_image(
"https://huggingface.co/datasets/diffusers/docs-images/resolve/main/t2i-adapter/color_ref.png"
)
color_palette=image.resize((8, 8))
color_palette=color_palette.resize((512, 512), resample=Image.Resampling.NEAREST)
adapter=diffusers.T2IAdapter.from_pretrained("TencentARC/t2iadapter_color_sd14v1", torch_dtype=torch.float16)
# single file loadpipe=diffusers.StableDiffusionAdapterPipeline.from_single_file(
'impressionismOil_sd15.safetensors',
adapter=adapter, torch_dtype=torch.float16)
pipe.to('cuda')
output=pipe(
prompt='impressionist oil painting of a sunset', image=color_palette).images[0]
output.save('test.png')

Previously working around this with:

pipe_class=type(
'StableDiffusionAdapterPipeline', (diffusers.loaders.FromSingleFileMixin, diffusers.StableDiffusionAdapterPipeline), {})

Fixes#9123

Before submitting

Who can review?

@DN6

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

DN6
DN6 approved these changes Jan 15, 2025
@Teriks

Copy link
Copy Markdown
ContributorAuthor

@yiyixuxu

@yiyixuxu
yiyixuxu merged commit 33f9361 into huggingface:mainJan 29, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

(feature) diffusers.StableDiffusionAdapterPipeline could inherit FromSingleFileMixin

5 participants

@Teriks@HuggingFaceDocBuilderDev@DN6@yiyixuxu@hlky