Adds Img2Img2 Variant for HunyuanDiT.

[MnCSSJ4x]

What does this PR do?

Adds Img2Img variant for HunyuanaDiT as per discussion in #8992.

Before submitting

• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?

How to reproduce:

importtorchfromdiffusersimportHunyuanDiTImg2ImgPipelinefromdiffusers.utilsimportload_imagepipe=HunyuanDiTImg2ImgPipeline.from_pretrained(
"Tencent-Hunyuan/HunyuanDiT-Diffusers", torch_dtype=torch.float16
)
pipe.to("cuda")
url= (
"https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/kolors/bunny_source.png"
)
init_image=load_image(url)
# You may also use English prompt as HunyuanDiT supports both English and Chinese# prompt = "An astronaut riding a horse"prompt="一个宇航员在骑马"image=pipe(prompt, image=init_image).images[0]

Output:

A colab notebook demonstrating all results can be found here.

Who can review?

@a-r-r-o-w@DN6

[DN6]

cc: @yiyixuxu

[yiyixuxu]

looks really good!
thanks for the PR!

can we add a test (similar to https://github.com/huggingface/diffusers/blob/main/tests/pipelines/hunyuan_dit/test_hunyuan_dit.py) and doc too?

[yiyixuxu]

can we check strength too?

diffusers/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_img2img.py

Line 655 in 867e0c9

ifstrength<0orstrength>1:

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[yiyixuxu]

@MnCSSJ4x
The PR is pretty close to merge, I added a "contribution welcome" label so someone in the community can pick it up. Let me know if it is ok. If you have time and would like to work on this, we will remove the label :)

The work left:

1. remove the changes in the example folder, as the community pipeline has already added
2. add a test
3. provide a code example and show us some outputs:)

[MnCSSJ4x]

@yiyixuxu
Hey. I think there is an example notebook link already mentioned in the PR. I would need to update some commands there once the PR is merged. Sorry for not wrapping this up as my semester picked up. Regarding test(s) sure I can try to wrap everything up by end of this week. You can keep the tag up just in case I am unable to do so.

[vladmandic]

this is "close-to-merge" for exactly a year now, can diffusers team pick it up and carry over the finish line?
cc @yiyixuxu@DN6

[vladmandic]

gentle ping?

[yiyixuxu]

hi @vladmandic
the team really don't have bandwidth for this now. sorry