[IP-Adapter] adding IP adapter support to all ControlNet and T2I pipelines

[yiyixuxu]

we recently added IP-adapter support to many of our pipelines including all the text2img, img2img and inpaint pipelines, as well as the text2img ControlNet pipeline.

anyone interested in adding it to rest of the ControlNet pipelines and T2I pipelines? You can check out this PR to see how it should be added #5713

[juancopi81]

Hi @yiyixuxu,

I'd like to give it a try and add support for the StableDiffusionControlNetInpaintPipeline

[a-r-r-o-w]

Awesome! @juancopi81 Will you be working on controlnets or other pipelines as well? If not, I'd be happy to take it up for txt2img :)

[juancopi81]

Sure! 😃 go ahead, I'll be working for now only in this pipeline: StableDiffusionControlNetInpaintPipeline

[charchit7]

Hey @yiyixuxu I'll also look into it :)

[charchit7]

Hey @juancopi81 @a-r-r-o-w is it okay if I take up for remaining one(img2img)? #self-assign

[juancopi81]

Hi @charchit7, for me it is ok, I took the StableDiffusionControlNetInpaintPipeline and I already created the PR, so in my case I am not working for the moment in any other pipeline.

[charchit7]

@a-r-r-o-w I am almost done with img2img :)