Uh oh!
There was an error while loading. Please reload this page.
[docs] IP-Adapter - #6897
Conversation
HuggingFaceDocBuilderDev
commented
Feb 7, 2024
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
yiyixuxu
left a comment
There was a problem hiding this comment.
great! thank you
I'm not sure where to add this but I think we need to add this information here #6162 (comment)
basically for certain ip-adapter-plus checkpoints (e.g. ip-adapter-plus_sdxl_vit-h), you will have to load the image_encoder from a different folder
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
sayakpaul
commented
Feb 10, 2024
Feel free to merge once @yiyixuxu approves. Looks really good! |
| # IP-Adapter | ||
| [IP-Adapter](https://hf.co/papers/2308.06721) is a lightweight adapter that enables prompting a diffusion model with an image. This method decouples the cross-attention layers of the image and text features. The image features are generated from an image encoder. Files generated from IP-Adapter are only ~100MBs. | ||
| [IP-Adapter](https://hf.co/papers/2308.06721) is a lightweight adapter that enables prompting a diffusion model with an image. This method decouples the cross-attention layers of the image and text features. The image features are generated from an image encoder. |
There was a problem hiding this comment.
Does it make sense to indicate the file size to give an upfront idea about the tinyness of the adapter?
There was a problem hiding this comment.
I think it's probably ok to not mention file size which seems like an extra detail for a reference page. It's already mentioned in the loading guide (where it is more relevant) which is linked on this page.
khipp
left a comment
There was a problem hiding this comment.
I read through the guide and added some suggestions if you don't mind. Great work!
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
yiyixuxu
left a comment
There was a problem hiding this comment.
thanks! feel free to merge anytime!
This (WIP) PR creates a more detailed and centralized guide for all things IP-Adapter related:
➖ removes non-loading related IP-Adapter content from the loading adapters guide
➕ adds IP-Adapter guide to the Techniques section
➕ adds
set_ip_adapter_scaleto the API docs➕ IP-Adapter guide is largely divided based on tasks (text-to-image, image-to-image, image-to-video, etc.) and specific use cases (face models, instant generation, controllable generation, etc.)