Uh oh!
There was an error while loading. Please reload this page.
[WIP][LoRA] support sd3.5 non-diffusers loras. - #10167
Conversation
HuggingFaceDocBuilderDev
commented
Dec 10, 2024
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
vladmandic
commented
Dec 10, 2024
i'll give it a test. fyi, we just did a complete lora processing refactoring in sdnext and changed load/apply methods from forward to pre-processing.
|
sayakpaul
commented
Dec 11, 2024
Thanks, Vlad! |
| raise ValueError("Invalid LoRA checkpoint.") | ||
| transformer_state_dict = {k: v for k, v in state_dict.items() if "transformer." in k} | ||
| transformer_state_dict = {k: v for k, v in state_dict.items() if k.startswith(f"{self.transformer_name}.")} |
There was a problem hiding this comment.
To inform the user about it when load_lora_weights() effectively becomes a no-op.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Please note that issues that do not follow the contributing guidelines are likely to be ignored. |
What does this PR do?
Fixes#9950.
Currently, it only supports LoRAs having the MMDiT blocks.
@vladmandic possible to test this? We can improve support for the LoRAs involving non-MMDiT blocks as we go.