[LoRA] Add LoRA support to AuraFlow

[hameerabbasi]

What does this PR do?

This PR is a simple rebase of #9017

cc @sayakpaul for review.

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[hameerabbasi]

Thanks for the helping hand, @hlky!

[hlky]

See https://github.com/huggingface/diffusers/blob/main/tests/lora/test_lora_layers_flux.pyhttps://github.com/huggingface/diffusers/blob/main/tests/lora/test_lora_layers_mochi.py etc as an example for tests. Seems to be missing transformer_cls, get_dummy_inputs and probably others, ping @sayakpaul if you need help with lora tests.

[hameerabbasi]

@sayakpaul Okay; I'm at a point where I've got actual, valid test failures but have no idea where to look.
pytest.log

[hameerabbasi]

Here's the log after the latest commit: pytest.log

[sayakpaul]

Thanks for the PR. I have left some comments to fix a couple of things. LMK if they're unclear.

[hameerabbasi]

Latest test log.

[hameerabbasi]

@sayakpaul Last CI ping. 😅

[sayakpaul]

Code styling issues need to be fixed.

[sayakpaul]

@bot /style

[github-actions]

Style fixes have been applied. View the workflow run here.

[hameerabbasi]

@sayakpaul CI blocked again. 🥹

[hameerabbasi]

@sayakpaul CI needs approval. 😅

[hameerabbasi]

@sayakpaul CI ping. 🥹

[hameerabbasi]

@sayakpaul Since I'm a first-time contributor, you'll need to approve the workflows on GitHub, opening/closing the PR or pushing commits doesn't seem to work. GitHub shows me the following notice on desktop, but the corresponding notice is invisible on mobile:

[hameerabbasi]

@sayakpaul Another approval on CI please.

[hameerabbasi]

@sayakpaul Merge before other issues pop up? 😛

[AstraliteHeart]

@sayakpaul can we please get this merged? very excited about getting AF ecosystem up to speed.

[hameerabbasi]

@sayakpaul The CI failures seem unrelated:

FAILED tests/pipelines/test_pipelines.py::DownloadTests::test_local_save_load_index - huggingface_hub.errors.LocalEntryNotFoundError

EDIT: This seems to be the cause:

Entry Not Found for url: https://huggingface.co/hf-internal-testing/tiny-playground-v2-5-pipe/resolve/f8baf778d35bdd9b187ae05f082700bc88e301a8/vae/diffusion_pytorch_model.bin.

[sayakpaul]

Thanks for your contributions.

[hameerabbasi]

Thanks so much for the reviews and patience!