Support pass kwargs to sd3 custom attention processor

[Matrix53]

What does this PR do?

Fixes#8855 as #9517

As mentioned in #8855 and #9516, pass kwargs to custom attention processor is preferable when implementing layout control, attention replacing or introducing side effect to attention computation. Now this feature is supported by sd, sdxl, FLUX series, but not sd3. This PR fix the problem, and may support future training-free experiments in sd3 series models.

example code:

classMyAttentionProcessor(JointAttnProcessor2_0):
def__init__(self, **custom_args):
super().__init__()
# some initializationdef__call__(self, ..., added_argu=None) ->torch.FloatTensor:
# custom attention forward passmy_processor=MyAttentionProcessor(**custom_args)
pipe.transformer.set_attn_processor(my_processor) # sd3 pipelinejoint_attention_kwargs= {"added_argu": 100} # prepare passing added_argu to attention processorpipe.transformer(..., joint_attention_kwargs=joint_attention_kwargs) # custom transformer forward pass

The documentation already describes usage of the joint_attention_kwargs:

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Hello @yiyixuxu@sayakpaul, I just want to do the same to sd3 as to FLUX in #9517

[a-r-r-o-w]

The PR looks good for the specific changes required to support kwargs, but all the other changes are unrelated. Please revert any changes not related supporting kwargs such as multi-line import, multi-line assigments, etc. These were not required before, nor needed now due to 120 token column limit. If these were caused by your text editor automatically, please configure it to use the same settings as pyproject.yaml for this specific repo

[Matrix53]

Thanks @a-r-r-o-w 😊, I've configured my editor and reverted all unrelated changes. Now this PR only contains necessary changes.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[hlky]

Edit: let's add joint_attention_kwargs = joint_attention_kwargs or {} instead like https://github.com/huggingface/diffusers/pull/9517/files

[hlky]

Thanks @Matrix53!

[hlky]

cc @sayakpaul@yiyixuxu WDYT about making default joint_attention_kwargs as {}? We end up doing joint_attention_kwargs or {} anyway, there are several checks for None which are sort of unnecessary.

[sayakpaul]

Not opposed to the idea.

[yiyixuxu]

thanks!