Skip to content

Add community pipeline for semantic guidance for FLUX - #10610

Merged
linoytsaban merged 10 commits into
huggingface:mainfrom
Marlon154:sega-flux-community
Jan 27, 2025
Merged

Add community pipeline for semantic guidance for FLUX#10610
linoytsaban merged 10 commits into
huggingface:mainfrom
Marlon154:sega-flux-community

Conversation

@Marlon154

Copy link
Copy Markdown
Contributor

What does this PR do?

This PR adds the new FluxSemanticGuidancePipeline to enable semantic guidance (original paper) capabilities in the Flux model family. Works like already existing semantic guidance pipelines.
Example on usage is in the doc string, it works with:

  • FLUX adapters
  • Multiple images per prompt
  • Multiple prompts
  • CFG with negative prompt
  • Without CFG

Examples

PromptOriginalEditEdited
A cat holding a sign that says hello worldOriginalremove "cat", add "dog"Edited
race car on a trackimage-original-2add "black sports car"image-edit-2
A sports car under a tree. (with adapter)adapter_orginaladd "apple tree", add "dog sitting on the right side of a car"adapter_edit

Before submitting

Who can review?

@linoytsaban

@linoytsabanlinoytsaban self-assigned this Jan 20, 2025

@linoytsabanlinoytsaban left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great work, thanks @Marlon154!

@linoytsaban
linoytsaban requested a review from hlkyJanuary 21, 2025 11:04

@hlkyhlky left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py
Comment threadexamples/community/pipeline_flux_semantic_guidance.py Outdated
Comment threadexamples/community/pipeline_flux_semantic_guidance.py Outdated
Comment threadexamples/community/pipeline_flux_semantic_guidance.py Outdated
@Marlon154

Copy link
Copy Markdown
ContributorAuthor

@hlky implemented requested changes

@linoytsaban
linoytsaban requested a review from hlkyJanuary 27, 2025 08:50

@hlkyhlky left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making the changes @Marlon154

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@linoytsaban
linoytsaban merged commit f7f36c7 into huggingface:mainJan 27, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@Marlon154@HuggingFaceDocBuilderDev@linoytsaban@hlky