[New feature] A Noise Injection Method for Flux

[SahilCarterr]

New Feature for FluxPipeline

Paper: Link
Code : Link
workflow : Link
This paper introduces Sample-specific Score-aware Noise Injection (SSNI) to improve diffusion-based purification (DBP) methods. Unlike existing approaches that use a fixed noise level (t*) for all samples, SSNI adapts t* based on how noisy or clean each sample is. Using a pre-trained score network, SSNI estimates a sample's deviation from the clean data and adjusts the noise level accordingly.

This have stunning Results with Flux

@sayakpaul @yiyixuxu

[sayakpaul]

@SahilCarterr consider avoiding human subjects :-)

Also, feel free to start a community pipeline.

[SahilCarterr]

I Found this in a reddit Post.I think this should be included in the main FluxPipeline.

[John6666cat]

I'm joining this issue too.
#10080

[John6666cat]

The code of FluxPipeline is based on StableDiffusionXLPipeline (or its original?), so I think it is extremely unlikely that bugs will occur, for better or for worse, even if we add sigmas option.

Rather, I think the branching is currently buggy. This is because FluxPipeline forcibly assigns a default value to sigmas, which should be None by default in StableDiffusionXLPipeline and other pipelines.😅

diffusers/src/diffusers/pipelines/flux/pipeline_flux.py

Line 112 in b66e691

if timesteps is not None and sigmas is not None:

    if timesteps is not None and sigmas is not None:
        raise ValueError("Only one of `timesteps` or `sigmas` can be passed. Please choose one to set custom values")

Fix in my test commit

ad3344e

sigmas: List[float] = None, # option

#sigmas = np.linspace(1.0, 1 / num_inference_steps, num_inference_steps)
sigmas = np.linspace(1.0, 1 / num_inference_steps, num_inference_steps) if sigmas is None and timesteps is None else sigmas

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[vladmandic]

ping to remove stale...

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[vladmandic]

ping to remove stale...