Request: Option to show intermediate images in CLI, not just web

[n00mkrad]

Today code to show the generation progress for the web ui was added.

Is it possible to also add this as a CLI switch? Would be very helpful for my use case.

[bakkot]

The CLI has always shown progress:

What more are you looking for?

[blessedcoolant]

The CLI has always shown progress:

What more are you looking for?

I believe he's probably asking for a way to save intermediary progress so he can make a video out of the progress later.

[lstein]

Ah. In that case I think we should just use the callback mechanism to create a video.

[n00mkrad]

The CLI has always shown progress:

What more are you looking for?

I want to dump a PNG every x steps.

[n00mkrad]

The CLI has always shown progress:

What more are you looking for?

I believe he's probably asking for a way to save intermediary progress so he can make a video out of the progress later.

Yes but for my use case just saving PNGs is fine, stuff like creating videos can be done afterwards with ffmpeg etc.

[tildebyte]

Tricky, because of the matrix formed by 1- Differences in how terminals allow displaying images 2 - Differences across OSs

[bakkot]

I don't know if it's worth having a CLI flag for this, but it's easy to do with a small bit of code. This will save the intermediate frames to outputs/intermediates.

import transformers

from ldm.dream.pngwriter import PngWriter
from ldm.simplet2i import T2I

t2i = T2I()
transformers.logging.set_verbosity_error()
t2i.load_model()

prompt = "a warrior prince, highly detailed digital art"

step_writer = PngWriter('./outputs/intermediates/')
step_index = 1
prefix = step_writer.unique_prefix()

def image_progress(sample, step):
    global step_index
    seed = t2i.seed
    image = t2i._sample_to_image(sample)
    name = f'{prefix}.{seed}.{step_index}.png'
    metadata = f'{prompt} -S{seed} [intermediate]'
    step_writer.save_image_and_prompt_to_png(image, metadata, name)
    step_index += 1

t2i.prompt2png(
    prompt=prompt,
    outdir="outputs/results",
    steps=15,
    step_callback=image_progress
)

[n00mkrad]

I don't know if it's worth having a CLI flag for this, but it's easy to do with a small bit of code. This will save the intermediate frames to outputs/intermediates.

import transformers

from ldm.dream.pngwriter import PngWriter
from ldm.simplet2i import T2I

t2i = T2I()
transformers.logging.set_verbosity_error()
t2i.load_model()

prompt = "a warrior prince, highly detailed digital art"

step_writer = PngWriter('./outputs/intermediates/')
step_index = 1
prefix = step_writer.unique_prefix()

def image_progress(sample, step):
    global step_index
    seed = t2i.seed
    image = t2i._sample_to_image(sample)
    name = f'{prefix}.{seed}.{step_index}.png'
    metadata = f'{prompt} -S{seed} [intermediate]'
    step_writer.save_image_and_prompt_to_png(image, metadata, name)
    step_index += 1

t2i.prompt2png(
    prompt=prompt,
    outdir="outputs/results",
    steps=15,
    step_callback=image_progress
)

How do I integrate this into dream.py from this repo? Sorry, my Python skills are rather basic.

I already tried to do something like this but failed.

[bakkot]

Don't - just save it as a file in this directory and run it with python this-script.py.

[n00mkrad]

Don't - just save it as a file in this directory and run it with python this-script.py.

But that's not what I wanted, I want to have the same functionality as usual, but in addition to dumping a progress PNG every x steps.

[n00mkrad]

Any help? Can't be too hard to do this, but my limited Python skills fail me here.

[search620]

I Would like to request additions to the next version that the steps will be added to the name of the image.
And also removing the date from the name of the image is confusing. Thanks!

[lstein]

Sorry for the delay on acting on this. I'm going to put this into the feature request list in the Discussion section. It will get implemented at some point in the not-too-distant future.