Streaming Generation

During scene generation, the streaming generation (Server-Sent Events) method is used to visualize progress in real time.

The generated scene text is previewed on screen gradually in real time.

Configuration

Streaming generation is enabled by default, but can be toggled with the following settings:

• Model Configuration Option: Set with the --stream option. Example: --stream=false
• Settings Screen Switch: Configure via the "Streaming" toggle on the Settings Screen.
• Automatic Disabling: If a provider's actual response does not enable streaming, it is automatically disabled for that provider only (reloading the app clears this).

info

Since there is additional generated text beyond the scene text itself, wait times occur both before the preview appears and after it appears.