Skip to main content
Version: Legacy

Streaming Generation

During scene generation, the progress is visualized using streaming generation (Server-Sent Events). (Ver2.7.3)

The generated scene text is previewed on screen in real-time as it gradually appears.

Configuration​

Streaming generation is enabled by default, but can be toggled with the following settings:

  • Model Configuration Option: Set with the --stream option. Example: --stream=false
  • Settings Screen Switch: Configure via the "Streaming" toggle on the Settings Screen.
  • Automatic Disabling: If a provider's actual response does not enable streaming, it is automatically disabled for that provider only (reloading the app clears this).

Notes​

Since there is additional generated text beyond the scene text itself, wait times occur both before the preview appears and after it finishes.