Streaming output for language models

August 14, 2023

Replicate's API now supports server-sent event (SSE) streams for language models, giving you live output as the model is running. See the announcement blog post and our streaming guide for more details about how to use streaming output.

eventsource example