We’ve made streaming a tiny bit easier and simplified our API.

When we first launched streaming for language models you had to pass "stream": true with your request to enable it. Adoption of streaming has been great, with about one third of requests to compatible models requesting a stream, and our streaming infrastructure is more robust now than it was when we first launched it. This means we’re now in the position to just stream everything by default if the model supports it.

So you no longer need to pass "stream": true with your prediction request to get back a stream URL – if the model supports streaming, you’ll always get one back.

We’ve deprecated the field, but it’s still valid to pass it. If you do continue to pass "stream": true then if the model supports streaming it has no effect. And if the model doesn’t support streaming we’ll keep the current behaviour of responding with a 422.