Skip to main content

Execution and streaming


Core · Execution and streaming

Core principle — Keep long work bounded while still delivering useful progress to the client.
Deadlines, cancellation, backpressure, SSE framing, and terminal states that behave under disconnects.

Key concepts

Backpressure

Bound buffers

Disconnect

Abort signal

Terminal

Done or error event

Boundary model

Ownership matrix

Engineering considerations

Streaming increases responsiveness but also keeps resources open longer; its lifecycle must be more explicit than a normal response.
Design constraint A stream is a resource lease, not an infinite response.

Implementation notes

Decision lens

References

Last modified on September 10, 2026