New features / v2.1.295
Add upstream_ttfb_ms gateway timeout
CHANGELOG · original
Added support for timeouts.upstream_ttfb_ms on the Claude apps gateway's Bedrock, Vertex, Foundry and other cloud upstreams: a value you set now limits how long a stream may take to start there, after which it fails over or gets a 502 Open official changelog ↗ Related documentation
Background on the feature; see the changelog above for this specific change.