New features / v2.1.292
Add prompt caching to $.model.complete
CHANGELOG · original
Added prompt caching to $.model.complete for mods: prompt and system take blocks of text, and cache: true on a block caches the request up to it Open official changelog ↗ Related documentation
Background on the feature; see the changelog above for this specific change.