Tag: HTTP proxy for inference

Butter adds automatic template induction to improve dynamic LLM response caching

TL;DR Butter updated its HTTP proxy cache with automatic template induction so stored responses can generalize via variable placeholders. The…