Semantic Cache
A local semantic answer cache built on ChromaDB cosine similarity that isolates entries by user, model, prompt and knowledge version, with labeled-pair threshold calibration, TTL expiration and source invalidation.
- Period
- October 2026
- Release
- Public source project
- Work type
- Independent open-source project
- Development
- AI-assisted, with verification
What I built
A local semantic answer cache built on ChromaDB cosine similarity that isolates entries by user, model, prompt and knowledge version, with labeled-pair threshold calibration, TTL expiration and source invalidation.
Developed with AI coding assistance. Source code, reproduction instructions and tests are available in the linked repository.
What was checked
6 automated calibration, isolation and invalidation checks passed locally on 2 November 2026.
Verification date: 2 November 2026. Tests cover the included fixtures and do not establish production performance.
What this demonstrates
Verified on a small synthetic question-pair dataset with zero paid API calls. Production use requires domain-specific threshold recalibration and does not establish production cost savings from the demo.
All projects