CNTXT.store
Search entity graph
PRODUCTParent Company: Helicone

Helicone Proxy

Official Documentation→

Capabilities & Summary

Open-source proxy for tracking LLM token budgets and prompt caches.

Primary Use Cases

token-budget-logging

Implemented Concepts & Architecture

Context Caching
The practice of storing pre-computed Key-Value (KV) states of prompt tokens on model servers to eliminate redundant processing and drastically reduce latency and cost for repetitive context.

Product Category

Context Caching & Optimization

Parent Entity

Helicone →

Open-source LLM observability platform providing request logging and context caching.