CNTXT.store
Search entity graph
PRODUCTParent Company: Portkey

Portkey Gateway

Official Documentation→

Capabilities & Summary

API gateway providing prompt routing, fallback strategy, and context cache.

Primary Use Cases

llm-gateway-routing

Implemented Concepts & Architecture

Context Caching
The practice of storing pre-computed Key-Value (KV) states of prompt tokens on model servers to eliminate redundant processing and drastically reduce latency and cost for repetitive context.

Product Category

Context Caching & Optimization

Parent Entity

Portkey →

AI gateway providing latency monitoring, prompt caching, and context routing.