Prompt Caching: Reducing LLM Pricing & Latency

Prompt Caching is an optimization technique that stores frequently used context (like system instructions or documents) in the LLM provider's memory, reducing input cost and time-to-first-token.