← Back to all articles
OpenAI BlogOctober 1, 2024

Prompt Caching in the API

Excerpt

Offering automatic discounts on inputs that the model has recently seen