Prompt Caching in the API
Offering automatic discounts on inputs that the model has recently seen
Originally reported by OpenAI Blog
Read original
Offering automatic discounts on inputs that the model has recently seen