GPT-6 Prompt Caching Gets an Efficiency Upgrade, Cutting Long-Conversation Costs
AI news brief: this story is short on hard details, so here’s the quick rundown. OpenAI updated its prompt caching mechanism for GPT-6, aiming to boost cache hit rates and cut latency and cost. The update adds diagnostic tools so developers can see actual cache hits and misses and optimize prompt structure accordingly, plus ’explicit breakpoints’ to mark fixed vs. variable sections.