Quickly Scaling Online Storage to Support Over 1 Billion ChatGPT Users (Part 2)
AI news flash: In part two of its series, OpenAI explains how it scaled its storage layer, called Habitat, to support ChatGPT as it approaches a billion users. The original summary points to three core approaches: reliable multi-tenancy, a global caching layer, and Azure Cosmos DB underneath, with ChatGPT reads becoming 12x faster.