OpenAI detailed how it scaled its Habitat storage infrastructure to support products used by more than one billion people each week.
Habitat handles over 70 million requests per second and more than 500 petabytes of data across nearly 40 regions, supporting products including ChatGPT, the API and Codex. OpenAI said moving 95% of production requests to its Rust implementation produced sixfold CPU efficiency and fifteenfold memory efficiency compared with the Python version.