ChatGPT's Guest Traffic Now Runs On Far Fewer GPUs After Internal Optimization. Yet The Bigger Question Is Whether Those Savings Extend To Paid And API Workloads.

Source: International Business Times

A smartphone displaying the ChatGPT application logo is photographed in front of an OpenAI logo screen in Tunis,Tunisia on May 20,2026. OpenAI engineers developed a software-only optimization in June 2026 that cuts the cost of running their AI models by more than half — and when applied to ChatGPT's logged-out visitor traffic, reduced the number of Nvidia GPUs serving that entire segment to roughly a couple hundred, according to The Information citing a person familiar with internal discussions. The gain comes entirely from better use of OpenAI's existing server infrastructure — no new chips, no upgraded hardware, no architectural overhaul.