Week 8: AI Supercomputers on a Path of Exponential Growth: Trends and Implications
A new study analyzing over 500 AI supercomputers from 2019 to 2025 reveals that their computational performance has been doubling every 9 months. This rapid growth is fueled by a yearly 1.6x increase in both the number of chips used per system and the performance of each individual chip. The study, conducted by Epoch AI, highlights a dramatic shift in ownership, with companies’ share of total computing power rising from approximately 40% in 2019 to an impressive 80% by 2025. This centralization of power in the private sector, led by the United States, which holds 75% of the total computing power in the dataset, has profound implications for the future of AI development and innovation. The exponential growth comes with significant costs. The power requirements and hardware costs for these supercomputers have also been doubling every year. For example, xAI's Colossus, as of March 2025, had an estimated hardware cost of $7 billion and required 300 megawatts of power. The article proje...