CapabilitiesIncorrect
“The path is clear to 20x [GPT-4's total pre-training FLOPS] by the end of next year given their current infrastructure buildout.”
Said Aug 28, 2023Deadline Dec 31, 2024SemiAnalysis, 'Google Gemini Eats The World – Gemini Smashes GPT-4 By 5X, The GPU-Poors', August 28, 2023
20x GPT-4 (~2e25 FLOP) implies a ~4e26 FLOP training run by end-2024; Epoch AI's dataset records the first model above 1e26 FLOP as xAI's Grok-3 in February 2025, and no Google model publicly known or estimated to be near that scale was trained by the end of 2024.