“AI training cost declines continued at an annual rate of 70%, the cost to train a large language model to GPT-3 level performance collapsing from $4.6 million in 2020 to $450,000 in 2022. We expect cost declines to continue at a 70% rate through 2030.”
Said Jan 31, 2023Deadline Dec 31, 2030ARK Invest, Big Ideas 2023 annual research report (January 31, 2023)
Runs through 2030; ARK itself raised the assumed decline rate to ~75%/year in Big Ideas 2024.