Hindsight · review build · data not yet validated
From 2015 to 2020, the cost to train a GPT-3 sized model dropped 65% at an annual rate, from $875 million to $4.6 million. According to our research, the cost will decline another four orders of magnitude to $500 in 2030.
Not graded yet.