474
Discussion[D] GPT-3, The $4,600,000 Language Model(self.MachineLearning)
submitted 5 years, 7 months ago* (edited 18 hours, 40 minutes after) by mippie_moe to /r/MachineLearning (3m)
since 5 years, 7 months ago
4 of 4
Tip Reveddit Real-Time can notify you when your content is removed.
your account history
Tip Check if your account has any removed comments.
view my removed comments you are viewing a single comment's thread.
view all comments
There’s some work estimating algorithmic progress on tasks like linear programming and object recognition. It looks like algorithmic progress is comparable to compute progress if you zoom out, and much more important if you look at a smaller timeline (eg translation SOTA from a couple years before transformers vs SOTA afterwards).
Academic research built the Large Hadron Collider. Of course it has a chance if it decides to dedicate the resources.
Couple of interesting articles related to this question:
https://openai.com/blog/ai-and-efficiency/ https://arxiv.org/pdf/1909.01736.pdf