470
Discussion[D] GPT-3, The $4,600,000 Language Model(self.MachineLearning)
submitted 5 years, 7 months ago* (edited 18 hours, 40 minutes after) by mippie_moe to /r/MachineLearning (3m)
since 5 years, 7 months ago
11 of 11
Tip Reveddit Real-Time can notify you when your content is removed.
your account history
Tip Check if your account has any removed comments.
view my removed comments you are viewing a single comment's thread.
view all comments
So the most interesting question here is:
I'm almost more impressed by the fundraising than the technology.
Microsoft gave OpenAI a billion dollars in Azure compute credits.
IIRC just a part of the billion dollars was paid in compute credits?
$4.6m may be the cost for cloud providers if you simply went and turned on a switch and reran the code. OpenAI likely used Azure credits but in this volume it makes sense to buy a kit from Nvidia and just pay for the electricity. There's no way this cost anyone $4.6m, that's just the sticker price like a hospital bill in the US.
[removed] content loading...
Gpt3 isn’t dominating any market
You can hire a lot of humans to do that for $4.6 million.
Bots don’t grow a spine or develop morals.
Neither do most humans, to be honest
No, you couldn’t. You would need a dozen large gpus just to run one instance of it.