LOADING: An error occurred. Update Chrome, try Firefox, or visit this post for more details.

⚠️Reddit changed how removals work, which breaks Reveddit's website. Install the extension to track removed content:Add to chromeAdd to firefoxWhat changed?
✖︎
about reveddit
⚙F.A.Q.add-ons
r/
status
copy sharelink
[+] show filters
473
Discussion[D] GPT-3, The $4,600,000 Language Model(self.MachineLearning)
submitted 5 years, 7 months ago* (edited 18 hours, 40 minutes after) by mippie_moe to /r/MachineLearning (3m)
217 commentsredditother-discussions (2+)subreddit-indexmessage modsop-focus

OpenAI’s GPT-3 Language Model Explained

Some int...

... view full text

since 5 years, 7 months ago
5 of 5

Tip Reveddit Real-Time can notify you when your content is removed.

your account history
(check your username's removed content. why?)
Tip Check if your account has any removed comments.
view my removed comments
you are viewing a single comment's thread.
view all comments
[–][deleted]7 points5 years, 7 months ago
[deleted] by user
(check your username's removed content. why?)
parenthide replies (1)as-of
[–]Ulfgardleo1 point5 years, 7 months ago

Hi,

you might have missed the relevant context of my reply:

So.... it costs 4.6M to train "in the cloud" but only 4M to 25M + electricity (quite a lot but on the whole insignificant, e.g. < 200k) to build the infrastructure on which these kinds of models could be researched.

Which doesn't seem that outrageously high tbh

A budget that is larger than the yearly budget of whole CS departments is outrageously high.

permalinkparentcontexthide replies (1)author-focusas-ofpreserve
[–][deleted]3 points5 years, 7 months ago
[deleted] by user
(check your username's removed content. why?)
parenthide replies (1)as-of
[–]Ulfgardleo1 point5 years, 7 months ago

Yes, a lot of what you mention is outrageous. But it is more so outrageous if it happens within the same field. E.g. as an experimental particle physicist i can expect my research to be expensive and thus i can expect to also be granted more Money by funding agencies (or access to those facilities at reasonable prices).

This does not happen at ML. most of this research will not be reproducible by independent parties. And given the extend of errors, under-reporting and misreporting in this field, this is bad for science.

permalinkparentcontexthide replies (1)author-focusas-ofpreserve
[–]elcric_krej1 point5 years, 7 months ago

Yes, a lot of what you mention is outrageous. But it is more so outrageous if it happens within the same field.

I gave examples from the same field, I am talking about the same fields where academia funding is much smaller (and includes many more people, as a counterbalance to that) than industry.

permalinkparentcontextauthor-focusas-ofpreserve
r/revedditremoved.substack.com
🚨 NEWS 🚨
✖︎

Important: Reddit Changed How Removals Work

A recent Reddit update makes mod-removed content disappear from profile pages, which breaks Reveddit's website.

Install the browser extension to receive removal alerts.

Add to chromeAdd to firefox

What changed?

r/revedditremoved.substack.com