https://www.nature.com/articles/s41567-022-01652-6
Murphy, T. W. (2022). Limits to economic growth. Nature Physics, 18(8), 844–847. https://doi.org/10.1038/s41567-022-01652-6
Posts Tagged ‘scaling’
Limits to economic growth | Nature Physics
December 24, 2024Scaling Laws for Neural Language Models
November 16, 2024https://arxiv.org/pdf/2001.08361
Jared Kaplan ∗
Johns Hopkins University, OpenAI
jaredk@jhu.edu
Sam McCandlish∗
OpenAI
sam@openai.com
Tom Henighan
OpenAI
henighan@openai.com
Tom B. Brown
OpenAI
tom@openai.com
Benjamin Chess
OpenAI
bchess@openai.com
Rewon Child
OpenAI
rewon@openai.com
Scott Gray
OpenAI
scott@openai.com
Alec Radford
OpenAI
alec@openai.com
Jeffrey Wu
OpenAI
jeffwu@openai.com
Dario Amodei
OpenAI
damodei@openai.com
Supersized AI – ScienceDirect
November 2, 2024https://www.sciencedirect.com/science/article/abs/pii/S0262407921018017
Rorvig, M. (2021). Supersized AI. The New Scientist, 251(3355), 36–40. https://doi.org/10.1016/s0262-4079(21)01801-7
BioNeMo | Generative AI Platform | NVIDIA
April 21, 2024Where the internet lives | Feb 3rd 2024 | The Economist
March 10, 2024https://www.economist.com/technology-quarterly/2024-02-03
nice discussion on the scaling economics of data centers
What will drive computer performance after Moore’s law?
November 11, 2020It’s All In Your Head – Forbes – Nice description of Metcalfe’s Law by its inventor
October 13, 2012http://www.forbes.com/forbes/2007/0507/052.html
QT:”
Using a 35mm slide (see chart below), I argued that my customers needed their Ethernets to grow above a certain critical mass if they were to reap the benefits of the network effect. …. The cost of installing the cards at, say, a corporation would be proportional to the number of cards installed. The value of the network, though, would be proportional to the square of the number of users…..
Why should that be so? The network effect says that the value of that Ethernet card to the person on whose desk it sits is proportional to the number, N, of other computer users he can connect to. Now multiply this value by the number of users, and you have a value for the whole operation that is roughly proportional to N^2.
…
In 1993 George Gilder, seeking to quantify the network effect, uncovered a slide from my 1980s Ethernet sales presentation and the formula saying that value is proportional to N 2. He christened it Metcalfe’s Law….
Recall that there is a critical mass beyond which the value of the network exceeds its cost. Where is this crossover point? You can find it by solving CxN=BxN 2, where C is the constant of proportionality of cost and B is the constant of proportionality of value. The critical mass threshold can be expressed as N=C÷B. Not surprisingly, the lower the cost per connection, the lower the critical mass. The higher the value per connection, the lower the critical mass.
“
linkstream2 microblog 