Posts Tagged ‘costseq3’
AI models are helping dirty industries go green
April 21, 2025Limits to economic growth | Nature Physics
December 24, 2024https://www.nature.com/articles/s41567-022-01652-6
Murphy, T. W. (2022). Limits to economic growth. Nature Physics, 18(8), 844–847. https://doi.org/10.1038/s41567-022-01652-6
The state of academic publishing in 3 graphs, 6 trends, and 4 thoughts | Dynamic Ecology
December 22, 2024QT:{{”
Publishing is growing exponentially – While the number of scientists is also growing exponentially, it is at a slower rate than papers. We are producing more papers per scientist every year. This is a profoundly important fact. Every ecologist knows the power and unsustainability of exponential growth. This also makes it abundantly clear that the publishers only deserve half the blame. Scientists have created a Red Queen situation in which we’re aggressively chasing opportunities to publish. Do we really need 1,000,000 (about +40%) more publications than 10 years ago! (Figure 1).
“}}
What is scaling? – ScienceDirect
December 8, 2024Scaling Laws for Neural Language Models
November 16, 2024https://arxiv.org/pdf/2001.08361
Jared Kaplan ∗
Johns Hopkins University, OpenAI
jaredk@jhu.edu
Sam McCandlish∗
OpenAI
sam@openai.com
Tom Henighan
OpenAI
henighan@openai.com
Tom B. Brown
OpenAI
tom@openai.com
Benjamin Chess
OpenAI
bchess@openai.com
Rewon Child
OpenAI
rewon@openai.com
Scott Gray
OpenAI
scott@openai.com
Alec Radford
OpenAI
alec@openai.com
Jeffrey Wu
OpenAI
jeffwu@openai.com
Dario Amodei
OpenAI
damodei@openai.com
Supersized AI – ScienceDirect
November 2, 2024https://www.sciencedirect.com/science/article/abs/pii/S0262407921018017
Rorvig, M. (2021). Supersized AI. The New Scientist, 251(3355), 36–40. https://doi.org/10.1016/s0262-4079(21)01801-7
How We’ll Reach a 1 Trillion Transistor GPU – IEEE Spectrum
August 19, 2024https://spectrum.ieee.org/trillion-transistor-gpu
Nice scaling graphs
Where the internet lives | Feb 3rd 2024 | The Economist
March 10, 2024https://www.economist.com/technology-quarterly/2024-02-03
nice discussion on the scaling economics of data centers