https://www.newyorker.com/magazine/2023/11/20/holly-herndons-infinite-art
The artist and musician uses machine learning to make strange, playful work. She also advocates for artists’ autonomy in a world shaped by A.I.
https://www.newyorker.com/magazine/2023/11/20/holly-herndons-infinite-art
The artist and musician uses machine learning to make strange, playful work. She also advocates for artists’ autonomy in a world shaped by A.I.
https://www.nature.com/articles/s41586-024-07421-0
Farquhar, S., Kossen, J., Kuhn, L., & Gal, Y. (2024). Detecting hallucinations in large language models using semantic entropy. Nature, 630(8017), 625–630. https://doi.org/10.1038/s41586-024-07421-0
https://www.economist.com/science-and-technology/2024/07/11/researchers-are-figuring-out-how-large-language-models-work
QT:{{”
A sparse autoencoder is, essentially, a second, smaller neural network that is trained on the activity of an LLM, looking for distinct patterns in activity when “sparse” (ie, very small) groups of its neurons fire together. Once many such patterns, known as features, have been identified, the researchers can determine which words trigger which features. The Anthropic team found individual features that corresponded to specific cities, people, animals and chemical elements, as well as higher-level concepts such as transport infrastructure, famous female tennis players, or the notion of secrecy. They performed this exercise three times, identifying 1m, 4m and, on the last go, 34m features within the Sonnet LLM.
“}}
The Old-Fashioned Library at the Heart of the A.I. Boom
https://www.nytimes.com/2024/05/15/technology/openai-library-office.html