https://www.wired.com/story/how-to-use-chatgpt-create-custom-gpt-openai/
Posts Tagged ‘gpt3’
Detecting hallucinations in large language models using semantic entropy | Nature
August 11, 2024https://www.nature.com/articles/s41586-024-07421-0
Farquhar, S., Kossen, J., Kuhn, L., & Gal, Y. (2024). Detecting hallucinations in large language models using semantic entropy. Nature, 630(8017), 625–630. https://doi.org/10.1038/s41586-024-07421-0
Researchers are figuring out how large language models work
August 11, 2024https://www.economist.com/science-and-technology/2024/07/11/researchers-are-figuring-out-how-large-language-models-work
QT:{{”
A sparse autoencoder is, essentially, a second, smaller neural network that is trained on the activity of an LLM, looking for distinct patterns in activity when “sparse” (ie, very small) groups of its neurons fire together. Once many such patterns, known as features, have been identified, the researchers can determine which words trigger which features. The Anthropic team found individual features that corresponded to specific cities, people, animals and chemical elements, as well as higher-level concepts such as transport infrastructure, famous female tennis players, or the notion of secrecy. They performed this exercise three times, identifying 1m, 4m and, on the last go, 34m features within the Sonnet LLM.
“}}
OpenAI may be changing how the world interacts with language. But inside headquarters, there is a homage to the written word: a library.
May 18, 2024The Old-Fashioned Library at the Heart of the A.I. Boom
https://www.nytimes.com/2024/05/15/technology/openai-library-office.html
【Science】Regulating advanced artificial agents
April 9, 2024AI and Biology
March 10, 2024A.I. Is Learning What It Means to Be Alive
Given troves of data about genes and cells, A.I. models have made some surprising discoveries. What could they teach us someday?
https://www.nytimes.com/2024/03/10/science/ai-learning-biology.html
linkstream2 microblog 