Browsed by
Category: Language

Large language models may face a hard limit to their abilities

Large language models may face a hard limit to their abilities

Anil Ananthaswamy writes: On December 17, 1962, Life International published a logic puzzle consisting of 15 sentences describing five houses on a street. Each sentence was a clue, such as “The Englishman lives in the red house” or “Milk is drunk in the middle house.” Each house was a different color, with inhabitants of different nationalities, who owned different pets, and so on. The story’s headline asked: “Who Owns the Zebra?” Problems like this one have proved to be a…

Read More Read More

Hannah Arendt’s love of the word

Hannah Arendt’s love of the word

Daegan Miller writes: “What is the subject of our thought? Experience! Nothing else! And if we lose the ground of experience then we get into all kinds of theories.” — Hannah Arendt Hannah Arendt first fled the Nazis in 1933. It was a harrowing escape: she had just been released from the Gestapo prison in Berlin after eight days of interrogation for collecting evidence of German anti-Semitism from the stacks of the Prussian State Library. She knew she had little…

Read More Read More

Large Language Models don’t actually model human language

Large Language Models don’t actually model human language

The Register reports: In May, Sam Altman, CEO of $80-billion-or-so OpenAI, seemed unconcerned about how much it would cost to achieve the company’s stated goal. “Whether we burn $500 million a year or $5 billion – or $50 billion a year – I don’t care,” he told students at Stanford University. “As long as we can figure out a way to pay the bills, we’re making artificial general intelligence. It’s going to be expensive.” Statements like this have become commonplace…

Read More Read More

How much does language shape thought?

How much does language shape thought?

Manvir Singh writes: Everyone can agree that language affects thought. If I told you that I have a pet badger and twenty-two canaries, you’d have new thoughts about my home life. The real question is whether a language itself has features that affect how its speakers think: Does conversing in Spanish for a month make objects seem more gendered? Does speaking English rather than Hindi make you less casteist, and maybe more capitalist? Today, questions like these tend to be…

Read More Read More

The race to translate animal communication into human language

The race to translate animal communication into human language

Arik Kershenbaum writes: In 2025 we will see AI and machine learning leveraged to make real progress in understanding animal communication, answering a question that has puzzled humans as long as we have existed: “What are animals saying to each other?” The recent Coller-Dolittle Prize, offering cash prizes up to half-a-million dollars for scientists who “crack the code” is an indication of a bullish confidence that recent technological developments in machine learning and large language models (LLMs) are placing this…

Read More Read More

How primate eye tracking reveals new insights into the evolution of language

How primate eye tracking reveals new insights into the evolution of language

Mariya Surmacheva/Shutterstock By Vanessa Wilson, University of Hull The human environment is a very social one. Family, friends, colleagues, strangers – they all provide a continuous stream of information that we need to track and make sense of. Who is dating whom? Who is in a fight with whom? While our capacity for dealing with such a large social network is impressive, it’s not something especially unique to humans. Other primates do it too. We – humans and other primates…

Read More Read More

Project analyzing human language usage shuts down because ‘generative AI has polluted the data’

Project analyzing human language usage shuts down because ‘generative AI has polluted the data’

Robyn Speer, the creator of wordfreq, writes: The wordfreq data is a snapshot of language that could be found in various online sources up through 2021. There are several reasons why it will not be updated anymore. Generative AI has polluted the data I don’t think anyone has reliable information about post-2021 language usage by humans. The open Web (via OSCAR) was one of wordfreq’s data sources. Now the Web at large is full of slop generated by large language…

Read More Read More

Linguistic relativity holds that your worldview is structured by the language you speak. Is it true?

Linguistic relativity holds that your worldview is structured by the language you speak. Is it true?

James McElvenny writes: Anyone who has learned a second language will have made an exhilarating (and yet somehow unsettling) discovery: there is never a one-to-one correspondence in meaning between the words and phrases of one language and another. Even the most banal expressions have a slightly different sense, issuing from a network of attitudes and ideas unique to each language. Switching between languages, we may feel as if we are stepping from one world into another. Each language seemingly compels…

Read More Read More

How fetuses learn to talk while they’re still in the womb

How fetuses learn to talk while they’re still in the womb

Darshana Narayanan writes: Loud, shrill and penetrating – a baby’s cry is its first act of communication. A simple adaptation that makes it less likely that the baby’s needs will be overlooked. And babies aren’t just crying for attention. While crying, they are practising the melodies of speech. In fact, newborns cry in the accent of their mother tongue. They make vowel-like sounds, growl and squeal – these are protophones, sounds that eventually turn into speech. Babies communicate as soon…

Read More Read More

Ultra-detailed brain map shows neurons that encode the meaning of words

Ultra-detailed brain map shows neurons that encode the meaning of words

Nature reports: By eavesdropping on the brains of living people, scientists have created the highest-resolution map yet of the neurons that encode the meanings of various words. The results hint that, across individuals, the brain uses the same standard categories to classify words — helping us to turn sound into sense. The study is based on words only in English. But it’s a step along the way to working out how the brain stores words in its language library, says…

Read More Read More

Babies in the womb exposed to two languages hear speech differently when born

Babies in the womb exposed to two languages hear speech differently when born

PsyPost reports: Researchers have shown for the first time that newborns of monolingual mothers respond differently to playback of a carefully selected sound stimulus than newborns of bilingual mothers. The findings suggest that bilingual newborns are sensitive to a wider range of acoustic variation of speech, at the cost of being less selectively tuned in to any single language. These results underscore the importance of prenatal exposure for learning about speech. It’s well established that babies in the womb hear…

Read More Read More

How Neanderthal language differed from modern human – they probably didn’t use metaphors

How Neanderthal language differed from modern human – they probably didn’t use metaphors

Neanderthal skull (foreground) contrasted with that of a modern human from the Palaeolithic. Petr Student By Steven Mithen, University of Reading The Neanderthals (Homo neanderthalensis) fascinate researchers and the general public alike. They remain central to debates about the nature of the genus Homo (the broad biological classification that humans and their relatives fall into). Neanderthals are also vital for understanding the uniqueness or otherwise of our species, Homo sapiens. We shared an ancestor with the Neanderthals around 600,000 years…

Read More Read More

Sperm whale clicks could hide a surprisingly complex ‘alphabet’

Sperm whale clicks could hide a surprisingly complex ‘alphabet’

Science Alert reports: A recent analysis of a sperm whale’s vocalizations suggests variations in ‘clicks’ represent a kind of alphabet that forms the basis of a complex communication system. Members of the conservation initiative Project CETI discovered series of clicks less than 2 seconds in length act as codas – basic units (phonemes) of cetacean speech. The highly social mammals have previously been heard identifying themselves with unique patterns of clicking, but this is the first time a combinatorial and…

Read More Read More

Individual neurons tune to complex speech sounds and cues

Individual neurons tune to complex speech sounds and cues

The Transmitter reports: Individual neurons in the cerebral cortex are finely tuned to the sounds of human speech—beyond just picking out consonants and vowels, two new independent studies show. The cells encode small sounds called phonemes that are said in a similar way; the order in which syllables are spoken; the beginning of sentences; vocal pitch; and word stress, among other features of speech. The studies were able to reveal this new level of detail by using Neuropixels probes, which…

Read More Read More

How chain-of-thought reasoning helps neural networks compute

How chain-of-thought reasoning helps neural networks compute

Ben Brubaker writes: Your grade school teacher probably didn’t show you how to add 20-digit numbers. But if you know how to add smaller numbers, all you need is paper and pencil and a bit of patience. Start with the ones place and work leftward step by step, and soon you’ll be stacking up quintillions with ease. Problems like this are easy for humans, but only if we approach them in the right way. “How we humans solve these problems…

Read More Read More

If we can learn to speak the language of whales, what should we say?

If we can learn to speak the language of whales, what should we say?

Ross Andersen writes: One night last winter, over drinks in downtown Los Angeles, the biologist David Gruber told me that human beings might someday talk to sperm whales. In 2020, Gruber founded Project CETI with some of the world’s leading artificial-intelligence researchers, and they have so far raised $33 million for a high-tech effort to learn the whales’ language. Gruber said that they hope to record billions of the animals’ clicking sounds with floating hydrophones, and then to decipher the…

Read More Read More