The dangers of seeing human minds as predictive machines
The machine they built is hungry. As far back as 2016, Facebook’s engineers could brag that their creation ‘ingests trillions of data points every day’ and produces ‘more than 6 million predictions per second’. Undoubtedly Facebook’s prediction engines are even more potent now, making relentless conjectures about your brand loyalties, your cravings, the arc of your desires. The company’s core market is what the social psychologist Shoshana Zuboff describes as ‘prediction products’: guesses about the future, assembled from ever-deeper forays into our lives and minds, and sold on to someone who wants to manipulate that future.
Yet Facebook and its peers aren’t the only entities devoting massive resources towards understanding the mechanics of prediction. At precisely the same moment in which the idea of predictive control has risen to dominance within the corporate sphere, it’s also gained a remarkable following within cognitive science. According to an increasingly influential school of neuroscientists, who orient themselves around the idea of the ‘predictive brain’, the essential activity of our most important organ is to produce a constant stream of predictions: predictions about the noises we’ll hear, the sensations we’ll feel, the objects we’ll perceive, the actions we’ll perform and the consequences that will follow. Taken together, these expectations weave the tapestry of our reality – in other words, our guesses about what we’ll see in the world become the world we see. Almost 400 years ago, with the dictum ‘I think, therefore I am,’ René Descartes claimed that cognition was the foundation of the human condition. Today, prediction has taken its place. As the cognitive scientist Anil Seth put it: ‘I predict (myself) therefore I am.’
Somehow, the logic we find animating our bodies is the same one transforming our body politic. The prediction engine – the conceptual tool used by today’s leading brain scientists to understand the deepest essence of our humanity – is also the one wielded by today’s most powerful corporations and governments. How did this happen and what does it mean?
One explanation for this odd convergence emerges from a wider historical tendency: humans have often understood the nervous system in terms of the flourishing technologies of their era, as the scientist and historian Matthew Cobb explained in The Idea of the Brain (2020). [Continue reading…]