For both consciousness and AI, attention is all you need
Michael Graziano writes: The most energy-expensive organ in the body is the brain. The human brain, for example, coming in at about 2% of the body’s mass, uses 20% of the body’s energy. Neural tissue is so costly that evolution does not generally favor large brains. Otherwise, the entire animal kingdom would have evolved giant ones, instead of just a few species that have found a way to exploit that trait. To pack as much capacity in as small a…