0640 - Nature of Reality
Testing A Time-Jumping, Multiverse-Killing, Consciousness-Spawning Theory Of Reality
“This retroactive idea. It has to be that,” says Nobel Prize-winning mathematical physicist Sir Roger Penrose, reflecting on a problem about the building blocks of reality that has dogged physics for nearly a century. “Any sensible physicist wouldn't be perturbed by this,” he adds. “However, I'm not a sensible physicist.”
If Penrose isn’t a sensible physicist it’s because the laws of physics aren’t making sense, at least not on the subatomic level where the smallest things in the universe play by different rules than everything we see around us. He has reason to believe this disconnect involves a fissure that divides two different kinds of reality. He also has reason to believe that the physical process that bridges these realities will unlock answers to the physics of consciousness: the mystery of our own existence.
Penrose's contributions to math and physics are significant. He’s proposed a theory of sequential universes that existed before the big bang, traces of which seem to be penetrating ours. He collaborated with Stephen Hawking on the Penrose-Hawking singularity theorems, identifying points in the universe, singularities, where the gravitational forces are so intense that spacetime itself breaks down catastrophically.
For decades, Penrose has been working with anesthesiologist Stuart Hameroff on a theory of consciousness called Orchestrated Objective Reduction (Orch OR). Penrose primarily handles the physics of Orch OR whereas Hameroff handles the biology. Their theory was formulated as a response to serious gaps in established scientific frameworks spanning physics, neuroscience and psychology. All, some or none of the hypotheses in this theory might prove out experimentally.
The smallest bits of matter in the universe are quantum particles. Quantum particles exist in multiple possible states at once. This is called a particle’s superposition. A wave function is a mathematical term that describes the particle’s superposition. A wave function can collapse, causing a particle’s many possible states to reduce to a single, fixed state. Wave function collapse is important for reality as we know it. It’s because of collapse that when we look at something with our naked eye, we see one thing. In the realm of big things, the world described by classical physics, we don’t see one thing as multiple possible things all at once.
When scientists measure a particle, it seems to collapse to one fixed state. Yet no one can be sure what’s causing collapse, also called reduction of the state. Some scientists and philosophers even think that wave function collapse is an elaborate illusion. This debate is called the measurement problem in quantum mechanics.
The measurement problem has led many physicists and philosophers to believe that a conscious observer is somehow acting on quantum particles. One proposal is that a conscious observer causes collapse. Another theory is that a conscious observer causes the universe to split apart, spiraling out alternate realities. These worlds would be parallel yet inaccessible to us so that we only ever see things in one single state in whatever possible world we’re stuck in. This is the Multiverse or Many Worlds theory. “The point of view that it is consciousness that reduces the state is really an absurdity,” says Penrose, adding that a belief in Many Worlds is a phase that every physicist, including himself, eventually outgrows. “I shouldn't be so blunt because very distinguished people seem to have taken that view.” Penrose demurs. He politely but unequivocally waves off the idea that a conscious observer collapses wave functions by looking at them. Likewise, he dismisses the view that a conscious observer spins off near infinite universes with a glance. “That's making consciousness do the job of collapsing the wave function without having a theory of consciousness,” says Penrose. “I'm turning it around and I'm saying whatever consciousness is, for quite different reasons, I think it does depend on the collapse of the wave function. On that physical process.”
What’s causing collapse? “It's an objective phenomenon,” insists Penrose. He’s convinced this objective phenomenon has to be the fundamental force: gravity. Gravity is a central player in all of classical physics conspicuously missing from quantum mechanics.
“There are a whole lot of people in this physics community who are trying to do quantum gravity,” says Penrose. “The sort of view, I gather, is that quantum mechanics is somehow more basic than gravitational theory and therefore you’ve got to bring gravity into the scheme of quantum mechanics.” With the majority of physicists wanting to bend gravity to accommodate quantum, Penrose pushes back. He sees some value in quantizing gravity, but he doesn’t think it should be the focus. “That’s not where physics should be going, not the experiments that should be done. It’s the other way around. It’s the influence of gravity on quantum mechanics. People don’t recognize fully enough that quantum mechanics is an inconsistent theory. It’s inconsistent with itself,” says Penrose. “It’s not our understanding of quantum mechanics that has the gap, it’s the theory itself that has the gap.”
Penrose takes a hard pass on Many Worlds or ideas about conscious ghosts in the quantum machine as a way to bridge this gap. His bridge is neither an illusion nor a ghost. For Penrose, wave function collapse is a real, physical, objective phenomenon: a gravitational field can’t tolerate being in a quantum superposition, eventually collapsing the particle’s wave function. According to Penrose, gravity-induced wave function collapse involves a process that jumps the particle back in time, retroactively killing off possible quantum realities in under a second. This reality-annihilating backward-jumping makes it as though only one, fixed classical reality ever existed.
Sorry multiverses. But the death of multiverses allows for the birth of consciousness. Penrose’s theory proposes that each gravity-induced collapse causes a little blip of proto-consciousness: micro-events that get organized by biological structures called microtubules inside our brains into full-bodied awareness. A conscious observer doesn’t cause wave function collapse. A conscious observer is caused by wave function collapse.
Penrose’s interest in consciousness was inspired by a revolutionary mathematical discovery nearly a century ago. In 1931, mathematician Kurt Gödel revealed his incompleteness theorems—theorems of mathematical logic that show there are statements in mathematics that must be true even though they can’t be proven. Gödel’s incompleteness theorems, and Goodstein's theorem sometime later, made an indelible imprint on Penrose. He took from these theorems that there’s a unique property of the physical universe giving rise to conscious understanding. This is our human ability to understand truths that cannot be derived from the rules that gave us those truths. In other words, the rules allow us to ascertain truths beyond the rules. The ability to understand Gödel and Goodstein’s theorems means there’s something about our conscious understanding that is not confined to computational boundaries. Since all theories of physics are computational, Penrose believes something must be happening in the reduction of the quantum state that gives rise to non-computational understanding. “All I have are all the theories we know in physics. Computational, computational, computational. I mean, you've got to find room for this thing,” says Penrose. He confirms that this thing that physics has to make room for is understanding.
Quantum weirdness doesn’t stop at a thing existing in multiple possible states all at once. Quantum behaviors also seem to defy the laws of physics. Like the law that nothing can travel faster than the speed of light. When two quantum particles get close enough, their wave functions become entangled. Once entangled, you can separate the particles across the universe and anything you do to one particle instantly affects the other. If you make a measurement on one particle, collapsing its wave function, it immediately determines the state of the other particle, even if the other particle is located across the universe. Einstein called this spooky action at a distance because it seemed to suggest information was traveling from one particle to another, faster than the speed of light. The 2022 Nobel Prize in physics was awarded to the team that proved entangled quantum particles do affect each other instantaneously even though they don't send a signal faster than the speed of light. “The quantum reality is, in some sense, not so fixed in spacetime,” says Penrose.
According to Penrose, entangled particles merely appear to scientists as though they are affecting each other instantaneously. “It’s not even instantaneous. It’s more than instantaneous,” says Penrose, who sees collapse as a sort of boundary. On one side is the classical reality we know, where things are in one single state in space and time. The other side of the boundary is quantum reality where space, time and possibilities have a lot more freedom. Wave function collapse is something like a gateway between quantum and classical realities. “It's how quantum and classical physics relate to each other. It’s huge,” says Penrose.
The price to traverse realities is charged to classical reality’s timeline. Countless experiments show the collapse reduces multiple quantum states. Experiments also show this effect is instantaneous. But the effect may only aseem instantaneous to us because the destruction of multiple quantum realities retroactively alters the classical reality timeline. In other words, classical reality retroactively emerges from the wave function collapse of quantum reality. Penrose calls this effect, aptly enough, retro-activity. It clears a path for making quantum behavior consistent with Einstein's theory of special relativity. Penrose thinks these backward time jumps are the only way a superposition can collapse into a single, fixed state and still remain consistent with results from experiments in both quantum physics and classical physics.
Special relativity says time passes at different rates depending on your frame of reference. This is called time dilation. Experiments show that time dilation is a natural part of how time works. “There isn’t a universal time,” says Penrose. The average person and even other scientists may be skeptical about the idea of retro-activity. It may sound like science fiction for anyone unaccustomed to thinking about general relativity, special relativity and a universe where past, present and future already exist in a four-dimensional block. “I’ve been thinking about it, not since I’ve been in the cradle exactly,” says the 92-year-old, “but certainly a long way back.” In his 1989 pioneering book on consciousness, Emperor’s New Mind, Penrose first proposed the idea of a retroactive effect. In the book, he cautions that we may err when applying the physics of time to our conscious perception of time. He writes that consciousness is the only phenomenon in modern physics that requires time to flow at all.
Penrose’s ideas about retro-activity as an explanation for quantum anomalies are only recently gaining traction. Retrocausality is the proposal that a measurement in the present can change a particle’s properties even before the measurement was made. “You need this distinction between the two realities,” says Penrose. Classical reality and quantum reality are fundamentally different realities. He adds that even the notion of before and after may be incoherent in quantum reality.
Why might gravity-induced wave function collapse produce non-computational consciousness? Consciousness “could be non-computable because it’s retroactive,” says Penrose.
For Penrose, this retro-active process helps explain how athletes make rapid decisions under extreme time constraints. “I used to play a lot of ping pong,” says Penrose. “If I suddenly decide I want to shoot the ball this way rather than that way, I consider I'm making that decision consciously. Now that's far less than half a second.” The process of taking in sensory information, making a decision and then acting, is a relatively lengthy physiological process. Decisions that involve a rapid reaction time are thought to be made unconsciously. According to cognitive psychology and neuroscience, the sense afterward that we made a conscious choice is an illusion. Penrose could never swallow this explanation. “Your conscious internal experience might be a kind of quantum reality,” offers Penrose. He suspects we may, on some level, be conscious of all the possible realities that get retroactively annihilated in under a second.
“The argument is that there would be something in quantum superposition between this action and that action—somewhere at the earlier stage in the brain when these two procedures are in quantum superposition,” says Penrose. “So the quantum state would contain both those alternatives. And then, when you decide to do one, it retroactively goes back.” Jumping back and overwriting multiple quantum choices makes it as if there was only ever one, fixed classical choice. “Conscious experience happens in quantum reality. And classical reality is retroactively determined by that,” says Penrose. He’s quiet for a moment before gently voicing a concern that people might misinterpret what he’s saying about retro-activity, but mainly because he’s still working out the details and potential paradoxes himself. “It’s too easy for people to speculate in ways which are almost certainly wrong,” says Penrose before emphasizing that retro-activity can only happen along the past light cone. The past light cone is a cone-shaped region in spacetime that represents every single past event that could have influenced a particular event. If retro-activity happens, it happens within these parameters.
Penrose doesn’t shy away from lobbing bold ideas into the public square of scientific debate before he’s worked out all the details. In turn, the scientific community doesn’t shy away from piling on when someone in their camp goes rogue. Penrose recalls giving a talk at the California Institute of Technology on his heterodox ideas in cosmology. Physicist Richard Feynman attended so he could heckle Penrose. Over the course of the talk, Feynman grew intrigued by what Penrose was saying. When another physicist heckled Penrose, Feynman turned in his seat and told the heckler to shut it and let the man speak.
Today, Penrose gets accused of making unsupported connections between strange phenomena in quantum mechanics and the mystery of consciousness. “People complain to me ‘he's just saying, here's a mystery, there's a mystery, therefore they're the same thing.’ That's not what I'm saying,” says Penrose. “I can see why they complain that way. It's not that.” Over the next hour he describes alternative theories and gives reasons for why he doesn’t think they’re credible. It’s unclear to what extent he’s driven by the reasoning of his own theory or by the implausibility of any alternatives. He suggests that the only other good alternative might be a theory that no one has thought of yet. As things stand, he feels that both classical physics and quantum mechanics are extraordinary theories. Both have proven to be extraordinarily precise when tested. So Penrose is writing a chapter in modern physics that he hopes will unite them: “I think measuring the collapse of the wave function is the most important experiment anybody should do and not many people are trying.”
His polite skepticism and genial demeanor belies an unflagging determination to see his own ideas either proven out or falsified. There are three core hypotheses to be tested experimentally:
1) gravity causes wave function collapse
2) the collapse involves retro-activity
3) consciousness comes out of this process
In 2022, a group of scientists ran an experiment and published a subsequent press release claiming they disproved Penrose's theory by disproving a prediction made by physicist Lajos Diósi. Diósi and Penrose had a similar timescale for how long it would take gravity to collapse the wave function. Their ideas were folded together and coined the Diósi-Penrose model. “Diósi’s model has some problems, very serious problems, which is that it doesn't conserve energy,” says Ivette Fuentes, a physicist at University of Southampton and Oxford Fellow. Diósi and Penrose agreed that gravity causes wave function collapse. They also agreed about how long it would take. For Diósi, however, gravity-induced wave function collapse involved radioactive heating. The 2022 experiment did not find radioactive heating, thereby disproving Diósi’s theory. For Penrose, there is no radioactive heating because the collapse involves retro-activity. There were other issues with the experiment. “One of the things Roger predicts is that if you have a particle in a superposition, a massive particle in a superposition, it will collapse,” says Fuentes. “But the [Diósi] experiment doesn't have a superposition. The experiment was one big mass not in a superposition.”
Solids like mirrors, levitated nanobeads and diamonds are traditional materials for testing wave function collapse. Fuentes has a unique, non-solid approach. She cools atoms to the absolute lowest temperature possible on earth, turning them into a new state of matter resembling a gas. This kind of matter is called Bose-Einstein Condensates (BECs). Fuentes' work with BECs caught Penrose’s attention and the two began collaboration on an experiment using BECs to test the first stages of gravity-induced wave function collapse called the shaking of the building. When testing a quantum particle in BECs, “the system behaves very differently and it's very sensitive to gravity,” says Fuentes.
Like Penrose, Fuentes embraces the inclusion of consciousness in physical theories, as long as physical theories provide an explanation for what consciousness actually is. From the time she was in high school, Fuentes wanted to understand how consciousness emerged from the interaction of atoms and molecules. In the 1990s, there was not a single scientific discipline where consciousness was considered a serious area of study. Family members in science and medicine advised her to go into psychology or neuroscience, two areas proximal to her interests. Fuentes had a sense that answers to her questions weren’t going to be found in those fields, so she became a physicist. Now she designs out-of-the-box ways of testing problems about our understanding of the universe. Increasingly, this path seems the surest route back to her original question. “We're at the brink of some sort of shift or change in which we will have to incorporate mind and consciousness to make a fuller picture, a better picture,” says Fuentes adding, “I do think we need a change. And I do think that it involves having mind as part of the equation. And maybe, by this shift, we'll be able to understand why we were banging our heads not being able to bring quantum mechanics and general relativity together.”
Penrose and Fuentes teamed up with quantum physics experimentalist Philippe Bouyer at University of Amsterdam to design the BEC experiment. They’ve raised $2 million USD from global philanthropists. The project needs an additional $4 million. Once funded, the experiment will take approximately five years to complete.
If gravity-induced wave function collapse can be proven with BEC experiments, Penrose still needs to prove this process involves retro-activity and consciousness. He has ideas about testing for retro-activity using the Italian Space Agency’s mirrored disco-ball-like LARES satellite. Still, neither satellites nor BECs have anything to say about consciousness. If BECs are systems sensitive enough to test for gravity’s influence on quantum particles, Penrose thinks human beings might be physical systems sensitive enough to test for consciousness registering retro-activity.
“Am I the last survivor of the team?” asks Dennis Keith Pearl, statistician and co-author of a 1979 experiment led by late psychologist Benjamin Libet. Libet is best known for his seminal research that seems to show that our choices to act are too slow to be made consciously. The brain "registers" the decision to make movements before we consciously decide to move. Libet studies are controversial because they seem to do away with free will. Penrose isn’t too concerned with free will, but he does believe our choices are made consciously, not unconsciously, regardless of whether or not they’re free. Decades ago, physicist Erich Harth, a colleague of Penrose, brought Libet’s 1979 experiment to Penrose’s attention. Harth thought it may contain evidence that the brain is registering retro-activity. Retro-activity could give us the fractions of a second we need to salvage conscious choice. Harth included an interpretation of the Libet study in his book Windows On The Mind.
Pearl was a graduate student in 1979 and the youngest on Libet’s research team, which included California senator Dianne Feinstein’s husband, neurosurgeon Bertram Feinstein. “Too bad you weren't asking me 10 years ago,” says Pearl as he struggles to remember details from a half-century-old experiment. “I had a box full of all the original records from my work with Ben,” says Pearl. “I had lots of notes from Ben and original graphs and things like that.” Pearl had never been contacted about his work with Libet, despite the fact that Libet names Pearl in his written defense of his research, at one point writing in the journal of Consciousness and Cognition to “take up any statistical difficulties with Dennis Pearl.” Boxes of materials and raw data were tossed out during a move a decade ago. Now Pearl carefully inspects the graphs that Harth constructed, graphs interpreted from the 1979 study. “I think everything that [Harth’s] got on this graph is correct in terms of what's reported,” says Pearl.
He’s drawn to Penrose’s use of probabilities in consciousness. He recalls a Libet experiment that he thinks might be of interest to Penrose. Libet stimulated a subject with a short burst of stimulus, and asked the subject if they felt it. The subject would report they did not. So Libet would ask the subject to hazard a guess. An ultra-short burst of stimulus that wasn’t likely to be felt resulted in sheer random guesses. As the bursts extended in duration, the subject would continue to report they couldn’t feel anything. However, guesses started to improve with accuracy until guesses were 100% accurate.
“[Libet] sent me some data and I looked at the curve and said, you know, these guys are getting it right,” says Pearl, recalling the conversation with Libet about a smooth probability curve from unconsciousness towards consciousness. “There's a fuzziness of time. That fuzziness is more on a probability scale. It's moving toward complete awareness, but in the meantime, there's some sort of a semi-foggy kind of period,” says Pearl, cautioning that he’s thinking about this as a statistician, not a neuroscientist or a physicist. He combs through papers trying to find the study where these results were published. Ultimately, he can’t. He wonders if it never made it into a publication because the experiment was only done on two patients.
Pearl takes another look at Harth’s graph. This time, something jumps out at him: the timescale from the infamous Libet clock. In the 1979 experiment, the duration of stimulus was timed precisely but not the subject's response. The timescale is an imperative detail. Without it, evidence for retro-activity in the 1979 experiment never existed. Left in its place isn’t a fixed classical state so much as an open question: Harth’s mistaken interpretation of retro-activity in the Libet experiment doesn’t undermine the retro-active hypothesis in physics. In fact, remove the Libet clock and there’s nothing in physics preventing retro-activity from jumping even further back in time. So the question remains—if backward time jumps are happening, would it impact how we observe reality? And would that impact psychology studies in unexpected ways?
“Our results, there's something weird happening, and we're trying to get to the bottom of it,” says cognitive scientist Marc Buehner, co-author of the study Human Vision Reconstructs Time to Satisfy Causal Constraints published in the journal Association for Psychological Science. “The visual system reorders the evidence, as it comes in,” says Buehner. Imagine a game of pool. The white cue ball hits a yellow ball and a yellow ball then hits a purple ball into the corner pocket. There’s a causal chain of white hitting yellow causing it to hit purple into the pocket. Buehner’s study shows that at least sometimes, our visual system lies to us about this causal order. Buehner and his team conducted experiments where an ABC causal sequence is presented to subjects out of order. Instead of ABC, the researchers mixed up the sequence so C moved inexplicably before B. Subjects saw this ACB disordered sequence but reported an ABC order, despite repeat viewings of the out of order sequence.
“It's basically as if the visual system actually reverses it. So it turns ACB into ABC,” says Buehner. “This weird stimulus as a whole, for reasons that are still not really quite known to us, creates an expectation of this causal event. So the expectation is that it should be ABC, and that expectation clashes with reality,” says Buehner. Interpreting sensory information from the environment to create a mental representation of the world involves a process we’re not aware of. It’s automatic and not consciously controlled. “What we demonstrated in this paper is that perception actually changes,” says Buehner. The researchers ruled out a false memory of what the subjects just saw, called post perceptual distortion or reinterpretation. The effect also can’t be explained by lapsed attention, or rapid, jerky eye movements we make when we shift our gaze, called saccades. “So you could say, oh it's just another one of those visual illusions. Because I asked you afterward, it's kind of like a post fiction. So you try to make sense of it. There's this weird thing you try to make sense of,” says Buehner. “Except that's not what's happening. We could show that you actually perceive the motion onset in the B stimulus as later and the motion onset of the C stimuluses earlier. So you actually perceive a reversal live—as it happens.”
An underlying assumption in perceptual science is that the brain uses sensory input to create mental representations of the world that correspond to what’s actually happening out there. This is referred to as veridical representations—mental pictures that align with reality. Studies like Buehner’s would suggest that either assumptions about the brain might be wrong, or assumptions about reality. “I'm not sure that I would necessarily want to make grand claims that potentially results are driven by some kind of like, you know…" Buehner presses the air with his fingers, "tapping into quantum mechanics. But if that's what's behind it, hey, that'd be super cool. But I want to be cautious.” Buehner adds that it would be good to know if physics is doing something weird that’s responsible for unexplained results in psychological experiments.
Is it outrageous to imagine developments in physics could upend findings in cognitive science? “All of my colleagues, and again, these are my friends and they're brilliant, but they believe that space and time are fundamental and that brain activity causes conscious experiences,” says Donald Hoffman, cognitive scientist and author of the book The Case Against Reality: Why Evolution Hid the Truth from Our Eyes. Hoffman rejects Orch OR’s depiction of reality along with every other physical theory. He thinks the long-standing barrier between classical physics and quantum mechanics is because we’re assuming space and time are fundamental. “Spacetime—we thought it was the final reality. It turns out it's just a trivial data structure and there are much deeper and much more fascinating structures entirely outside of spacetime,” says Hoffman.
He echoes Nima Arkani-Hamed, a theoretical physicist at the Institute for Advanced Study at Princeton university who says spacetime is doomed. Hoffman’s research suggests that the underlying assumptions in perceptual science, neurophysiology and psychology are wrong—the brain does not use sensory input to create accurate mental representations of reality. Hoffman ran simulations using evolutionary game theory and observed that evolution selects for fitness over truth. According to Hoffman, we perceive a completely false reality that is far more practical for survival, useful illusions that lead us far afield the truth-seeking path.
The alternative theory Hoffman proposes is that conscious entities are fundamental entities that exist beyond spacetime. These entities are us. And we are also avatars of a single conscious entity that Hoffman calls the “conscious aleph infinity agent.” We interact with each other via an interface whose format is spacetime. For Hoffman, what’s really going on outside of conscious awareness is so complex, involving non-spacetime dimensions numbering in the trillions or quadrillions. Our simple human minds created an ultra-compressed version of reality stripped of details that would break our brains—if we actually thought with our brains, which Hoffman sees no convincing evidence for.
Hoffman is critical of theories of consciousness like Orch OR. “There's not a specific conscious experience that they can explain. Not one,”says Hoffman. Whereas modern physics has mostly omitted consciousness from theories of reality, Hoffman believes consciousness is the starting point for a theory of reality. He claims to start with a mathematically precise theory of consciousness from which physicists can derive reality. “I'm not going to stipulate all of the other stuff that they stipulate,” says Hoffman, who considers each and every conscious experience fundamental. The taste of chocolate ice cream and an infinite variety of experiences are irreducible and fundamental.
“What I think science has taught us that spiritual traditions didn't understand,” says Hoffman, “is that imprecise theories don't get you anywhere or they can get you in trouble. You can start fighting with each other and be dogmatic and kill each other because you disagree on descriptions. Once you start having mathematically precise descriptions you're forced to really look at your experiments carefully,” says Hoffman, whose theory is based on Markov chains. A Markov chain is a mathematical construct, a system that undergoes transitions from one state to another according to certain probabilistic rules where nothing about the past affects the probability of the future. “The math is absolutely essential to the correct interpretation or more useful interpretations of the experiments,” says Hoffman.
Hoffman’s math leads him to conclude that we are avatars of a superconscious or arch-conscious agent. The arch-conscious agent puts us avatars through the paces of an infinite number of experiences, no matter how joyous or horrific, so that the arch-conscious agent can experience everything. Hoffman also warns against overidentifying with our self, because the self is an avatar. What’s more: “You are not any particular experience. You are the potential in which those experiences arise and disappear. That's what you really are in your essence. You transcend any particular experience because you are that potential,” says Hoffman.
Hoffman’s theory of consciousness resonates with many spiritual narratives, suggesting a unifying force exploring all of its potential. Because of this, it confronts significant ethical questions, grappling with notions like whether we, at the most fundamental level, are a powerful conscious force willingly subjecting ourselves and others to the most painful, terrifying and tragic experiences just to satiate a gluttonous drive for experience. Its intriguing alignment with spiritual philosophies means Hoffman’s theory faces the same daunting challenge of explaining the existence of evil and suffering. Hoffman’s theory is quite popular. His interview with Lex Fridman has over 6.4 million views on YouTube. “Spacetime is over. It's not fundamental in any sense. It's not like we have to go do smaller things inside spacetime. We have to go entirely outside of spacetime,” says Hoffman.
“Okay, I’m the conservative person,” laughs Penrose upon learning of Hoffman’s view. Penrose is a physicalist. Whatever consciousness is, he’s convinced it can be explained by the laws of physics, and he’s fairly confident our current theories give us at least some idea of what those laws are. “It’s hugely tempting to go off in a wild direction,” says Penrose, highlighting the risky business of trying to account for consciousness scientifically. He raises a concern that throwing around mathematical terminology can make a theory seem more credible than it is. Experiments are the anchor for any scientific theory. Hypotheses must be tested and the model subjected to experimental falsifiability to qualify as a scientific theory. It must have the potential to be disproven in order to distinguish itself from pseudoscience. According to Penrose, there’s a risk of getting caught up in the beauty of a precise mathematical theory. “I think it's dangerous,” says Penrose, “It could be that there's a deeper beauty which tells you why the thing you thought was true is not true.” Given the track record of experimental success for both classical physics and quantum mechanics, and the lack of evidence needed to replace all of physics with a conscious agent, Penrose doesn’t see the rush to flip the table on spacetime. “It's just that the laws of physics may be more puzzling than we think they are,” says Penrose.
When it comes to the suddenly salient question of whether or not AI could be conscious, Penrose draws again from Gödel and Goodstein’s theorems. Computer science is built on formalized systems. They’re confined by computation. For Penrose, AI built on classical computers today isn’t capable of true understanding or consciousness. After some consideration, he adds a caveat when it comes to quantum computers: “You put wave function collapse into its process somehow…”
For an in-depth discussion about this theory, including Penrose’s Hemingway Paradox, watch the interviews with Penrose that were the basis for this reporting:
**This article has been updated. A previous version reported that Benjamin Libet was the first recipient of a Nobel Prize in Psychology. However, the Klagenfurt Virtual Nobel Prize has no relation to the Nobel Prize from the Swedish Nobel Foundation
A professor of cognitive science argues that the world is nothing like the one we experience through our senses
As we go about our daily lives, we tend to assume that our perceptions—sights, sounds, textures, tastes—are an accurate portrayal of the real world. Sure, when we stop and think about it—or when we find ourselves fooled by a perceptual illusion—we realize with a jolt that what we perceive is never the world directly, but rather our brain’s best guess at what that world is like, a kind of internal simulation of an external reality. Still, we bank on the fact that our simulation is a reasonably decent one. If it wasn’t, wouldn’t evolution have weeded us out by now? The true reality might be forever beyond our reach, but surely our senses give us at least an inkling of what it’s really like.
Not so, says Donald D. Hoffman, a professor of cognitive science at the University of California, Irvine. Hoffman has spent the past three decades studying perception, artificial intelligence, evolutionary game theory and the brain, and his conclusion is a dramatic one: The world presented to us by our perceptions is nothing like reality. What’s more, he says, we have evolution itself to thank for this magnificent illusion, as it maximizes evolutionary fitness by driving truth to extinction.
Getting at questions about the nature of reality, and disentangling the observer from the observed, is an endeavor that straddles the boundaries of neuroscience and fundamental physics. On one side you’ll find researchers scratching their chins raw trying to understand how a three-pound lump of gray matter obeying nothing more than the ordinary laws of physics can give rise to first-person conscious experience. This is the aptly named “hard problem.”
On the other side are quantum physicists, marveling at the strange fact that quantum systems don’t seem to be definite objects localized in space until we come along to observe them. Experiment after experiment has shown—defying common sense—that if we assume that the particles that make up ordinary objects have an objective, observer-independent existence, we get the wrong answers. The central lesson of quantum physics is clear: There are no public objects sitting out there in some preexisting space. As the physicist John Wheeler put it, “Useful as it is under ordinary circumstances to say that the world exists ‘out there’ independent of us, that view can no longer be upheld.”
So while neuroscientists struggle to understand how there can be such a thing as a first-person reality, quantum physicists have to grapple with the mystery of how there can be anything but a first-person reality. In short, all roads lead back to the observer. And that’s where you can find Hoffman—straddling the boundaries, attempting a mathematical model of the observer, trying to get at the reality behind the illusion. Quanta Magazine caught up with him to find out more.
Gefter: People often use Darwinian evolution as an argument that our perceptions accurately reflect reality. They say, “Obviously we must be latching onto reality in some way because otherwise we would have been wiped out a long time ago. If I think I’m seeing a palm tree but it’s really a tiger, I’m in trouble.”
Hoffman: Right. The classic argument is that those of our ancestors who saw more accurately had a competitive advantage over those who saw less accurately and thus were more likely to pass on their genes that coded for those more accurate perceptions, so after thousands of generations we can be quite confident that we’re the offspring of those who saw accurately, and so we see accurately. That sounds very plausible. But I think it is utterly false. It misunderstands the fundamental fact about evolution, which is that it’s about fitness functions—mathematical functions that describe how well a given strategy achieves the goals of survival and reproduction. The mathematical physicist Chetan Prakash proved a theorem that I devised that says: According to evolution by natural selection, an organism that sees reality as it is will never be more fit than an organism of equal complexity that sees none of reality but is just tuned to fitness. Never.
Gefter: You’ve done computer simulations to show this. Can you give an example?
Hoffman: Suppose in reality there’s a resource, like water, and you can quantify how much of it there is in an objective order—very little water, medium amount of water, a lot of water. Now suppose your fitness function is linear, so a little water gives you a little fitness, medium water gives you medium fitness, and lots of water gives you lots of fitness—in that case, the organism that sees the truth about the water in the world can win, but only because the fitness function happens to align with the true structure in reality. Generically, in the real world, that will never be the case. Something much more natural is a bell curve—say, too little water you die of thirst, but too much water you drown, and only somewhere in between is good for survival. Now the fitness function doesn’t match the structure in the real world. And that’s enough to send truth to extinction. For example, an organism tuned to fitness might see small and large quantities of some resource as, say, red, to indicate low fitness, whereas they might see intermediate quantities as green, to indicate high fitness. Its perceptions will be tuned to fitness, but not to truth. It won’t see any distinction between small and large—it only sees red—even though such a distinction exists in reality.
Gefter: But how can seeing a false reality be beneficial to an organism’s survival?
Hoffman: There’s a metaphor that’s only been available to us in the past 30 or 40 years, and that’s the desktop interface. Suppose there’s a blue rectangular icon on the lower right corner of your computer’s desktop — does that mean that the file itself is blue and rectangular and lives in the lower right corner of your computer? Of course not. But those are the only things that can be asserted about anything on the desktop — it has color, position, and shape. Those are the only categories available to you, and yet none of them are true about the file itself or anything in the computer. They couldn’t possibly be true. That’s an interesting thing. You could not form a true description of the innards of the computer if your entire view of reality was confined to the desktop. And yet the desktop is useful. That blue rectangular icon guides my behavior, and it hides a complex reality that I don’t need to know. That’s the key idea. Evolution has shaped us with perceptions that allow us to survive. They guide adaptive behaviors. But part of that involves hiding from us the stuff we don’t need to know. And that’s pretty much all of reality, whatever reality might be. If you had to spend all that time figuring it out, the tiger would eat you.
Gefter: So everything we see is one big illusion?
Hoffman: We’ve been shaped to have perceptions that keep us alive, so we have to take them seriously. If I see something that I think of as a snake, I don’t pick it up. If I see a train, I don’t step in front of it. I’ve evolved these symbols to keep me alive, so I have to take them seriously. But it’s a logical flaw to think that if we have to take it seriously, we also have to take it literally.
Gefter: If snakes aren’t snakes and trains aren’t trains, what are they?
Hoffman: Snakes and trains, like the particles of physics, have no objective, observer-independent features. The snake I see is a description created by my sensory system to inform me of the fitness consequences of my actions. Evolution shapes acceptable solutions, not optimal ones. A snake is an acceptable solution to the problem of telling me how to act in a situation. My snakes and trains are my mental representations; your snakes and trains are your mental representations.
Gefter: How did you first become interested in these ideas?
Hoffman: As a teenager, I was very interested in the question “Are we machines?” My reading of the science suggested that we are. But my dad was a minister, and at church they were saying we’re not. So I decided I needed to figure it out for myself. It’s sort of an important personal question—if I’m a machine, I would like to find that out! And if I’m not, I’d like to know, what is that special magic beyond the machine? So eventually in the 1980s I went to the artificial-intelligence lab at MIT and worked on machine perception. The field of vision research was enjoying a newfound success in developing mathematical models for specific visual abilities. I noticed that they seemed to share a common mathematical structure, so I thought it might be possible to write down a formal structure for observation that encompassed all of them, perhaps all possible modes of observation. I was inspired in part by Alan Turing. When he invented the Turing machine, he was trying to come up with a notion of computation, and instead of putting bells and whistles on it, he said, Let’s get the simplest, most pared down mathematical description that could possibly work. And that simple formalism is the foundation for the science of computation. So I wondered, could I provide a similarly simple formal foundation for the science of observation?
Gefter: A mathematical model of consciousness.
Hoffman: That’s right. My intuition was, there are conscious experiences. I have pains, tastes, smells, all my sensory experiences, moods, emotions and so forth. So I’m just going to say: One part of this consciousness structure is a set of all possible experiences. When I’m having an experience, based on that experience I may want to change what I’m doing. So I need to have a collection of possible actions I can take and a decision strategy that, given my experiences, allows me to change how I’m acting. That’s the basic idea of the whole thing. I have a space X of experiences, a space G of actions, and an algorithm D that lets me choose a new action given my experiences. Then I posited a W for a world, which is also a probability space. Somehow the world affects my perceptions, so there’s a perception map P from the world to my experiences, and when I act, I change the world, so there’s a map A from the space of actions to the world. That’s the entire structure. Six elements. The claim is: This is the structure of consciousness. I put that out there so people have something to shoot at.
Gefter: But if there’s a W, are you saying there is an external world?
Hoffman: Here’s the striking thing about that. I can pull the W out of the model and stick a conscious agent in its place and get a circuit of conscious agents. In fact, you can have whole networks of arbitrary complexity. And that’s the world
Gefter: The world is just other conscious agents?
Hoffman: I call it conscious realism: Objective reality is just conscious agents, just points of view. Interestingly, I can take two conscious agents and have them interact, and the mathematical structure of that interaction also satisfies the definition of a conscious agent. This mathematics is telling me something. I can take two minds, and they can generate a new, unified single mind. Here’s a concrete example. We have two hemispheres in our brain. But when you do a split-brain operation, a complete transection of the corpus callosum, you get clear evidence of two separate consciousnesses. Before that slicing happened, it seemed there was a single unified consciousness. So it’s not implausible that there is a single conscious agent. And yet it’s also the case that there are two conscious agents there, and you can see that when they’re split. I didn’t expect that, the mathematics forced me to recognize this. It suggests that I can take separate observers, put them together and create new observers, and keep doing this ad infinitum. It’s conscious agents all the way down.
Gefter: If it’s conscious agents all the way down, all first-person points of view, what happens to science? Science has always been a third-person description of the world.
Hoffman: The idea that what we’re doing is measuring publicly accessible objects, the idea that objectivity results from the fact that you and I can measure the same object in the exact same situation and get the same results — it’s very clear from quantum mechanics that that idea has to go. Physics tells us that there are no public physical objects. So what’s going on? Here’s how I think about it. I can talk to you about my headache and believe that I am communicating effectively with you, because you’ve had your own headaches. The same thing is true as apples and the moon and the sun and the universe. Just like you have your own headache, you have your own moon. But I assume it’s relevantly similar to mine. That’s an assumption that could be false, but that’s the source of my communication, and that’s the best we can do in terms of public physical objects and objective science.
Gefter: It doesn’t seem like many people in neuroscience or philosophy of mind are thinking about fundamental physics. Do you think that’s been a stumbling block for those trying to understand consciousness?
Hoffman: I think it has been. Not only are they ignoring the progress in fundamental physics, they are often explicit about it. They’ll say openly that quantum physics is not relevant to the aspects of brain function that are causally involved in consciousness. They are certain that it’s got to be classical properties of neural activity, which exist independent of any observers—spiking rates, connection strengths at synapses, perhaps dynamical properties as well. These are all very classical notions under Newtonian physics, where time is absolute and objects exist absolutely. And then [neuroscientists] are mystified as to why they don’t make progress. They don’t avail themselves of the incredible insights and breakthroughs that physics has made. Those insights are out there for us to use, and yet my field says, “We’ll stick with Newton, thank you. We’ll stay 300 years behind in our physics.”
Gefter: I suspect they’re reacting to things like Roger Penrose and Stuart Hameroff’s model, where you still have a physical brain, it’s still sitting in space, but supposedly it’s performing some quantum feat. In contrast, you’re saying, “Look, quantum mechanics is telling us that we have to question the very notions of ‘physical things’ sitting in ‘space.’”
Hoffman: I think that’s absolutely true. The neuroscientists are saying, “We don’t need to invoke those kind of quantum processes, we don’t need quantum wave functions collapsing inside neurons, we can just use classical physics to describe processes in the brain.” I’m emphasizing the larger lesson of quantum mechanics: Neurons, brains, space … these are just symbols we use, they’re not real. It’s not that there’s a classical brain that does some quantum magic. It’s that there’s no brain! Quantum mechanics says that classical objects—including brains—don’t exist. So this is a far more radical claim about the nature of reality and does not involve the brain pulling off some tricky quantum computation. So even Penrose hasn’t taken it far enough. But most of us, you know, we’re born realists. We’re born physicalists. This is a really, really hard one to let go of.
Gefter: To return to the question you started with as a teenager, are we machines?
Hoffman: The formal theory of conscious agents I’ve been developing is computationally universal—in that sense, it’s a machine theory. And it’s because the theory is computationally universal that I can get all of cognitive science and neural networks back out of it. Nevertheless, for now I don’t think we are machines—in part because I distinguish between the mathematical representation and the thing being represented. As a conscious realist, I am postulating conscious experiences as ontological primitives, the most basic ingredients of the world. I’m claiming that experiences are the real coin of the realm. The experiences of everyday life—my real feeling of a headache, my real taste of chocolate—that really is the ultimate nature of reality.
A fully immersive first-person virtual-reality game
You probably remember my mystical experience as a seventeen-year-old, which lasted for a couple of days. But remembering it was more than I was able to do, at least for a long time. I somehow suppressed a memory of what you might think would be a life-changing episode. Weird, huh? But here’s the thing. I’ve found it’s remarkably easy to forget anomalous events. From experience, I know that unless I immediately write down a striking psi experience—say, a confirmed premonition or an amazing synchronicity—I will be unable to recall it even thirty minutes later. It vanishes like the memory of a dream. I’ve also noticed that it’s all too easy to forget case histories of, say, experiments with mediums that really ought to be memorable. I’ll spend a good deal of time summarizing a case for a blog post, and a few weeks later, it’s largely slipped my mind. Am I plagued by a bad memory? I don’t think so, because it’s not just me. In fact, this problem is astonishingly common.
Sittings with Eusapia Palladino, by Everard Feilding, documents a series of séances with a controversial Italian medium. The book includes journal entries by the researchers, a highly experienced team who, among them, had successfully debunked more than one hundred mediums of Palladino’s type—so-called physical mediums, who, in darkness or dim light, apparently caused objects to move, breezes to blow, and musical instruments to play. Palladino was known to cheat—she even bragged about it—so the researchers no doubt thought it would be easy to add her to their list of fakes. They found, however, that if they took the trouble to secure Palladino in such a way that cheating was impossible, a variety of dramatic phenomena still took place. For the first time they found themselves confronted by séances they could not explain.
Even when Palladino’s hands, feet, and knees were securely held, the table at which they sat would levitate, sometimes remaining aloft for a full minute. In an attempt to force down the table, one or two men would climb onto it, but it would remain suspended in air, bobbing like a raft, even as another man crawled underneath with a lamp to guard against fraud. More than once, Palladino, still in her chair, was levitated onto the table and, once, even above the tabletop, as the researchers passed their hands between the surface of the table and the legs of the hovering chair. Items of furniture moved freely around the room at a long distance from the medium, and one small table sometimes climbed atop a larger one. Inside a curtained-off area called a cabinet, musical instruments—a banjo, music box, bell, tambourine, and guitar, among others—would play by themselves, occasionally emerging from the cabinet to play in different parts of the room. Invisible hands would clutch the researchers even when Palladino’s own hands were restrained.
In their journals, the researchers reported their frustration and confusion, but also a more interesting fact—that after a day or two, the most dramatic and persuasive effects produced by Palladino had somehow vanished from their memory. When reviewing contemporaneous notes taken during each session, they were often surprised to discover how many astonishing feats Palladino performed just a couple of days earlier.
With regard to one of the first sittings, Feilding notes:
My mind was not prepared to accept the phenomena which occurred, and yet I was unable to suggest any loophole for fraud in the production of any of them ... We were still fresh at the game, still alertly suspicious of every movement of Eusapia; somewhat annoyed, to speak frankly, at our failure to detect any fraud at the first séance, and determined to get even with her. We tied her feet, and then presently forgot that we had tied them, and ... did not even remember it the next day.
Of the third sitting, Feilding writes:
On reading through, last night, the translation of the shorthand notes of the third séance, we [i.e., Feilding and colleague Herewood Carrington] were both surprised to find what an entirely different impression we had retained of what had taken place from that which we derived from the notes. All the more remarkable manifestations had receded in our memory ... and if, before reading the notes, we had been asked to give an account of the séance, we should certainly have said that it had been almost barren of results ...
During the third séance, [the table] remained motionless for long periods together, and the impression upon our minds was that the use of [a device to secure the table] had floored the medium. The notes, however, show that several complete levitations did, in point of fact, take place ... We had completely forgotten a great portion of [various other phenomena] until we read the notes.
In a supplementary comment written later, Feilding says that his original, early notes
exist as a record of our critical, indeed hostile state of mind. The first two séances had in fact left no enduring mark upon us. They had astonished us, puzzled us, vexed us ... The ordinary effect of the sudden confrontation of a fairly balanced mind with a merely bizarre fact is a reaction: the mind rejects it, refuses to consider it. And the more bizarre the fact, the stronger the reaction ... Tables, we knew, or thought we knew, do not go into the air by themselves; curtains do not bulge out without some mechanical agency; and although we saw them do so, we still refused to believe that they did.
In his memoir Travels, Michael Crichton includes an account of a so-called PK (psychokinesis) party in which guests tried bending spoons and other pieces of metal by the power of the mind. Naturally, Crichton was skeptical, as was his friend, Anne-Marie.
Rubbing her spoon, Anne-Marie said, “I don’t think this is going to work. This is silly. I just don’t see how it can work.”
I looked down at her hands. Her spoon was bending.
“Look, Anne-Marie ...”
Anne-Marie laughed. Her spoon was like rubber. She easily twisted the spoon into knots.
Crichton thought his own spoon would never bend, until another friend said, “Congratulations.”
I looked down. My spoon had begun to bend. I hadn’t even realized. The metal was completely pliable, like soft plastic.
After bending the bowl of the spoon in half with minimal pressure, Crichton chose a fork, which “twisted like a pretzel.” He did this with a few more items. After which, something even more remarkable happened.
I got bored. I didn’t do any more spoon bending. I went and got coffee and a cookie. I was now far more interested in what kind of cookies they had for me than anything else.
His interest did not return. “The room was full of people doing the same thing, and it seemed very ordinary. Kind of boring.” He adds that “this sense of boredom often seems to accompany ‘psychic’ phenomena. At first the event appears exciting and mysterious, but very quickly it becomes so mundane that it can no longer hold your interest.”
Then there is the curious case of Miss Z. This young lady was the subject of experiments conducted by parapsychologist Charles Tart in the early 1960s. The test subject, known in the literature as Miss Z to protect her privacy, said she often had out-of-body experiences (or OBEs) while asleep. To test this claim, she agreed to sleep in Tart’s laboratory, hooked up to EEG monitors. The EEG results were highly unusual; in The End of Materialism, Tart writes that “one of the world’s leading authorities on sleep research, psychiatrist William Dement, ... agreed with me that it was a distinctive pattern, but we had no idea what it meant.” More interesting, though, was that Miss Z correctly identified a target number hidden in the room, which she had seen while out of the body. Although there is a very small chance that she could have seen the number’s (exceedingly dim) reflection in a wall clock, she could not have seen the target directly from her bed, nor could she have gotten out of bed without unhooking the monitors; moreover, the period of her reported OBE corresponds to the unusual EEG activity. Odds against simply guessing the number are 100,000 to 1.
This seems like a potentially breakthrough case, and we would expect Tart to have continued the experiments and replicated the results, while eliminating any possible source of information leakage, such as the faint reflection. But that’s not what happened. Instead, Miss Z relocated to another city, and Tart let the experiments lapse, even though, as he notes, “People who can have an OBE on demand are, to put it mildly, rare.”
Looking back, he says he finds his decision not to follow through somewhat peculiar. He notes the “long history of parapsychological experiments where powerful results were obtained in the beginning, investigators got excited, and then the results petered out for no apparent reason or the experimenter got involved in other things ... Sometimes it makes you wonder: Are we being led? Baited? Intellectually teased?”
People forget striking events they ought to remember; they lose interest just as things are getting interesting; they don’t follow up on groundbreaking experiments that could shift everyone’s perception. Why? What’s going on here? As long as we’re asking questions, let’s ask a few more:
* Why do we react in a panic to the very idea of experimenting with mind-altering chemicals, even throwing people in jail for doing so?
* Why do we pass laws penalizing psychics and mediums, or uphold religious injunctions against dabbling in the occult?
* Why do some intellectuals spend their lives, or at least much of their free time, combatting any suggestion that the paranormal has some validity?
* Why do so many people say they’re never really convinced, no matter how much evidence they see?
* Why do researchers who choose to study the paranormal find themselves ostracized, their careers sidetracked, their reputations maligned?
* Why do we reflexively dismiss and ridicule those who claim to be in touch with higher levels of consciousness?
Some people, seeing the marginalization of the paranormal, say the government or a secret cabal is behind it all. I don’t think so. Governments and cabals are notoriously inept.
George Hansen, author of The Trickster and the Paranormal, offers a more sophisticated take. He argues at length for the liminality (marginal nature) of psi. He points to the marginal status of shamans, medicine women, necromancers, and ghost hunters in most societies—including ours, which relegates the paranormal to horror stories, humor, and “woo.” This socially mandated liminality keeps us from accepting the paranormal or even taking it seriously.
This is probably true. But what is the nature of Hansen’s “liminality” and why does it seem to function as a built-in feature of the universe? One answer is that it actually is a built-in feature of the universe, a feature that helps to ensure our continued full immersion in our perceived reality by marginalizing anyone who starts to see “behind the veil,” and by sequestering and scrubbing our own memories before they can be preserved long-term. It’s equivalent to the steps taken in The Matrix to keep everybody believing in the shared illusion.
If you look at it this way, doubts and even denial in the face of intellectually convincing evidence may support the idea that our reality, the cosmos itself, is a kind of virtual-reality simulation—not literally, in the sense of being a rendered environment produced by algorithms on a laptop, but conceptually, in the sense that it is only an appearance and not the true underlying reality. It is Plato’s cave, in which the shadows of things on the wall are mistaken for the things themselves.
Moreover, this simulation is designed to be fully immersive, an experiential environment that envelops us completely and absorbs our full attention. To the extent that we become aware of nonphysical existence, we are less than fully immersed in this environment, and that’s not how the game is played.
In short, the world works this way because that’s how it’s set up to work. We are biologically hard-wired and socially conditioned to pay no attention to the man behind the curtain. If we notice him anyway, we are inclined to forget. If, despite everything, we remember, then we risk our own social, professional, and intellectual banishment (a prospect that gives us an additional incentive to forget).
I forget my little moments of psychic intuition—or my teenaged self’s glimpse of a higher reality—because they threaten my full immersion in the role-playing game of my physical life. The researchers studying Eusapia Palladino forgot the most compelling moments of the séances for the same reason. Michael Crichton suddenly found spoon-bending boring, with the result that he didn’t pursue it. What Charles Tart calls being baited, led, and teased might be understood as a veil of ignorance imposed by the conditions of our incarnation itself.
Well, maybe. But if this were the only reason for picturing our cosmos as a fully immersive virtual-reality environment, it would not be very persuasive. Some form of purely psychological or sociological analysis would serve equally well. Is there any reason to think this model is more than an intriguing daydream?
I think there is, and it’s found in both parapsychology and mainstream science.
Anyone who’s studied the evidence for survival that has accumulated in the 138 years since the founding of the Society for Psychical Research knows that a basic picture has emerged. This picture is incomplete and contains some contradictions, which we’ll get to later. But in essence it goes like this:
Each of us is, as the popular saying goes, “a spiritual being having a physical experience.” The body and brain are used by consciousness to navigate the physical world. At death, the spiritual consciousness is liberated from this vessel and undergoes an out-of-body experience. The OBE typically begins in familiar surroundings but can move quickly into a transitional zone, sometimes visualized as a tunnel or as a void. Passage through this zone brings the spirit into another plane of existence, where all memories of the now-concluded lifetime are relived in rapid succession, with startling clarity. Insights gleaned from this “life review” help the spirit to understand where he or she chose the wrong path or failed to live up to his or her potential.
After a period of recuperation, the refreshed spirit, inhabiting a spiritual body similar to that of the earthly incarnation, is introduced to an earthlike environment where the next phase of postmortem existence will play out. This environment is an idealized re-creation of earthly habitats, and is understood to be the product of the collective unconscious of all the spirits making use of it. A multiplicity of such environments exists, ranging from paradise conditions to nightmarish hells, each corresponding to the overall level of spiritual development of its inhabitants. Because spirits of similar developmental levels cluster together, and because their environment is made up out of their expectations and memories, people will tend to experience what they want and expect to experience.
In his book 90 Minutes in Heaven, Don Piper, a born-again Christian, describes a near-death experience in which he found himself in a quintessentially Christian heaven, complete with “pearlescent gates,” streets of gold, and choirs of angels. He came back convinced that he had been to heaven, though he remained skeptical of other NDEs that encompassed different, non-biblical experiences. He was sure that only his version of the afterlife could be real. But there’s no reason to think it was any more or less real than any other experience, including the experiences of Hindus who often report being escorted to the afterlife by angelic messengers known as yamdoots, as recounted by Erlendur Haraldsson and Karlis Osis in At the Hour of Death.
Nineteenth-century spiritualist literature abounds in descriptions of the Summerland, a serene and beautiful environment enjoyed by most people after death. Gardens, cottages, and other homely delights are recounted in detail. People are said to create art, tend flowers, hold jobs, conduct research, and even—occasionally—partake of whiskey, cigars, and sex! Naturally, skeptics have had a field day with these accounts, but if the experience is a product of memory and expectation, then any earthly experience can be re-created with apparent reality. Yes, even whiskeys, cigars, and sex.
All such environments are temporary, serving as way stations that offer opportunities for learning and growth; eventually all spirits will move on, whether from paradise, hell, or one of the myriad spiritual planes in between. In the channeled book The Road to Immortality, the spirit of early psychical researcher F.W.H. Myers warns that Summerland is a plane of illusion, which he compares to the land of the Lotus Eaters in Greek mythology. The Lotus Eaters kept themselves perpetually intoxicated, existing in a hallucinatory state. Myers, as transcribed by Geraldine Cummins via automatic writing, insists that however attractive Summerland may be to its inhabitants, it is not ultimately real, and when an individual spirit recognizes this fact, he will be elevated to a higher plane.
The above story has been put together out of many different lines of inquiry. NDEs and OBEs, mediumship and automatic writing, deathbed visions and and the mystical experiences known as “cosmic consciousness”—all have contributed to the story, and for the most part tend to reinforce and supplement each other. There is as much coherence and unanimity among our various sources, dating back to the nineteenth century or even earlier, as we might expect from a couple of centuries of reports on a distant, inaccessible place—Timbuktu, perhaps.
Now let’s step back and look at all this from the standpoint of our virtual-reality model.
Imagine yourself playing a computer game. When you complete one level, you’re automatically transitioned to the next level. This new, higher level is similar to the previous one, but the rules are somewhat different, and you’ve acquired some powerful new capabilities. Your avatar (your on-screen persona) may look different. You must learn new skills or hone the skills you already learned.
For our purposes, this is not just any computer game, but a virtual-reality (VR) game—the sort of game where you wear a special headset that immerses you in a computer-generated world. Everything about you seems real; and it is real, but only in the sense that it is a real image, a real artificial construction. The underlying reality, which you don’t see, is very different. It’s a reality of ones and zeros, digital data, which are processed behind the scenes. The trees, mountains, and living bodies in your virtual environment have, as their underlying reality, a vast invisible sea of algorithms and binary code.
What happens if you take off your VR headset, or allow it to slip partly off? You are no longer immersed in the virtual world, no longer seduced by its imagery or caught up in its drama. You may say, as film critic Roger Ebert did shortly before he died, “This is all an elaborate hoax.”
What’s necessary to lift the headset is an altered state of consciousness. This can be achieved in many different ways.
Salvia divinorum is a psychoactive plant that is usually smoked or chewed. Known more commonly as salvia or just Sally, the plant is legal in some jurisdictions and has a long history of use in traditional societies. Here are excerpts from the experiences of various salvia users.
I took a big hit of Salvia ... I slipped out of the 2d [= two-dimensional] plane and was hovering over my body for a brief moment
.
Next thing I know my vision is getting saturated, literally like Photoshop effects, and then when I move my head even slightly it’s like everything is warping and stretching, like a graphical bug, with pixels not loading, stuff like that.
Everything gets depth and becomes pixels, the ground gets depth and becomes pixels and starts moving and carrying [me] around on the pixels, while moving [I try] to look in between the pixels into nothing, and [try] to feel in between them.
I couldn’t see anything at all. It was a kaleidoscope so intricate that the pieces were not visible to the naked eye. It was as if a computer took all of its pixels and scrambled them into some random configuration.
My vision seemed to be consistent [sic] of pixels like a computer, and all I had to do was turn away ... Turn away and look at the real reality, but I just couldn’t
Everything I was seeing was made of individual, single color pixels, like a TV screen, but the colors weren’t limited at all! And they didn’t have a definite shape, either. They were all roughly oval. Sort of pill-shaped, but I got more of the impression that they were like plant cells, with thin layers of membrane around each one that kept it binded [sic] to the others on the proper sequence.
The last friend I smoked it with had no idea what he was in for ... Straight away he seemed distressed ... Apparently he thought himself an icon in a video game, and he was trapped between planes of reality.
It’s like nothing exists and all is just ... like fake or something.
This is when I realize that all of reality and everything that I knew to be true was false.
Salvia unzipped myself in half and everyone around me morphed into laughing jokers, causing me to believe that the world had played a giant trick on me and that everything I knew was totally fake.
Suddenly everyone I’d ever known, all the places I’d been, my whole life, had been a lie. It had been just a game, a silly puppet show, and it meant nothing in comparison to the depths of existence beyond my life, way into the infinity of the universe ... All along my life has been this insane charade which God has now chosen to break down.
The only way I can explain it is that it’s almost like there are entities that are part of our subconscious mind and the collective unconscious. They are “behind the scenes” in making our objective reality. They are always shifting things to make them seem real and authentic, almost like this reality is just a sinister joke, or some sort of game we all play.
I was transported into another dimension where I FINALLY understood life and all of its concepts and a multicolored being came to me and presented himself and explained to me that all we are as humans are tiny pixels working our hardest to play out life for beings above us ... We are all tiny pieces to an indescribably large puzzle.
Salvia is the only thing I’ve done that has so completely shattered my reality and forced me to reassess my entire life and the way I live it.
My old vision of death as simple oblivion has been wiped away, and it’s very difficult for me to imagine death as anything other than a new transformation into the conscious energy we were before birth and will return to again.
Many of these people suffered intense psychological aftereffects as they struggled with the sense of having glimpsed a deeper reality that makes our normal, everyday experience seem like a game, a puzzle, “a silly puppet show.” One person said, “It will leave you doubting your existence for years afterwards.”
Perhaps salvia has this effect on people because our mundane experience really is a game of sorts—shadows on the wall of Plato’s cave, or icons on a screen. Perhaps the ancient Vedic texts are correct when they describe this world as Maya, a world of appearances that masquerades as the one and only reality, or when they speak of our lives as Lila, meaning play-acting. Beyond Maya there is Brahman, ultimate reality. But because the pull of Maya is so strong—because the game is immersive (and addictive)—you will probably find it hard to let go.
Sometime between the eighth and fourteenth centuries, Buddhist monks on the high plateau of Tibet worried about much the same thing. They authored a document known in the West as the Tibetan Book of the Dead. It delineates various stages of postmortem existence, known as bardos. As is often the case with religious writings, the book is highly formalized, with successive stages neatly ordered in groups of seven and said to last for a specific number of days. Leaving aside these elaborations, the gist of the narrative is a set of instructions on how to best handle the dying process. You are told to expect a series of visions, both positive and negative, which are generated by your own mind but perceived as objectively real. You will find yourself fully immersed in these thought-forms, which reflect your deepest expectations, fears, and hopes, all the while cut off from your higher self. Only by realizing that the scenes before you are nothing more than a mental projection can you break free of the wheel of rebirth and avoid reincarnation. Most of us, not being spiritual adepts, can’t manage it; we remain entangled in illusion and are eventually shuttled back to earth for a new lifetime.
Seeing past the illusions of the bardo is analogous to lifting the VR headset and emerging from the simulated reality that entraps you. Remaining caught up in illusion is akin to leaving the headset in place—which is so much easier.
Even in a typical postmortem experience, there are moments when the headset is lifted at least a little. Near-death experiencers commonly report an encounter with an intense light that contains or embodies all knowledge. They often equate the light with God. The Tibetan Book of the Dead, calling it “the clear light of being,” identifies it as your own higher self. This is also a view put forward by prominent NDE researcher Kenneth Ring in his book Life at Death. However we understand the light, those who temporarily merged with it and then returned to life report that they were flooded with a complete knowledge of the universe.
Mystics report similar epiphanies. In 1901, Richard Maurice Bucke wrote an influential book titled Cosmic Consciousness: A Study in the Evolution of the Human Mind. The book is a compilation of accounts featuring persons both notable and unknown who underwent mystical experiences that uplifted their thought and character—essentially what psychologist Abraham Maslow called “peak experiences” and what Hindu tradition calls “kundalini experiences.” My own reaction to the guided meditation about Jesus may possibly qualify as a case of this sort, at least to a certain extent.
Many of Bucke’s best accounts were provided by his contemporaries—ordinary people whose lives were changed by a transcendent sense of oneness with the cosmos lasting anywhere from a few minutes to a few days. One such case involves a woman identified only as C.M.C.
After a lifelong search for spiritual meaning, C.M.C. experienced “the supreme event of my life ... the outcome of those years of passionate search.” Worn out by “the pain and tension deep in the core and center of my being,” she submitted to a higher power and let go of herself entirely. The result was “a feeling of perfect health” and a new appreciation of “how bright and beautiful [was] the day.” She goes on:
The sense of lightness and expansion kept increasing, the wrinkles smoothed out of everything, there was nothing in all the world that seemed out of place ... The light and color glowed, the atmosphere seemed to quiver and vibrate around and within me. Perfect rest and peace and joy were everywhere, and, more strange than all, there came to me a sense of some serene, magnetic presence—grand and all pervading ... I was seeing and comprehending the sublime meaning of things, the reasons for all that had before been hidden and dark ...
I felt myself going, losing myself. Then I was terrified, but with a sweet terror. I was losing my consciousness, my identity, but was powerless to hold myself. Now came a period of rapture ... The Perfect Wisdom, truth, love and purity! And with the rapture came the insight. In that same wonderful moment of what might be called supernal bliss, came illumination. I saw with intense inward vision the atoms or molecules, of which seemingly the universe is composed—I know not whether material or spiritual—rearranging themselves, as the cosmos (in its continuous, everlasting life) passes from order to order. What joy when I saw there was no break in the chain—not a link left out—everything in its place and time. Worlds, systems, all blended in one harmonious whole. Universal life, synonymous with universal love! ...
How long the vision lasted I cannot tell. In the morning I awoke with a slight headache, but with the spiritual sense so strong that what we call the actual, material things surrounding me seemed shadowy and unreal. My point of view was entirely changed. Old things had passed away and all had become new. The ideal had become real, the old real had lost its former reality and had become shadowy. This shadowy unreality of external things did not last many days. Every longing of the heart was satisfied, every question answered, the “pent-up, aching rivers” had reached the ocean—I loved infinitely and was infinitely loved! ...
Out of this experience was born an unfaltering trust. Deep in the soul, below pain, below all the distraction of life, is a silence vast and grand—an infinite ocean of calm, which nothing can disturb; Nature’s own exceeding peace, which “passes understanding.” (all emphases in original)
At the risk of interpreting a sublime experience in dispiritingly mundane terms, C.M.C.’s rapturous flood of knowledge could be described as a data dump. No longer focused on appearances, she was, in a sense, shown the source code behind the rendered images, the database that underlies the simulation. For some timeless interval she enjoyed direct, unfettered access to this source, and could see the whole pattern: the universal plan and order, the laws and constants, everything. She saw the components of the universe “rearranging themselves, as the cosmos ... passes from order to order,” perhaps in a manner similar to the changes on a computer screen, where one ordered pattern is replaced by a new ordered pattern every time the screen refreshes. She peered behind the veil, saw through the illusions.
But it was only temporary. The headset slipped down again, and she was back in the familiar, rendered, virtual-reality world.
In the VR model, our perceived experience can vary from level to level in the game. Very rarely, we emerge from the game altogether. These brief escapes are peak experiences, mystical transports, episodes of cosmic consciousness, spiritual epiphanies. They form the basis for religions, philosophies, art, music, morals, culture. In these moments we—like Melville’s Ahab—“strike through the mask” of our false reality, penetrating nearer to the heart of things.
But come on. How can mysticism tell us anything about reality? That’s what science is for, isn’t it? What we need is not metaphysics, but physics.
Okay, let’s look at physics.
I begin this excursus with a caveat lector (reader beware): I’m not a scientist and can only report what I’ve read in books and essays. Moreover, there are many differing interpretations of quantum physics, all of which are correct in terms of mathematics, but none of which has attained a consensus as the final, authoritative explanation of how things work. Victorian author A.W. Kinglake thought churches should have the words “Important if True” carved over their entryways. Perhaps this section of the book should have a similar heading.
In the scientific community, there is a small but vocal faction arguing that the space-time universe actually is grounded in pure information. The late physicist John Wheeler, who came around to this position, summarized it as “everything is information” or, more pithily, “it from bit.”
Why would anybody think such a crazy thing? Much of it has to do with the oddities and paradoxes of the quantum (subatomic) realm. Experts have long known that a subatomic entity can behave like either a particle or a wave, which is not how objects in everyday life behave. In fact, it’s not consistent with the behavior of objects as such. It’s more consistent with the way information works.
The basis for particle-wave duality, also known as quantum indeterminacy, is the famed double-slit experiment, which has been repeated and confirmed countless times. Electrons beamed through a pair of slits will, if measured one way, produce an interference pattern consistent with a wave, but will, if measured another way, produce a scattershot pattern consistent with individual particles. The pattern on the screen depends on which measurements are taken—and yet taking the measurements has no physical effect on the photons. We can be sure of this, because the result holds true even if the decision about how to measure the electrons is taken after the experiment is over (but before any results are known).
Take a moment to digest this: The actual physical result is determined by our decision on how to make the measurements, even after the fact.
Again, this is not at all how objects behave, but it is the way information behaves. Our decision on which calculations to perform will determine what mathematical outcome we end up with, just as our decision on which measurements to make will determine whether the electron is expressed as a particle or a wave.
When we talk about a wave in this context, we’re really talking about a probability wave—a distribution curve representing all possible positions that the electron might occupy at a given moment. And what is a probability wave except mathematical information? It is a graphical representation of all possible outcomes. What is a particle? It is one point on the graph—the one particular outcome that is actualized in any given case.
Things get even weirder. In The Hidden Domain, Norman Friedman observes:
If we duplicate this experimental [double-slit] arrangement throughout the world with many experimenters, each firing just one electron at a given prearranged time, with each individual photographic plate showing the arrival of the one electron, and the results from all the plates are added together, then, amazingly, the interference pattern shows up again! These experiments are arranged so that no signal can travel between them at less than the speed of light, so there can be no physical communication between the electrons. Just how does each electron know where to strike the plate so that the interference pattern appears?
In a computational universe, the electrons know where to strike the plate because the calculations have already been performed at the level of information processing. The fact that the experiments are being carried out in different labs is irrelevant, because the source code is nonlocal. Since it is all one experiment (albeit broken up into different parts), the outcome is determined by a single set of calculations behind the scenes.
In other words, an electron behaves like a wave of probabilities when its position is not determined, and it behaves like a particle when its position is determined. What, then, is an electron? An object—or a mathematical construct, a bit of data?
There is more to the story. Every probability wave is essentially a menu of possible outcomes, each of which has an equal reality until the wave function “collapses” into a single outcome, which we call a particle. As long as the wave function is uncollapsed, its possibilities can branch out in a variety of possible futures. This branching or ramifying occurs in “virtual time,” as distinct from the “real time” with which we’re familiar. All of this is quite consistent with the computer model, in which all possible outcomes of the program exist in the source code but only one pathway can be followed by any given player.
Some physicists, troubled by the wave function’s collapse, argue instead that all pathways are actualized in a constantly expanding collection of parallel universes or “many worlds.” Like Alice’s White Queen, I can believe six impossible things before breakfast, but to think that whole universes sprout into being to match every possible path in a network of probabilities is more than I can swallow. What seems far more likely is that these alternate universes exist only in utero, as potentialities inherent in the source code; the informational pathways are real at the computational level, but most of them are not actualized at the experiential level. This would certainly be a lot more efficient than generating millions of new universes every second! As Elon Musk, quoted in Rizwan Virk’s recent book The Simulation Hypothesis, puts it, “Quantum indeterminacy is really an optimization technique.”
Another fascinating feature of the subatomic realm is quantum entanglement. Two electrons, once paired, will continue to affect each other no matter how far apart they travel, and can affect each other instantaneously—too fast for any signal to pass between them. If the spin of one electron is altered, the spin of its counterpart will be simultaneously altered in a corresponding way, even if the two electrons are at opposite ends of the universe.
If we think of electrons as objects, quantum entanglement is baffling. But if we think of them as pixels on a computer screen, the paradox disappears. A computer screen refreshes many times each second. The computer is constantly processing information, and with each screen refresh, the icons and graphics on the screen will be redrawn to reflect the latest calculations. The computer doesn’t care if pixel A is on the extreme left side of the screen, and pixel B is on the extreme right side. The physical distance between the pixels is irrelevant to the information processor’s calculations. If the “rule” is that a change in pixel A necessitates a complementary change in pixel B, then as soon as that calculation is made and the screen refreshes, both pixels will be appropriately altered.
Interestingly enough, the computer analogy also gives us a way to solve one of the world’s oldest logical paradoxes—Zeno’s paradox of the arrow. Zeno argued that motion is impossible. To prove it, he asked us to consider an arrow in flight. The arrow’s path can be broken down into smaller and smaller units, and in the smallest of these units the arrow will be standing still. How, then, can it ever get anywhere, if its apparent motion consists ultimately of static positions? How can movement arise from immobility?
If Zeno had owned a PC, he might have solved his own paradox. The pixels on the screen never actually move. They are static. But because the screen is constantly refreshing, and because the pixels are drawn in different positions with each new refresh, the appearance of motion is created. The cursor appears to move across the screen, but it is really a series of still pictures being redrawn at a very high rate.
Let’s say Zeno’s arrow is equivalent to the cursor on the screen. As Zeno correctly stated, it is never actually in motion. But at a deeper level, our cosmic information processor is performing the necessary calculations and refreshing our space-time reality “screen,” and it is those calculations and the resultant changes in the arrow’s position that create movement as we know it.
This argument implies that all motion originates in the informational field, and that all apparent movement in our experiential reality is the result of “state transitions”—abrupt jumps from one state to another.
Quantum jumps and quantum tunneling are well-known examples of state transitions—discontinuous changes, in which a particle shifts its energy level or its position or from one state to another without passing through the intervening state. It would be like a person aging from ten years old to twelve years old without ever passing through age eleven, or like someone traveling directly east from New York City to Europe without crossing the Atlantic Ocean. It’s not something that happens in our familiar reality, but it is easy enough to understand if the transitions reflect calculations taking place in an informational field. The particle does not need to pass through the intervening states, because it simply shifts from one state to another as a result of a behind-the-scenes calculation. The new state shows up as soon as the virtual-reality screen is refreshed.
For this to work, time itself must be “quantized”—there must be a minimum duration, corresponding to the length of time between screen refreshes. It is generally agreed that such a minimum duration exists. There is, first of all, a minimum physical distance known as the Planck length. Since the speed of light is unchanging, it is possible to calculate the time it takes light to travel one Planck length. This figure equals the Planck time constant, the shortest possible interval of time. In our model, the Planck length is equivalent to a single pixel on a computer screen, while the Planck time is equivalent to the time it takes to refresh the screen.
The speed of light, by the way, has also been singled out as an argument for the informational model. In his essay “The Physical World as a Virtual Reality,” computer scientist Brian Whitworth asks, “Given the speed of light is a universal maximum, what is simpler, that it depends on the properties of featureless space, or that [it] represents a maximum network processing rate?” He suggests that the dilation of time predicted by Einstein’s relativity theory can be seen as the information-processing system reaching the limits of its processing load.
The computational model can even be used to describe the origin of our space-time universe in the Big Bang. Whitworth observes that the Big Bang is not dissimilar to the “sudden influx of information” observed when a computer boots up. Maybe it should be called the Big Boot.
It has often been noted that the mathematical formulas necessary to describe our reality are confoundingly simple. Kepler’s laws of motion and Einstein’s E=mc2 are remarkably elegant equations. There’s no obvious reason why physical reality should be expressible in such terms. But if all physical things can be reduced to information, and if all physical events are the result of processing that information, then we might expect the basic rules governing the system to be as simple as possible. After all, these calculations would have to be performed untold quadrillions of times every second; simple formulas would clearly be better.
Now, I’m not saying our universe actually exists on the hard drive of somebody’s laptop. (If it does, I hope it’s a Mac, because they don’t crash as much.) This would be a purely materialistic interpretation of the idea—a way of locating the ground of being in some physical object, in this case an extradimensional or extraterrestrial (but physical) computer. I think the reality is far more subtle. Some of its nuances are caught in a famous quote from Stephen Hawking’s A Brief History of Time: “Even if there is only one possible unified theory, it is just a set of rules and equations. What is it that breathes fire into the equations and makes a universe for them to describe?”
I suggest that what breathes fire into the equations is consciousness.
The data in a computer would just sit there, useless for game-playing purposes, unless the computer was able to render the data as images and sounds. By what means do we “render” our world? The most straightforward answer is: via our minds. Not our brains—brains are physical objects and thus part of the rendered, multidimensional, multisensory imagery we call reality. It is our minds that translate the informational code into the world of experience.
If so, then each individual mind renders its own “virtual-reality” world out of the same information matrix. And each “world” will be slightly different from all the others, because it will depend on our particular point of view—our focus, our choice of what to tune in and what to ignore.
If this idea sounds familiar, it may be because you’re acquainted with the eighteenth-century philosopher Immanuel Kant. Kant divides reality into two realms—the phenomenal realm, or the world of appearances, and the noumenal realm, which consists of “things in themselves.” For us, the phenomenal realm is the space-time cosmos, and the noumenal realm is the informational field.
Modern philosophers have been happy to accept Kant’s phenomenal world, with its subjectivity and limitations, but are less interested in his noumenal world. The result is that Kantianism has given rise to modern epistemological skepticism, with no counterbalancing weight of the noumenal to ground it in a larger reality. In effect, philosophy has focused solely on the world of appearances. But I think Kant was closer to the mark. His bisection of the world into the noumenal and phenomenal realms is probably as close as we can get to understanding, in philosophical terms, what reality is all about.
In its entry on Kant, the Stanford Encyclopedia of Philosophy makes the important point that “Kant denies that appearances are unreal: they are just as real as things in themselves but are in a different metaphysical class.” Similarly, in our model, it is not that the space-time cosmos is unreal; it is real for us. But it is not ultimately real; it is dependent on an informational field that is beyond space and time.
Kant wrote of “the objects, or what is the same thing, the experience in which alone they can be cognized (as given objects).” This profound statement encapsulates the often overlooked fact that all experience is subjective, and that what we call “physical things” are ultimately sensory images in our private field of awareness. Those sensory images—which include all perceptions, not just visual images—would not exist without an observer to perceive (“cognize”) them. The informational field, on the other hand, exists regardless of any observer.
As the encyclopedia puts it,
Whenever appearances do exist, in some sense they exist in the mind of human perceivers. So appearances are mental entities or mental representations ... These appearances cut us off entirely from the reality of things in themselves, which are non-spatial and non-temporal. Yet Kant’s theory, on this interpretation, nevertheless requires that things in themselves exist, because they must transmit to us the sensory data from which we construct appearances.
This passage would require very little rewriting to apply to the VR model.
We all live in our own subjective bubble of experience, but we all draw on a common source. Each mind takes pure information and translates it into an experiential world, a world that is subjective but grounded in objective data. By objective, I mean that the informational field exists independent of the observer; by subjective, I mean that the rendered environment exists only in respect to the observer.
Now here’s an interesting question. In this scenario, what is the role of physical space? Matter and energy are rendered from data. Data are nonphysical. The minds that do the rendering are also nonphysical. The resulting rendered sensory images appear to be physical, but they are only experiential constructs, the equivalents of avatars and icons on a computer screen. What exists in this model is not physical space but only information and consciousness. What we understand as physical space is only the shadow-show of mentally constructed images arising from an informational substrate.
It would appear that people like C.M.C. who have episodes of cosmic consciousness are able to temporarily break out of their mental bubble and tap into the informational field directly. In so doing, they feel they are exposed to all knowledge, which would be the case if the informational field constitutes all the data and programming that underlie what we call “the world.” But they cannot retain most of the details when they return to ordinary consciousness, because they are back in their subjectively rendered mental space with its inherent limitations. Moreover, they are not meant to retain the details; they must remain fully immersed in the virtual-reality experience (Maya) so they can continue to participate in the cosmic play (Lila).
It is probable that many psychic events take place because the mind is able to tap into the informational field in a small way and access the source code directly. The source code, being nonphysical, is also nonlocal; information readily accessible in the matrix may pertain to physically separate and quite distant “objects,” just as information in a computer may pertain to any object in any part of the screen. In this scenario, remote viewing and telepathy become quite possible and not “anomalous” at all.
Another implication of this notion of consciousness as the “render engine” of subjective reality is that each of us renders only that part of the world we perceive in any given moment. To conserve processing power, computer programs do not render images that are not currently on the screen. If you are playing a computer game and looking “north” at a mountain, the computer will render the mountain in all its detail, but it will not render the city behind you, to the “south.” If you turn to face south, the computer will obediently render the city, but it will no longer render the mountain. In a virtual-reality environment, to be is to be perceived.
Does this mean that in the “real world,” mountains and cities disappear if you’re not looking at them? Logically, it does seem to follow that they do disappear from your particular reality bubble, your personal, subjective mental space. Your mind is not rendering those particular data into imagery at that moment. However, if the mountain or city is being observed by some other mind, then it is rendered in that mind’s personal space. Moreover, the data that are the ultimate constituents of the mountain or city always exist in the source code, independent of any observer.
To ask an old question: Does the moon disappear if no one is looking at it? If literally no mind anywhere is observing the moon, then the moon is not currently being rendered in anybody’s mental space, and in that sense it has “disappeared.” But the data that give rise to the moon in the first place, the data of the informational field, are still there and are ready to be rendered by any mind at any time. So the moon is still there in the noumenal realm, but it is not presently being rendered in the phenomenal realm.
As the Zen master Yung-chia Ta-shih put it,
The one Moon reflects itself wherever there is a sheet of water,
And all the moons in the waters are embraced within the one Moon.
This idea ties in with, and may help explain, quantum indeterminacy. An electron’s probability wave branches out into myriad pathways or “potentia,” each representing a possible future. These pathways exist only at the computational level. Which future is actualized? Whichever one a mind selects. Once a mind has made the selection, the ramifying pathways collapse into a single defined value (an event known as “the collapse of the wave function”). This defined value will then be true for all observers—i.e., true in the rendered subjective environment of any mind. The defined value will be “reality.”
Rizwan Virk envisions individual minds interacting in much the same way as the players of a massively multiplayer online role-playing game (MMORPG). Such games have
the ability to store and track the state of a large number of simultaneous characters ... and the state of the shared, persistent game world as information. The information, which is the basis of everything that goes on in the virtual world, is stored somewhere outside the rendered world—on cloud servers that are invisible to those inside the world and rendered as needed ...
Not only is a virtual world in modern MMORPGs larger than we can see on one screen, it isn’t fully rendered into pixels until and unless it’s necessary ... Only those places in the world where there is an observer get fully rendered as pixels ...
MMORPGs are still rendered on individual computers—as such, a “shared rendered world” doesn’t really exist. Each computer renders what is happening in your scene. If my character is present and yours is present, then both of our CPUs/GPUs will be rendering the scene based on shared information. Where is this information? It is both decentralized and centralized—it is sent from the client machines based upon every choice you make and then synchronized and sent to the other people that are in the same place that you are.
So here we are, nearing the end of our exploration of the first model. We can imagine our world as the product of a cosmic information processor—a nonphysical system existing outside of our space-time universe and governing the universe by means of the calculations it performs. Our everyday reality is analogous to the artificial reality of a computer game—except that, being fully immersed in it, we’re unaware that it’s a mere construct. Even our own bodies are part of this constructed reality and serve as our avatars, allowing our consciousness to explore and interact with this ever-changing environment.
There is no reason why the particular reality around us should be the only one that can be generated by the cosmic information processor. Indeed, most computer games have various levels of constructed reality; as you develop more skill, you advance to progressively higher levels, perhaps adopting a new avatar in order to better interface with new environments. And perhaps you reach a point where you no longer need to play the game, because you’ve seen through all its illusions. Perhaps you will take off the VR headset and delve into the source code directly, and in so doing, you will—to hijack another famous formulation of Stephen Hawking—“finally know the mind of God.”
Maybe.
No doubt some objections have occurred to you as you’ve plowed through the above. I’ll try to address the ones I’ve encountered when writing about this model on my blog.
The first objection. Haven’t researchers proven that computers cannot create a simulation as complex as our cosmos?
Yes and no. Researchers have determined that quantum processes are too complex to simulate using classical computers. Since our universe is chock-full of quantum processes, this discovery rules out a giant classical computer crunching data behind the scenes. But when has anyone said that the simulation of our space-time cosmos has to be run on an old-school classical computer?
More important, our argument is not that the universe is literally created by a supercomputer, but rather that the world of appearances relates to an underlying noumenal reality in ways that can be analogized to a virtual reality world rendered from a program.
The second objection. Doesn’t every generation try to model the world after current technology? When clockwork mechanisms were brand-new, the clockwork universe was in vogue. When holography was an exciting new field, we heard about the holographic universe. Now everything is computers and the Internet, so naturally we think of the universe in those terms.
There’s a lot of truth to this. The clockwork universe did reflect the advanced technology of its day. But it also represented a considerable advance over earlier models. Perhaps as our leading-edge technology becomes more sophisticated, it more nearly approaches the underlying truths of cosmology. At the very least, it allows us to think about cosmology in more sophisticated terms.
The theory of the holographic universe popularized by physicist David Bohm is not all that different from the computational model. A holographic plate consists of wave-interference patterns. You can convert waves into data, or data into waves. It’s possible to create a holographic plate by writing data on a computer, converting the data into wave functions, and engraving the waveforms on a plate. The process is known, logically enough, as computer-generated holography.
The point is that both the holographic model and the computational model see the space-time cosmos as an image projected or rendered out of an informational substrate. The exact nature of that informational source is still up for grabs.
The third objection. This whole idea is just too counterintuitive to be true.
Quantum physics itself is highly counterintuitive. Famed physicist Niels Bohr reportedly said, “Those who are not shocked when they first come across quantum theory cannot possibly have understood it.” (Heisenberg, Physics and Beyond)
Even classical physics presents us with a startlingly different picture of our world. We may think of an object, such as a table, as a cluster of atoms bunched together, but in actuality the atoms are more like miniature solar systems widely separated in space. By far the greater part of the table is sheer emptiness. The table feels solid only because the atoms are bound together by electricity. When you touch a table, your body’s electric field bumps up against the table’s electric field, creating the impression of contact and solidity. There’s a reason David Bohm called matter “condensed or frozen light.” (Nichol, Essential David Bohm)
Any model of reality that takes classical physics, much less quantum physics, into account will necessarily be counterintuitive.
The fourth objection. Isn’t it insensitive to compare the tragedies of life to a mere game? And how could any intelligently designed system allow for so much pain and suffering?
Life on earth is hard. There’s no getting around this fact. Dr. Pangloss’s encomia in Candide to “this best of all possible worlds” simply do not ring true for most of us. The “problem of pain” has vexed spiritual seekers of all descriptions. Why would a loving God or a beneficent universe allow so much suffering? The usual explanation, that original sin and plain old human cussedness are responsible, doesn’t account for natural calamities such as earthquakes, tidal waves, and malarial mosquitoes. And human-caused evils like war and tyranny plague the innocent. So what’s it all about?
One possible, though not altogether satisfactory, answer goes like this: How interesting or instructive would a role-playing game be without obstacles, hazards, and challenges? We seek conflict and drama in movies and novels—why not in the ultimate fictional story we’ve devised, the story of our own lives? As I can attest from personal experience, an author doesn’t shrink from making things difficult for his characters; he knows that the more they struggle, the better the narrative. Our higher self, with a kind of pitiless creativity, lays traps and snares for us as we navigate the virtual environment of our personal drama. To us, it may seem like sadism, just as an animal may perceive nothing but hostile intent in the jab of the veterinarian’s needle. It takes a higher intelligence to know that the pain of the injection is the necessary price of avoiding rabies—or that the pain of life on earth is necessary to teach us what we need to learn.
Here’s another possible answer, which I prefer: While the game is planned in some respects, it may not be planned out in detail. If free will is real, then we, the players, can and will make pivotal decisions, writing our own script, which may deviate significantly from what the planners had in mind. Sometimes our higher self will nudge us back on track when we threaten to go too badly off course; other times, we’re on our own. Like children learning to walk, we have to be allowed to fall.
But perhaps the best answer to the problem of pain is that the game, however real it seems while we are immersed in it, is only a game, and a brief one at that. It’s a cliché that as people age, they look back on their lives and wonder where the time went. All those years look like only a moment; a lifetime seems like little more than a waking dream. I think this perception is correct. It is only a moment, only a dream.
The fifth objection. There’s no such thing as a field of “pure information.” Information exists only if there is a mind to perceive it.
This is how most of us think of information, but it’s not how information theorists think of it. According to an online dictionary, information theory defines information as “a mathematical quantity expressing the probability of occurrence of a particular sequence of symbols, impulses, etc., as contrasted with that of alternative sequences.” Mathematical quantities exist whether or not a mind conceives them. Or at least it can be argued that they do.
But doesn’t information involve telling us something? And doesn’t this necessarily involve a mind? Not exactly. Information theory got its start studying the transmission and reception of messages, but today it is understood that the message in question does not need to be sent or received by a mind. Messenger RNA, as its name implies, delivers messages, but that doesn’t mean the ribosomes that receive the information have minds or understand what they’re doing. Such messages can be compared to a key that fits a particular lock; the key does not know which lock it fits; the lock does not know that a key will open it; but when the right key finds the right lock, the “message” has been received.
In short, consciousness is not necessary for information to exist, when the term “information” is used in its technical sense.
The sixth objection. Maybe so, but the information still has to exist somewhere—encoded in DNA or in the pages of a book. Where is this alleged primordial field of pure information encoded?
It’s true that an information matrix with no physical reality is inconceivable, in the sense that the human mind cannot visualize it. But then, we can hardly be expected to visualize anything outside the space-time universe in which we are fully immersed. If there is a deeper level to reality, that level is outside of space and time and is not definable in mundane terms.
Still, we could argue that there is another sort of “place,” beyond genes and books, where information resides—namely, the mind. Imagine a cosmic Mind that eternally holds the entire source code in its field of awareness. This Mind (Brahman) would be the ground of being; the informational field is the content of this Mind; our personal consciousness is a small offshoot of the Mind; and our moment-to-moment experience of the physical universe is rendered out of the informational field by our consciousness as needed.
The seventh objection. I don’t like this approach. It feels cold and impersonal.
Well, stay tuned! There are other models. In fact, “stay tuned” serves as a fitting segue into model number two.