What My Eyes See Is What I Consciously See

The brain edits what you see

Most people are never taught this in school, so it's worth explaining plainly: what reaches your conscious awareness is not a direct feed from your eyes. The brain heavily edits raw visual input before it becomes something you're aware of seeing.

The memory color effect

One well-documented example is what researchers call the memory color effect. If you look at a banana that's actually a somewhat dull, slightly green-tinged yellow, most people will report seeing — and even misremember — a much more vivid, "ideal" banana-yellow. The brain pulls toward the color it expects an object to have, based on memory, rather than rendering the exact color hitting the retina.

The same applies to your apple example: if an apple in front of you is faintly mixed with yellow and green, many people's conscious experience skews toward "red apple," because that's the stored, expected color for that shape and category of object. This isn't a metaphor — it's a documented finding in color and object perception research, closely related to what's called color constancy and to predictive processing more broadly.

Why the brain does this

Why does the brain do this? The dominant explanation in vision science is efficiency, not literal "overheating." Processing every detail of raw visual input at full resolution, all the time, would demand enormous computational and metabolic resources. So the brain uses prediction and memory as shortcuts, filling in and substituting the expected version of things, to keep everyday perception fast and cheap.

For me, the substitution doesn't happen

For me, this substitution doesn't seem to happen, or happens far less. What I see appears to reach my awareness closer to raw: the apple in front of me stays the apple in front of me, blemishes, uneven color and all, rather than being swapped out for a mental "ideal apple." It's not something I have to concentrate on, the way a painter has to consciously fight the brain's shortcuts to draw what's actually there. It's just how things look for me, all the time.

It's not something I have to concentrate on. It's just how things look for me, all the time.

The clearest indirect evidence I have is that I could paint what I saw, on the first attempt, with no training — something people generally spend years learning to do specifically because the brain keeps substituting the "idea" of an object for what's actually there. I've also asked around, human friends and AI systems alike, and the pattern people describe is consistent: what's on your plate isn't quite what you consciously see; the food in your memory intrudes on, and effectively replaces, the food that's actually there.

The cost

If the standard explanation is correct — that this substitution exists to keep perception fast and manageable — I'd expect the alternative to come at some cost. In my case, and in my family's, there does seem to be one, though a different one than "overheating": our eyes tire quickly, we often want to lie down, and light feels unusually, uncomfortably bright. I don't experience anything like sensory overload or shutdown. But the fatigue and light sensitivity are real and consistent enough across my family that I think they're worth recording here, even though I can't prove they're connected to any of this.

▲