The most recommended books on visual perception

I am a neuroscientist best known for my studies and writings exploring the brain basis of consciousness. Trained as a physicist, I was for 27 years a professor of biology and engineering at the California Institute of Technology in Pasadena before moving to the Allen Institute in Seattle, where I became the Chief Scientist and then the President in 2015. I published my first paper on the neural correlates of consciousness with the molecular biologist Francis Crick more than thirty years ago.

As a writer, I’ve always been interested in ambiguity and ambivalence. How does that apply to the self? What does it mean to present myself to others? How do I appear to the world and how close is that to what I see myself to be? Are we ever truly seen—or willing to be seen? In a world where cameras exist everywhere and we are encouraged to record rather than simply be, how do we look in a mirror? Hannah Arendt said that we could tell reality from falsehood because reality endures. But I feel that nothing I experience endures; nothing remains the same, including the reflection. If anything lasts, it may be my own make-believe. Everything I write is, in some way, this question. Who is that?

It’s been fantastic to work in computer vision, especially when it is used to build biometric systems. I and my 80 odd PhD students have pioneered systems that recognise people by the way they walk, by their ears, and many other new things too. To build the systems, we needed computer vision techniques and architectures, both of which work with complex real-world imagery. That’s what computer vision gives you: a capability to ‘see’ using a computer. I think we can still go a lot further: to give blind people sight, to enable better invasive surgery, to autonomise more of our industrial society, and to give us capabilities we never knew we’d have.

Drawing and painting people has been my passion and my profession for a couple of decades now. Fine art, comic books, animation, illustration – as long as I'm drawing people, I'm happy. I love the challenge of trying to capture (or create) a living, breathing, thinking person on paper. And I love talking about art books with other artists. Which ones are great, which ones miss the mark, which ones have tiny hidden gems in them. This list is a mix of books I love, and books I heartily recommend.

My journey began as a high school camp counselor at the Ability Center of Greater Toledo in Ohio. As I worked with children who had neurodevelopmental differences and collaborated with a co-counselor who had cerebral palsy, I saw how people with differences were marginalized and devalued despite being insightful, empathetic, passionate, funny, and talented. My appreciation for their strengths and perspectives shaped my approach as a pediatric neurologist, BCBA, neuroscientist, researcher, and founder of Cortica, which is focused on a whole-child, neurodivergent-affirming approach to care for autism and other neurodevelopmental differences. Reading is an important way for me to stay connected to the strengths-based lens I began cultivating in my teens.

I have obsessed with maps my whole life, but I guess the main drive for studying them is my enjoyment of outdoor spaces, as a hiker, a mountaineer, and as a sailor: always with a paper map at hand. If you use GPS (a wonderful innovation) you will not only lose some of your precious orientation abilities but above all you will look less at the environment around you. I feel that paper maps do a great favor to my brain and to my enjoyment of places. The books below are a great tribute to maps; they helped me understand them better, and this affected the way I use them.

I'm a designer, a teacher, a father, a husband, and a friend. I love beautiful things and personally want to know why I find certain things more beautiful than others. I love learning about the world and finding connections between everyday experience and art. When I say “art” I really am blending art, design, architecture, landscape architecture, product design, etc. I believe everything is connected in some way. If I were to pigeonhole myself in any way I would call myself a generalist design thinker. I draw, I write, I make little objects, I make big objects – I see very little difference in any of these things.

Writing my first book, I found out how dependent my thinking about the world beyond my doorstep was on language made up by engineers (“Please don’t block the driveway”). Engineering language defined how I saw the street. It was a shock to realize how severely this had limited my thinking about public space but also a liberation to become aware of this: now I could perceive streets in completely new and different ways. The books I recommend all have made me perceive the world differently. I hope they do the same for you. Also, see the recommendations by my co-author, Marco te Brömmelstroet.

I was thrown into the deep end to learn about autism when our first son was diagnosed as autistic. As first-time parents, how were we to know that the struggles we faced went beyond the norm? We also have twins, one of whom is ADHD and the other dyslexic. Thus, not only have I spent a lot of time learning about autism, but I also enjoy turning to fiction to learn how others both struggle and find solutions. I started writing because the bedtime routine with my kiddos was very difficult. Nearly twelve years later, I am still using my writing to overcome the obstacles in my life. 

If I was asked to describe the central theme of my life's work in a phrase, it would be 'geometry in the arts'. I'm an architect originally, now a professor in London, and have always loved drawing and the art of perspective. In the 1990s I became fascinated with the idea that Johannes Vermeer used the camera obscura, an obsession that led to my book Vermeer's Camera. I'm now working on Canaletto's Camera. And I have ideas for yet another book, on perspective, to be called Points of View. I've chosen five books on these topics that I've found most thought-provoking and inspiring.