My favorite books that keep an AI researcher awake at night

Why am I passionate about this?

I've been working in the field of AI for 40 years, first in graduate school and then as a professor. For the most part, I have had my head in the sand, focusing on the minutiae that occasionally lead to publications, the coins of the academic realm. When deep learning started exhibiting human-level pattern recognition abilities, the number of AI books for the general public began to swell.  Unfortunately, the science-fiction scenarios were a bit much. Since understanding, recognizing, and admitting problems are vital steps toward a solution, I find these books to be the most important warnings of the impending tech-dominated future.


I wrote...

Gradient Expectations: Structure, Origins, and Synthesis of Predictive Neural Networks

By Keith L. Downing,

Book cover of Gradient Expectations: Structure, Origins, and Synthesis of Predictive Neural Networks

What is my book about?

Prediction is a cognitive advantage like few others, inherently linked to our ability to survive and thrive. Our brains are awash in signals that embody prediction. Can we extend this capability more explicitly into synthetic neural networks to improve the function of AI and enhance its place in our world? Gradient Expectations is a bold effort by Keith L. Downing to map the origins and anatomy of natural and artificial neural networks to explore how, when designed as predictive modules, their components might serve as the basis for the simulated evolution of advanced neural network systems.

Shepherd is reader supported. When you buy books, we may earn an affiliate commission.

The books I picked & why

Book cover of The Loop: How Technology is Creating a World Without Choices and How to Fight Back

Keith L. Downing Why did I love this book?

I have always been fascinated by feedback loops, so even though the positive feedbacks discussed in this book have a very negative impact on society, they stir my technical curiosity.

More importantly, Ward highlights a very real problem with AI technology and its deployment: the potential for automated recommendations and other nudges to move us, as a population, toward conformity and predictability. 

Ward actually writes about 3 nested loops: 1) our evolved human tendencies, 2) the exploitation of those tendencies by human-based enterprises, such as capitalism and marketing, and 3) exploitation of those same tendencies by AI tools.

By Jacob Ward,

Why should I read it?

1 author picked The Loop as one of their favorite books, and they share why you should read it.

What is this book about?

"The best book I have ever read about AI." -Roger McNamee, New York Times bestselling author of Zucked
Artificial intelligence is going to change the world as we know it. But the real danger isn't some robot that's going to enslave us: It's our own brain. Our brains are constantly making decisions using shortcuts, biases, and hidden processes-and we're using those same techniques to create technology that makes choices for us. In The Loop, award-winning science journalist Jacob Ward reveals how we are poised to build all of our worst instincts into our AIs, creating a narrow loop where each…


Book cover of The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power

Keith L. Downing Why did I love this book?

This book is very long, and somewhat redundant at times. But it’s extremely interesting…and chilling. 

Zuboff cites a wide variety of examples of how companies, Google foremost among them, gather information about us (legally or illegally) and then use it not only to predict our behavior, but to control it as well. That’s the really scary part.

The writing can be a bit too poetic at times, but Zuboff displays an incredible breadth and depth of knowledge on this subject. I’m a slow reader, so this one took me a while to get through, but it was time well spent.

By Shoshana Zuboff,

Why should I read it?

9 authors picked The Age of Surveillance Capitalism as one of their favorite books, and they share why you should read it.

What is this book about?

THE TOP 10 SUNDAY TIMES BESTSELLER

'Everyone needs to read this book as an act of digital self-defense.' -- Naomi Klein, Author of No Logo, the Shock Doctrine, This Changes Everything and No is Not Enough

The challenges to humanity posed by the digital future, the first detailed examination of the unprecedented form of power called "surveillance capitalism," and the quest by powerful corporations to predict and control us.

The heady optimism of the Internet's early days is gone. Technologies that were meant to liberate us have deepened inequality and stoked divisions. Tech companies gather our information online and sell…


Book cover of The Attention Merchants: The Epic Scramble to Get Inside Our Heads

Keith L. Downing Why did I love this book?

Although it is now a well-known fact that many actors are fighting for our online attention, and will do just about anything to get and keep it, Wu puts it all in historical perspective by going back to the 1800’s and the beginning of print advertising. 

He then traces our relationships with ads across a century and four screens: movies, television, home computers, and finally the cell phone. For the same reason that I enjoy reading history books to try to make some sense of the world’s current political chaos, this masterpiece by Wu should ensure you that nothing about human greed has changed in any major way: the tools of exploitation just get more powerful and more addictive.

By Tim Wu,

Why should I read it?

7 authors picked The Attention Merchants as one of their favorite books, and they share why you should read it.

What is this book about?

Attention merchant: an industrial-scale harvester of human attention. A firm whose business model is the mass capture of attention for resale to advertisers.
In nearly every moment of our waking lives, we face a barrage of advertising enticements, branding efforts, sponsored social media, commercials and other efforts to harvest our attention. Over the last century, few times or spaces have remained uncultivated by the 'attention merchants', contributing to the distracted, unfocused tenor of our times. Tim Wu argues that this is not simply the byproduct of recent inventions but the end result of more than a century's growth and expansion…


Book cover of The Shallows: What the Internet Is Doing to Our Brains

Keith L. Downing Why did I love this book?

My first 3 picks put much of the blame for widespread attention capture on greedy actors engaged in a “race to the bottom of the brainstem” (Tristan Harris, former Google employee, became popular opponent of exploitative big tech). 

Although Carr does not shy from that theme, he seems to put much of the responsibility on our own shoulders: it is we who must resist many temptations of convenience in order to preserve our own cognitive strengths, such as creativity. Otherwise, we become shallow thinkers and reliant on AI even for something as characteristically human as wisdom. 

Carr’s follow-up to this book, The Glass Cage, is also very intriguing, and it offers a little more hope for a humanity that is currently bound up in a web of frightening technological dependency.

In my mind, Carr nails the real threats of AI: a total dumming-down of humanity to a level where we behave like AI and are thus incredibly predictable and malleable – putty in the hands of any public or private organization that wants to exploit us, without an inkling of our awareness.

By Nicholas Carr,

Why should I read it?

3 authors picked The Shallows as one of their favorite books, and they share why you should read it.

What is this book about?

Nicholas Carr's bestseller The Shallows has become a foundational book in one of the most important debates of our time: As we enjoy the internet's bounties, are we sacrificing our ability to read and think deeply? This 10th-anniversary edition includes a new afterword that brings the story up to date, with a deep examination of the cognitive and behavioral effects of smartphones and social media.


Book cover of Our Final Invention: Artificial Intelligence and the End of the Human Era

Keith L. Downing Why did I love this book?

I read this and Bostom’s SuperIntelligence around the same period. 

Whereas the latter was a bit too sci-fi for me – and Bostom’s paper-clip-generating monster has become quite the overused meme – I feel that Barrat gets into a much more realistic set of danger scenarios for AI’s that may not take over the world but can cause massive disruption, as things like trader bots already have. 

Perhaps most prescient is his discussion of the containment problem (with an expert on the topic) in light of a recent Chat system that managed to fool a human into giving it access to a robot-prohibited website. I also appreciate Barrat’s interviews of a wide range of AI experts. Although others have interviewed many such luminaries (with Martin Ford’s Architects of Intelligence being the most comprehensive), I particularly enjoy the way that Barrat weaves it all together.

This may only come in 5th on my list because I read it a long time ago. A reread might push it to the top.

By James Barrat,

Why should I read it?

3 authors picked Our Final Invention as one of their favorite books, and they share why you should read it.

What is this book about?

Elon Musk named Our Final Invention one of 5 books everyone should read about the future

A Huffington Post Definitive Tech Book of 2013

Artificial Intelligence helps choose what books you buy, what movies you see, and even who you date. It puts the "smart" in your smartphone and soon it will drive your car. It makes most of the trades on Wall Street, and controls vital energy, water, and transportation infrastructure. But Artificial Intelligence can also threaten our existence.

In as little as a decade, AI could match and then surpass human intelligence. Corporations and government agencies are pouring…


You might also like...

American Flygirl

By Susan Tate Ankeny,

Book cover of American Flygirl

Susan Tate Ankeny Author Of The Girl and the Bombardier: A True Story of Resistance and Rescue in Nazi-Occupied France

New book alert!

Why am I passionate about this?

Susan Tate Ankeny left a career in teaching to write the story of her father’s escape from Nazi-occupied France. In 2011, after being led on his path through France by the same Resistance fighters who guided him in 1944, she felt inspired to tell the story of these brave French patriots, especially the 17-year-old- girl who risked her own life to save her father’s. Susan is a member of the 8th Air Force Historical Society, the Air Force Escape and Evasion Society, and the Association des Sauveteurs d’Aviateurs Alliés. 

Susan's book list on women during WW2

What is my book about?

The first and only full-length biography of Hazel Ying Lee, an unrecognized pioneer and unsung World War II hero who fought for a country that actively discriminated against her gender, race, and ambition.

This unique hidden figure defied countless stereotypes to become the first Asian American woman in United States history to earn a pilot's license, and the first female Asian American pilot to fly for the military.

Her achievements, passionate drive, and resistance in the face of oppression as a daughter of Chinese immigrants and a female aviator changed the course of history. Now the remarkable story of a fearless underdog finally surfaces to inspire anyone to reach toward the sky.

American Flygirl

By Susan Tate Ankeny,

What is this book about?

One of WWII’s most uniquely hidden figures, Hazel Ying Lee was the first Asian American woman to earn a pilot’s license, join the WASPs, and fly for the United States military amid widespread anti-Asian sentiment and policies.

Her singular story of patriotism, barrier breaking, and fearless sacrifice is told for the first time in full for readers of The Women with Silver Wings by Katherine Sharp Landdeck, A Woman of No Importance by Sonia Purnell, The Last Boat Out of Shanghai by Helen Zia, Facing the Mountain by Daniel James Brown and all Asian American, women’s and WWII history books.…


5 book lists we think you will like!

Interested in artificial intelligence, consumer behaviour, and the brain?

10,000+ authors have recommended their favorite books and what they love about them. Browse their picks for the best books about artificial intelligence, consumer behaviour, and the brain.

Artificial Intelligence Explore 283 books about artificial intelligence
Consumer Behaviour Explore 28 books about consumer behaviour
The Brain Explore 149 books about the brain