100 books like Novacene

With recent advances in large language models such as GPT-4, it is predicted that AI capabilities in terms of general decision making and problem solving may exceed that of humans even in less than a decade. Is this good or bad news?

This book is a must-read for anyone who wants to understand and navigate this difficult topic. Of particular interest are Bostrom’s two groundbreaking observations: the orthogonality thesis (any level of intelligence can be combined with any final goal) and the instrumental convergence thesis (any sufficiently non-trivial final goal will also create instrumental goals of self-preservation, efficiency, creativity, and unbounded resource acquisition).

A top pick for anyone who wants to figure out the prospects for the human civilization in the face of superhuman artificial general intelligence.

As I write these lines, artificial intelligence (AI) is getting a lot of attention.

This is largely due to ChatGpt recently bursting onto the scene. But even before ChatGpt began making its mark, AI was often in the news. Some have expressed worry that it will take our jobs, others that it will reinforce systemic oppression by making racially or otherwise discriminatory decisions, and some have even voiced concerns that one day a superintelligent AI might pose an existential threat to humanity.

In the midst of all this, what might get lost is what AI is, what it's capable of doing, and what its limitations are. Wenger's book is intended to address all of these questions. It manages to do so in a way which goes into some of the mathematics of AI systems and yet remain accessible to a lay audience.

After laying out the technical aspects of AI,… show more.

There’s a lot of fear-mongering going around regarding the possibility of a superintelligent AI that could take over or even wipe out humanity. 

Larson gives a clear rationale for why this is not going to happen and further, why it is a big mistake to expect computer reasoning to be like human reasoning. He explains the ways computers think and how they differ from the ways we do. 

In short, we don’t have a clue how to give computers either consciousness or common sense. Without these, worrying about superhuman intelligence is worrying about the wrong thing. There is no way a computer using current AI methods could evolve into a general intelligence.  

As ever more powerful AI-based tools are created, Russell asks the question (and provides some answers) as to how we can ensure that we stay in the control of our creations. In particular, what safeguards are needed to protect us from something that will potentially be more intelligent than ourselves? Some might argue that this is all just science fiction and, even if it’s possible to build machines that are more intelligent than we are, it’s a problem for the distant future. However, there are many areas where AI is already making the key decisions about how we are treated. For example, whether or not to offer you a job or if you should get that loan you applied for. Consequently, I found this book to present a compelling case that controlling AI is something that we need to address as a matter of urgency, sooner rather than later.

Another big thing to worry about. AI doesn’t have to be superintelligent to do real damage. Scharre identifies four areas where AI will radically change the future of international politics and conflict. 

As a former Army Ranger, Scharre looks first at the impact of autonomous weapons and decision-making systems, on the battlefield and behind the scenes. These will speed up the pace of warfare, perhaps beyond our human capacity to keep up and stay “in the loop.” 

But Ai will also move the battlefield to the political arena, economy, and social media. In each of these, AI has the potential to really destabilize our current systems, furthering autocracy, increasing unemployment, and filling our inboxes and minds with misinformation and propaganda. I fear we might see some of Scharre’s concerns borne out in the 2024 election.

OK, I’m biased here because Rob is an old friend of mine. We first met at academic conferences and had several heated debates (arguments). But after spending a little time together at a workshop we realised each probably knew what they were talking about after all. Robert Elliott Smith, I should make clear it's not the Rob Smith who writes about “Artificial Superintelligence”. Those books definitely do not make this list.

Our Rob is a coherent, grounded scientist with bags of real-world experience, and he brings his knowledge to this title with gusto, telling us about how AI is affecting our lives in ways you never thought possible – and often not in a good way. If you want to understand what can go wrong with AI and what we should be doing to stop it, don’t read about singularities or other such nonsense, read this.

This book is a timely primer on the promise and peril of artificial intelligence (AI) authored by an unlikely coalition of insightful thinkers: a 100-year-old diplomat, a former Google chief executive, and an M.I.T. professor.

They present an interesting overview of the range of AI technologies and their likely impact on many spheres of life, from medicine and the military to health care and urban development.

The result is an accessible, thought-provoking book that asks important questions about the role of machine learning in changing human society, for good and ill.

This final work in Banks’ Culture sci-fi series is all about technologically advanced species making the decision to sublime – to depart the “real world” to reside in “higher dimensions”.

As I read the book I found my philosopher’s brain bullied to understand what subliming could possibly be. When techno-enthusiasts propose radical human enhancement are they effectively suggesting that we should sublime? When the aspiring trillionaires of AI are asked about the future in which they make AIs much smarter than us, they get vague about the details.

The throwaway line of OpenAI’s Sam Altman and Microsoft’s Satya Nadella is “all bets are off” after they achieve their stated goal of artificial superintelligence. Should we approach the future gifts of AI much in the way that Banks’s characters approach the offer of subliming?

My sister and I were only close because we’re only two years apart. But recently we’ve had some tragedy in our family, and that brought us closer.

While I was making this list of books, I was reminded of this story and how much I enjoyed it, not just for the prose, which I take notice of and will drop a book if it’s bad, but for that reminder of the brother and sister story here. Not to mention the rescue crew of odd characters which reflects a belief of mine: truth is universal.

Any human or alien can understand compassion and suffering and choose the better of the two.

So much of the public conversation around AI focuses on the extremes: "It's Going to Take Our Jobs And We'll Never Be Able To Work Ever Again!" or "It's Going To Create a Utopia And We'll Never Have To Work Ever Again!"

To be honest, I don't put a lot of credence into either of these perspectives. What I adore about this book is that it puts the technology in perspective in a concrete and laugh-out-loud funny way. Through detailed examples, it provides a glimpse into how the technology works, how it can be applied to real problems, and where it falls jaw-droppingly short.