typing keyboard daniel dennett

What Happens When Machines Become Smarter than People?

Philosopher Daniel Dennett is not worried about a catastrophic singularity event — but that doesn’t mean he’s not worried. This article outlines what he considers to be the real, practical dangers of artificial intelligence.

Jack Maden
By Jack Maden  |  December 2019


Last month, former champion of the ancient board game Go, Lee Se-dol, retired from professional play. His reason? “With the debut of AI in Go games,” Lee Se-dol told Yonhap News Agency in Seoul, “I’ve realized… even if I become the number one, there is an entity that cannot be defeated.”

Lee is referring to AlphaGo, an artificial intelligence system created by Google-owned company, DeepMind.

AlphaGo played Lee at Go in 2016, and shocked the world by beating him four matches to one. Go is an extremely sophisticated game, and success at the top level is generally reserved for only very gifted human brains. DeepMind’s use of neural network technology to outsmart the best human player on the planet, therefore, marks a seismic change in the perceived sophistication and potential of AI.

Go board game
There are more possible configurations for pieces on the Go board than there are atoms in the observable universe.

Since that fateful match in 2016, the team at DeepMind have released AlphaGo Zero, an even more advanced version of the program. Within three days of training by playing itself over and over, AlphaGo Zero surpassed the original AlphaGo program, beating it 100 matches to zero.

No wonder poor Lee Se-dol regards any possibility of reclaiming his 'best ever player' status as futile.

Could AI get out of hand..?

Accomplishments in AI like the AlphaGo project have led some commentators to worry that, eventually, all this deep learning could get a bit out of control, culminating in a catastrophe event that’s become known as the ‘singularity’.

As philosopher David J. Chalmers puts it in his paper, The Singularity: A Philosophical Analysis:

What happens when machines become more intelligent than humans? One view is that this event will be followed by an explosion to ever-greater levels of intelligence, as each generation of machines creates more intelligent machines in turn. This intelligence explosion is now often known as the ‘singularity’.

The singularity is typically associated with world-ending consequences, with tech mavens like Elon Musk pronouncing it humanity’s greatest existential threat. Put simply, the concern is if we’re capable of creating machines more intelligent than we are, then that generation of machines is capable of creating machines more intelligent again. This would lead to an exponential situation where human intelligence is quickly and irretrievably left far behind by machine intelligence. Consequently, we’d lose authority and control.

Best case, we become slaves to the machines; worst case, we’re exterminated as surplus to requirements.

American philosopher Daniel Dennett, however, doesn’t buy it. In the final chapter of his latest book, From Bacteria to Bach and Back, Dennett reflects on the role technology is playing and will come to play in our lives. As he puts it:

I am not worried about humanity creating a race of super-intelligent agents destined to enslave us, but that does not mean I am not worried. I see other, less dramatic, but much more likely, scenarios in the immediate future that are cause for concern and call for immediate action.

Our reliance on AI could lead to negligence

For Dennett, while a singularity event remains possible in principle, “the task is orders of magnitude larger and more difficult than the cheerleaders have claimed.” He argues that smart technology presents us with more practical threats that have a far higher likelihood of occuring. As he clarifies:

The real danger, I think, is not that machines more intelligent than we are will usurp our role as captains of our destinies, but that we will over-estimate the comprehension of our latest thinking tools, prematurely ceding authority to them far beyond their competence.

Take transport. It’s not just aviation and shipping industries that depend on GPS for safe and efficient navigation: how many individuals now turn to their smartphones instead of using a road map?

Daniel Dennett
Daniel Dennett, possesser of great (human) intelligence.

Alternatively, take medicine. Computer-based systems now outperform the best human diagnosticians on their own turf, identifying early stages of cancer and other diseases with unprecedented precision. What does this imply about how we train doctors? Will we be encouraged to jettison huge chunks of traditional medical education, because machines can now do certain parts of the job more effectively?

As Dennett summarizes:

Use it or lose it is the rule of thumb cited at this point… how concerned should we be that we are dumbing ourselves down by our growing reliance on intelligent machines?

It could be argued that we’ve always used technology to make our lives easier throughout history, and that AI is just the latest ‘dangerous’ invention we’ll soon all calm down about.

However, the difference here is that while something like, say, a tractor replaces human labor, it doesn’t replace human comprehension: the human brain still plays a central role in plowing fields. AI is different because it does replace human comprehension: we cede not just labor but intellectual authority and expertise to the machine.

This, for Dennett, is what's dangerous. What happens when the machines break? Will there be enough clued-up human experts to step in? If a coronal mass ejection from the sun were to wipe out global electronics, for example, are we confident civilization could survive?

As NASA states in an article on solar flares:

In an increasingly technological world, where almost everyone relies on cell phones and GPS controls not just your in-car map system, but also airplane navigation and the extremely accurate clocks that govern financial transactions, space weather is a serious matter.

So, besides preparing our machines for such space weather, what can we do culturally to prevent ourselves becoming too dependent on technology? How can we ensure we never overestimate the competence of machines to run societies on our behalf?

Calling out the incompetences in software

Dennett’s solution to the problem of over-reliance is to make absolutely explicit the boundary between machines that are tools and those that claim to replace our comprehension.

We should expose and ridicule all gratuitous anthropomorphism in systems, the cute, ever-more-human voices, the perky (but canned) asides. When you are interacting with a computer, you should know you are interacting with a computer.

We should make it fashionable to identify and point out flaws in systems, Dennett argues. What's more, we should write it into law that any advertisements for technology must acknowledge all shortcomings in the software — just like healthcare companies are obliged to list side effects.

As Dennett forcefully puts it:

Systems that deliberately conceal their shortcuts and gaps of incompetence should be deemed fraudulent, and their creators should go to jail for committing the crime of creating or using an artificial intelligence that impersonates a human being.

This might seem alarmist, but Dennett’s argument should be considered in the context of how societies currently operate.

Comprehension is already spread thin amongst various power structures. Politicians know some things; scientists and professors know some things; business leaders know some things; emergency services know some things — but nobody knows everything. Specialization in society is rife. And if we start ceding that specialist knowledge to machines, then just as society becomes more complex humans will know less about how to deal with it.

We can reboot machines easily (and frequently do to fix problems); but we can’t reboot civilization without causing serious harm. As Dennett concludes:

Civilization is a work in progress, and we abandon our attempt to understand it at our peril.

Give human intelligence a go

What do you think? Is AI dangerous? Does the singularity pose a serious existential threat to society? Is our dependence on technology the more realistic path to civilization’s downfall? Or is all this talk of downfall merely alarmist thinking?

From Bacteria to Bach and Back is a wide ranging and fascinating book. As well as his reflection on technology discussed above, Dennett tackles a bunch of outrageously difficult questions in typically entertaining style. What are the origins of language and culture? What is human consciousness? How did it become possible for our minds to even ask this question?

Dennett takes the reader on a riveting journey from natural selection and ‘design without a designer’ through to cultural evolution and the birth of intelligent (human) design. For minds slipping into the warm, numbing embrace of machine intelligence, From Bacteria to Bach and Back is Dennett’s glorious bucket of ice-cold water, twisting human comprehension inside out.

And if that doesn't float your boat, we've compiled a reading list of the most essential, compelling, and accessible works on the philosophy of human consciousness. Hit the banner below to access it now.



The Top 5 Books to Read

Philosophy Break

Discover exactly what philosophy is and how it can improve your life with just 1 email per day for 3 days

Philosophy Basics

What is philosophy? Why is it important? How can it improve your life? Discover the answers to all these questions and more with our free, 3-lesson introductory email course:

1 email per day for 3 days. Join 50,000+ thinkers. No spam. Unsubscribe any time.

Philosophy Basics





6-Day Introduction to Nietzsche Course

Life's Big Questions

Learn everything you need to know about Friedrich Nietzsche in just six days. This introductory course distills Nietzsche’s best and most misunderstood ideas, from God is dead to the Übermensch.

★★★★★ (9 reviews)

Learn More about Course
Introduction to Nietzsche

Latest Course Reviews:

★★★★★  Great

Great course experience, content was clear and simple to read. Loved the way the course was delivered and the writing was informative, interesting, and easy to understand. My favorite chapter was the final one on the will to power, I thought it brought everything together very nicely. Thanks for creating such an accessible course on Nietzsche!


  Julien S. on 22 March 2022

★★★★★  Please make more

It was really good. Honestly, there are things I thought I knew but turns out I had completely misunderstood from the books and the course helped me to figure out what I was missing. The content was very easy to understand and didactic, covering everything I was hoping for, and the difficulty of material was very well balanced. Please make more!


  Joaquim N. on 16 March 2022

★★★★★  Excellent

Excellent. Well written and an enjoyable read on my iPhone. I found the content very interesting. It’s been over 30 years since I took a course on Nietzsche - great to revisit the material at a later life stage and new perspective. My favorite chapter was the one on perspectivism.


  David U. on 11 March 2022

See All Course Reviews

Life's Big Questions

Latest Course Reviews:

★★★★★  Brilliant primers

Brilliant primers on all the major topics of philosophy. I wasn't entirely sure what to expect but the content provides a ton of value, it's all brilliantly written and delivered and covers so much. Highly recommend if you're at all interested in philosophy.


  Rebecca L. on 7 August 2022

★★★★★  Thoroughly enjoyed

Great! All content was very well written and easily digestible. Thoroughly enjoyed throughout. Free will was my favorite chapter, due to my personal interest in the subject, but all chapters were both interesting and easy to comprehend.


  Niall C on 24 July 2022

★★★★★  Very good

Very good. After completing the course I am now planning to start a serious study of philosophy. My favorite chapter was Chapter 2: considering we perceive a 'photo' of reality, rather than reality itself, was a real breakthrough.


  Luca G. on 19 June 2022

See All Course Reviews

Take Another Break

Each break takes only a few minutes to read, and is crafted to expand your mind and spark your philosophical curiosity.

Epicurus Principal Doctrines
If a tree falls in the forest, and there's no one around to hear it, does it make a sound?
eternal recurrence nietzsche
David Deutsch cosmic significance

View All Breaks