I’m getting sick of the word “existential” because of the way the left reflexively uses it with climate change, but it seems like the most apt word for my question here.
A friend just posted something on LinkedIn about how quantum computing might save us by figuring out how to address climate change. I replied, “Have you read Dune?”
Dune is set long after humanity has won a battle against the thinking machines. After the Butlerian jihad they instituted various conventions to prevent anyone from building a thinking machine. (Basically the rest of the universe would come down on you with atomics and wipe you out.)
Threat #1 — machines taking over.
We’ve all just lived through Covid, which — while mild by historic standards — illustrates that we are not immune to pandemics. Something natural or man-made might be lurking out there, and we are woefully unprepared.
Threat #2 — pathogens.
Iran is probably going to get a nuke. (Thanks, Obama.) Several other not-entirely-stable countries have them. China and Russia already have them. The threat of nuclear war is still very serious, although we seem to have forgotten it after the fall of the Soviet Union.
Threat #3 — nuclear war.
Elon Musk is one of the only people I know who’s talking about population collapse as a potential problem. Birth rates and sperm counts are falling, and weird stuff seems to be happening.
This seems like a serious, but mostly survivable problem.
Thread #4 — population collapse.
I list this one for completeness, but I don’t worry about it.
Threat #5 — alien invasion.
Climate change is a real threat, but I don’t think it’s even close to #s 1-4. We can deal with rising seas, bad weather and such. If we’re hit with any of these, I hope it’s climate change.
Threat #6 — climate change.
What have I missed? And which one do you think is the biggest threat?
Interesting question! I’ll add nanotech-grey-goo (kind of a combination of #1 and #2, I guess) and asteroid impacts.
(I’ve been doing my own preparation for existential threats over the last few months: was trying to decide whether I wanted to move to a smaller town or stay in my current large town and simply get a much higher paying job. I went the latter route for now. Downside is more responsibility, upside is more control over the work I’m responsible for, and a raise of life-altering magnitude, which is nice. But now that the contract is signed I can get back to snarking in comment sections!)
I wasn’t sure I get what nanotech-grey-goo is, but the internet came to the rescue.
Sounds awful, and more likely (as an end of the world scenario) than climate change.
Congrats on the new job!
As to the scenario of machines taking over, you might be interested in this newly published book. (I have been in touch with one of the authors, Barry Smith, since the late 80s.)
https://www.routledge.com/Why-Machines-Will-Never-Rule-the-World-Artificial-Intelligence-without/Landgrebe-Smith/p/book/9781032309934?fbclid=IwAR3R6a3PNkYpIynlX7HQyZCseNGpZq06aUrZeW3dDCrBuOpUhKfgZilVxPM
Just reading the description, it sounds similar to the claim that intelligence requires a body. But that sounds to me like just another hurdle to overcome — i.e., create a digital analog to a body.
I’m sure it’s more complicated than that.