Thoughts on Existential Risk

March 11th, 2018
ea
I recently talked to someone who wanted to know what I thought about existential risk (x-risk). The idea is, how do we keep humanity from being destroyed, or otherwise failing to meet its potential? Within the EA movement there's been some shift in focus from global poverty towards x-risk over the past few years, and as someone who's been advocating for and funding poverty-related organizations they thought I might have some thoughts.

Here's more or less what I said:

  • Future people matter, and we owe it to our children's children to keep from wiping ourselves out. As future people who aren't around yet to advocate for themselves, most decisions today aren't fair to them. A big contribution to global inequality is that the worst suffering is far away from the richest people, and another is that the people involved are less in a position to advocate for themselves: both of these apply even more strongly to future generations.

  • There could potentially be a lot of future people. The scale here is much larger than anything involving the people currently alive on earth.

  • I'm much more skeptical than most people I talk to, even most people in EA, about our ability to make progress without good feedback. This is where I think the argument for x-risk is weakest: how can we know if what we're doing is helping, and how can we do as much good as we can without that? This has been my main concern since I first started thinking about x-risk

  • Cause prioritization, evaluation, and thinking through potential future scenarios are all really hard, and I expect they benefit both from focused study and conversations with people who've similarly put in a lot of thought. As an EA who's gone into earning to give, however, it does make me feel somewhat disconnected. I could say "seems like community consensus is to prioritize x-risk more, despite the reasons that it doesn't seem tractable to me" but that's not how I work, and it's not really EA. I feel pretty conflicted about this, and it's an additional reason to be wary of earning to give.

  • Overall, I've been feeling unhappy about my giving since at least 2016. I think our 2017 donations were valuable, but flexibility is one of the main advantages of earning to give, and it's not one I'm making much use of. Good giving takes time, research, and investigation, and right now I'm not really able to put in that work.

I'm unsure enough that if I don't sort this out this year I might shift giving from GiveWell's top charities to a donor-advised fund. Though if I don't sort this out this year I'm not all that convinced that I'll know better next year either.

(I'm not considering ways of doing good things with my career other than earning to give currently; all of those options seem like they would involve moving or working remotely, neither of which I want to do.)

Referenced in:

Comment via: google plus, facebook, substack

Recent posts on blogs I like:

Linkpost for September

Regular announcements: did you know you can hire me for life coaching and general consulting? You can also buy my novella Her Voice Is A Backwards Record wherever fine books are sold (except Google Books).

via Thing of Things September 8, 2025

Against the Teapot Hold in Contra Dancing

The teapot hold is the most dangerous common contra dancing figure, so I’ve been avoiding it. The teapot hold, sometimes called a "courtesy turn hold,” requires one dancer to connect with their hand behind their back. When I realized I could avoid put…

via Emma Azelborn August 25, 2025

Little Puppy

She's very little and she likes to do stuff with me. She also likes to bark around and run around and jump around. She also likes to go to places with me and that's all I have.

via Nora Wise's Blog Posts August 23, 2025

more     (via openring)