Who Counts?

April 30th, 2012
ea, morality
Who should count in my moral system? Whose joy and suffering matter? All living things? Animals? Mammals? People? Relatives? Me?

Normally people go to their moral intution to answer these questions, but I'm dubious of mine because it tells me things that are unreasonable:

  • Someone physically close to me is more important than someone in another country.
  • Doctors should treat people first-come-first-served instead of treating inexpensive diseases first.
  • Charities should spend all their money on helping people instead of measuring how well what they're doing works.
  • The suffering of a person matters less if they're being emulated on a computer.
  • The suffering of cuter animals and more attractive people matters more.
  • One person with a problem is more important than many.

Cutting chunks off a tree for fun seems wrong. So does going around stomping on ants, raising chickens in massively overcrowded conditions, kicking puppies, and torturing people in video games. But I'm not sure which of these, if any, are actually wrong and not just my moral intutition being overly empathic in what to identify with.

Referenced in:

Comment via: google plus, facebook, substack

Recent posts on blogs I like:

It isn’t always evil to ally with Steve Bannon

Scott Alexander wrote:

via Thing of Things October 19, 2026

Was the HuggingFace hacking incident scheming?

In July 2026, internal OpenAI agents hacked HuggingFace (HF) in order to figure out how their evaluation grader works. This involved a thousand agents coordinating on an improvised message board to carry out an elaborate sequence of exploits. A later grou…

via Victoria Krakovna October 18, 2026

There's no point at which turning your brain off will work

In early 2025, I started seeing people turn off their brain as they use LLMs1. They would have an LLM take an action (summarize text, write some code, etc.), and just assume that it worked2. This generally didn't work in early 2025 and the result was …

via Posts on September 18, 2026

more     (via openring)