• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • Technical Distance to AGI

    July 11th, 2017
    airisk, giving  [html]
    I think the largest piece of the disagreement between ML people over how to prioritize AI risk may turn out to be: how likely is it that we get AGI soon that looks a lot like systems we have now?

    Specifically, here are two things I'd guess most of the people I've talked to would agree with (though I haven't run this by any of them):

    • If there were a 10% chance of current systems getting us to AGI within the next 10 years, then the kind of questions posed in Concrete Problems in AI Safety (pdf) would be very important from a safety perspective.

    • If the chance were less than 1%, then while those are still interesting research questions that look useful for today, they're not altruistically important.

    What I'm planning to do next is write back to all of the people I've been talking to in order to find out:

    • Does this actually capture their views?
    • What do they put the chance at, and why?

    Before I reach out to people again, though, I wanted to post this here for feedback. Any thoughts?

    (This is a lot like the more general question of AI timelines. For that, Open Phil's What Do We Know about AI Timelines? gives a good overview and summary, with Katja Grace and others' recently published When Will AI Exceed Human Performance? Evidence from AI Experts (pdf) giving more recent information. But (a) that's about time and not about technical distance (would AGI look like what we have now) and (b) my main takeaway from the surveys is that people are giving pretty off-the-cuff answers without thinking very hard.)

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    The Limit of Circles in the Suburbs

    In dense urban cores, it’s valuable to run circular rail lines. They connect dense near-center neighborhoods to one another without going through the more congested center, and help make transferring between parallel lines more efficient, again through av…

    via Pedestrian Observations September 6, 2020

    Collections: Bread, How Did They Make It? Addendum: Rice!

    As an addendum on to our four-part look at the general structures of the farming of cereal grains (I, II, III, IV) this post is going to briefly discuss some of the key ways that the structures of rice farming differ from the structures of wheat and barle…

    via A Collection of Unmitigated Pedantry September 4, 2020

    Notes on “Anthropology of Childhood” by David Lancy

    I read David Lancy’s “The Anthropology of Childhood: Cherubs, Chattel, and Changelings” and highlighted some passages. A lot of passages, it turns out. [content note: discussion of abortion and infanticide, including infanticide of children with disabilit…

    via The whole sky August 27, 2020

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact