• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • Technical Distance to AGI

    July 11th, 2017
    airisk, giving  [html]
    I think the largest piece of the disagreement between ML people over how to prioritize AI risk may turn out to be: how likely is it that we get AGI soon that looks a lot like systems we have now?

    Specifically, here are two things I'd guess most of the people I've talked to would agree with (though I haven't run this by any of them):

    • If there were a 10% chance of current systems getting us to AGI within the next 10 years, then the kind of questions posed in Concrete Problems in AI Safety (pdf) would be very important from a safety perspective.

    • If the chance were less than 1%, then while those are still interesting research questions that look useful for today, they're not altruistically important.

    What I'm planning to do next is write back to all of the people I've been talking to in order to find out:

    • Does this actually capture their views?
    • What do they put the chance at, and why?

    Before I reach out to people again, though, I wanted to post this here for feedback. Any thoughts?

    (This is a lot like the more general question of AI timelines. For that, Open Phil's What Do We Know about AI Timelines? gives a good overview and summary, with Katja Grace and others' recently published When Will AI Exceed Human Performance? Evidence from AI Experts (pdf) giving more recent information. But (a) that's about time and not about technical distance (would AGI look like what we have now) and (b) my main takeaway from the surveys is that people are giving pretty off-the-cuff answers without thinking very hard.)

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    More on the Deutschlandtakt

    The Deutschlandtakt plans are out now. They cover investment through 2040, but even beforehand, there’s a plan for something like a national integrated timetable by 2030, with trains connecting the major cities every 30 minutes rather than hourly. But the…

    via Pedestrian Observations July 1, 2020

    How do cars fare in crash tests they're not specifically optimized for?

    Any time you have a benchmark that gets taken seriously, some people will start gaming the benchmark. Some famous examples in computing are the CPU benchmark specfp and video game benchmarks. With specfp, Sun managed to increase its score on 179.art (a su…

    via Posts on Dan Luu June 30, 2020

    Quick note on the name of this blog

    When I was 21 a friend introduced me to a volume of poems by the 14th-century Persian poet Hafiz, translated by Daniel Ladinsky. I loved them, and eventually named this blog for one of my favorite ones. At some point I read more and found that Ladinsky’s …

    via The whole sky June 21, 2020

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact