• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • Superintelligence Risk Project

    July 3rd, 2017
    airisk, giving  [html]
    I've decided to make a larger project out of looking into AI risk. I don't think we really know why there's such a disconnect between people who think we should strongly prioritize it and the mainstream ML perspective that it's not useful to work on (at least not currently). I've applied for an EA grant, and am thinking I'll spend about a month on this.

    Here's where I currently am:

    • I've read nearly all of the reading people suggested (by number of words) or about two thirds of it (by individual pieces). This is mostly an effect of Superintelligence being very long.

    • I've had conversations with one person in each camp, have a few more scheduled, and am working on lining up more.

    Here are some very preliminary thoughts on where I think the disagreement might be:

    • How likely is it that current approaches are all we need for AGI, with relatively straightforward extensions and a lot of scaling?

    • How valuable is it to work on solving problems that are probably not the right ones? For example, even if we think AGI will not look like current systems, might trying to solve the control problem for current systems teach us enough about the underlying problem and how to do this kind of work that we'll be in a better position once we see more what AGI will actually look like?

    • How useful is it to have a strong theoretical foundation, vs just understanding the technology enough from an engineering perspective that we can make it do things for us?

    • How similar is this to normal engineering? How much should we expect companies' desires that their AI systems do what they want them to do to work out?

    • As we get closer to AGI, how likely is the ML community to take superintelligence risk seriously? Is it just that they don't think it can be productively worked on now or do they not think it will ever be a real problem?

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    Collections: The Queen’s Latin or Who Were the Romans, Part V: Saving And Losing an Empire

    This is the fifth and final part (I, II, III, IV) of our series asking the question ‘Who were the Romans?’ How did they understand themselves as a people and the idea of ‘Roman’ as an identity? Was this a homogeneous, ethnically defined group, as some ver…

    via A Collection of Unmitigated Pedantry July 30, 2021

    Modernizing Rail 2021 Announcement

    We are happy to announce that on Sunday the 29th of August we will hold this year’s Modernizing Rail conference, on the heels of the success last year. Please register using this form. And please give details on what you’d like to see, and if you’re willi…

    via Pedestrian Observations July 29, 2021

    Songs about terrible relationships

    [Spoilers for several old musicals.] TV Tropes lists dozens of examples of the “I want” song (where the hero of a musical sings about their dream of escaping their small surroundings). After watching a bunch of musicals on maternity leave, I’m wondering h…

    via The whole sky July 17, 2021

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact