• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • The Trouble With Charity Navigator

    May 29th, 2012
    giving, metacharities  [html]
    When I ask someone how they know if a charity's any good, they often bring up Charity Navigator. It's not the only site out there evaluating charities, but it's the only one people seem to have heard of. From the perspective of improving the process where people figure out where to give to, trying to help people do as much good as possible, it's potentially an excellent resource. Unfortunately, it doesn't rate charities on the thing that actually matters: what does your money do?

    Charity Navigator's financial-only rating system took simple inputs relying on data from charities' publicly available IRS Form 990s. This allowed them to quickly become very comprehensive, with review pages for charities up as fast as they could get the forms into their system. This won them the number one spot in our heads for "charity evaluator" but at a big cost: they had to claim their reviews based on the small amount of financial information that US charities are required to disclose were sufficient, and they set a standard of having reccomendations on most US charities.

    They've expanded their rating system to include other information from the form 990 data as well as a quick review of the charity's website, which they call accountability and transparency [1], and they have plans to start evaluating charities based on their results, where "the results dimension will count for the largest portion of the total rating score once it goes live". [2]

    The problem is that a real review of a charity is a lot of work. You need to spend a lot of time talking to them to gather data, evaluating it, going back for missing pieces, and presenting your findings in a clear manner where they can be widely understood. This is hard. There's no way that Charity Navigator can do this level of evaluation across the board unless either they become enormous or charities become convinced to post high quality data publicly with little prompting. And most charities don't even have this data, so do you just rate them badly? [3]

    Charity Navigator is in a tight spot, where their brand is based on being big and comprehensive but doing charity evaluation right is too resource intensive for this scale. I don't know how to fix this, but it has to include more than just evaluating form 990s and quick looks over websites.


    [1] I think it's great that they publish their process details publicly.

    [2] I wrote to them asking about the status of results evaluation, but they didn't get back to me.

    [3] GiveWell used to give "0 stars" to charities that couldn't demonstrate high levels of impact with good evidence. In some ways this made sense: if you don't know how well what you're doing is working, you're probably not doing very well. But mostly it annoyed charities to little gain, so now they just list charities they looked at but that don't meet their standards under "all charities considered".

    Comment via: google plus, facebook, r/smartgiving

    Recent posts on blogs I like:

    It's ok to feed stray cats

    Before we had kids, Jeff and I fostered a couple of cats. One had feline AIDS and was very skinny. Despite our frugal grocery budget of the time, I put olive oil on her food, determined to get her healthier. I knew that stray cats were not a top global pr…

    via Giving Gladly May 15, 2021

    Collections: Teaching Paradox, Europa Universalis IV, Part III: Europa Provincalis

    This is the third part of our series (I, II) examining the historical assumptions of Paradox Interactive’s grand strategy computer game set in the early modern period, Europa Universalis IV (which is in turn the start of a yet larger series looking at sev…

    via A Collection of Unmitigated Pedantry May 14, 2021

    Randal O’Toole Gets High-Speed Rail Wrong

    Now that there’s decent chance of US investment in rail, Randal O’Toole is resurrecting his takes from the early Obama era, warning that high-speed rail is a multi-trillion dollar money sink. It’s not a good analysis, and in particular it gets the reality…

    via Pedestrian Observations May 12, 2021

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact