Computers and Prejudice

April 6th, 2010
ism, nlp
Consider the following fake snippet of news reporting:

Sarah Jones reporting for News Station X. The CEO of Big Powerful Company announced today that BPC was on track to meet its earnings targets for the quarter. She went on to attribute the continuing success of BPC to the quality of its employees.

Imagine I were to tell you that I interpreted the "she" as being a reference back to "sarah jones" instead of "the ceo of big powerful company". What if I say that this is because I think of "ceo" as a male-gendered word, so I interpret the "she" as being more likely to refer to "sarah jones". You'd say I was being sexist, no? The assumption that a ceo is male is a sexist assumption. I'd agree with you.

Now imagine I am working on a computer program that is supposed to learn how to connect pronouns (and other words) back to their antecedents. (I am, in fact, working on such a program) Imagine it learns, from lots and lots of data, that ceos are much more likely to be male than female. So it makes the mistake I described above, identifying "she" as the reporter instead of the ceo. Is the program being sexist? Were the programmers sexist in desigining the program with the capacity to learn the gender of words? Is there sexism here, aside from that which results in there being more male ceos than female?

Comment via: facebook, substack

Recent posts on blogs I like:

Food Fridays: Blueberry Cobbler

Here is my blueberry cobber recipe, by request of William Friedman.

via Thing of Things January 16, 2026

Why I Don't Think My Braces Were Worth It

A couple weeks ago, I got my braces off. I kind of wish I had never had them, though. When I was younger, two of my teeth were sticking out, and they looked kind of funny. I thought that my teeth were just fine, and I didn't want to get braces. But s…

via Anna Wise's Blog Posts January 3, 2026

Family Christmas

Unlike many families my family celebrates Christmas with really really a lot of our family. This past year there were about 29 people at my Grandfather's house in the week around Christmas. I know what you're thinking: how does that work? It's…

via Lily Wise's Blog Posts January 3, 2026

more     (via openring)