RCT of ads for BIDA

December 15th, 2012
bida, contra, experiment
It's really hard to know what works with advertising for contra dances. We put out ads via many channels (plus there's lots of people talking to each other and bringing friends) and then some number of people show up. For example we have ads that show up when people search for stuff related to contra dancing in the boston area, paying per click. Are those clicks worth it? Do people show up?

For a while I've written off our advertising as too hard to test, but now I'm not sure. If we were to randomly run ads before some dances and not before others, we could see how this matched to our attendance. The signal is pretty noisy, though. I wonder how long we would need to run the test to tell?

Since May 2011 (1.5 years) we've had 353 clicks, or about 10 clicks per dance. Our average attendance is about 100 people. I don't know enough stats to say how long we would have to run a test (at two dances (trials) a month) to find whether there's an effect and if so whether it's large enough to be worth it.

Comment via: google plus, facebook, substack

Recent posts on blogs I like:

Male Sexuality

Testosterone-driven sexuality is different from estrogen-driven sexuality.

via Thing of Things August 8, 2025

The anti-fragile culture

I wrote a post about organizational culture!.

via Home August 6, 2025

Retrospective on life tracking and effectiveness systems

I’ve been doing life tracking for around 10 years, and this post is looking back at some things I learned from the data (since my previous retrospective in 2017). Highlights include what I get out of the Oura ring, correlations between sleep and deep work…

via Victoria Krakovna July 4, 2025

more     (via openring)