RCT of ads for BIDA

December 15th, 2012
bida, contra, experiment
It's really hard to know what works with advertising for contra dances. We put out ads via many channels (plus there's lots of people talking to each other and bringing friends) and then some number of people show up. For example we have ads that show up when people search for stuff related to contra dancing in the boston area, paying per click. Are those clicks worth it? Do people show up?

For a while I've written off our advertising as too hard to test, but now I'm not sure. If we were to randomly run ads before some dances and not before others, we could see how this matched to our attendance. The signal is pretty noisy, though. I wonder how long we would need to run the test to tell?

Since May 2011 (1.5 years) we've had 353 clicks, or about 10 clicks per dance. Our average attendance is about 100 people. I don't know enough stats to say how long we would have to run a test (at two dances (trials) a month) to find whether there's an effect and if so whether it's large enough to be worth it.

Comment via: google plus, facebook, substack

Recent posts on blogs I like:

Living in the AI world

I. I know lots of people who believe that superintelligent AI is going to be invented maybe next year, maybe by 2030, and that when the superintelligent AI comes maybe everyone is going to die.

via Thing of Things November 18, 2026

I did a meditation and it sort of changed my personality?!

a trip report

via benkuhn.net November 8, 2026

Test/verification technique effectiveness with Astra

When we looked at how well agents used test/verification techniques in August1, we saw that GPT-5.6 Sol generally did what you might call a caricature of various techniques when asked to use a technique or library such as TDD, QuickCheck, Lean 4, etc.; no…

via Posts on November 2, 2026

more     (via openring)