Comments on: 1,2,3 – It’s As Easy As A/B/C Testing

By: Billy

Billy — Mon, 24 Nov 2008 21:37:43 +0000

Hmm, seems a lot easier to track A/B testing with paid search than SEO because the new versions of the page/category templates need to get reindexed before the search engines decide on providing you with additional natural traffic or turning off the faucet on you.

By: SlightlyShadySEO

SlightlyShadySEO — Sat, 16 Feb 2008 15:27:01 +0000

You around Gab? I got a question or two for ya about *the project*, and you havent been around lately…

By: Gabriel Goldenberg

Gabriel Goldenberg — Wed, 13 Feb 2008 17:13:35 +0000

Brian, thanks for sharing that. I honestly had no idea that that was the case. I guess the idea is that you want to leverage your greater traffic to run more tests in a shorter period of time? I’d love to see that tool anyways.

Hannah, that’s a fascinating point. I thought it was always run with a single version of the ad! I guess it would offer different coupons, for example, to test the response?

And no, no worries about showing your age.

In any case, both have you earned yourselves a couple of links; I’ll update the post a little later today when I get a minute.

By: Hannah

Hannah — Wed, 13 Feb 2008 16:53:41 +0000

Nice post – I think it’s really important to explain the jargon – particularly for clients.

Did you know that A /B testing orginated in good old fashioned print advertising? Half of the print run of publication contains with one variant of the ad, and the other half of the print run contains the other variant.

I’m in danger of showing my age, no?

By: Brian Chappell

Brian Chappell — Wed, 13 Feb 2008 04:55:15 +0000

From my understanding, you want to use a/b testing when your site does not get much traffic, and vice versa for multivariate testing. I found a great multivariate analysis excel tool to help you calculate when you have enough statistical evidence to equate one sample is the clear winner. Email me if you want me to send it to you. Don’t think I am allowed to post the link.

By: Gabriel Goldenberg

Gabriel Goldenberg — Tue, 12 Feb 2008 03:51:01 +0000

My pleasure Tim! That’s a big compliment too, so thanks a bunch!

By: Local Hound

Local Hound — Tue, 12 Feb 2008 03:11:11 +0000

I was just reading a “For Dummies Book” about this stuff and this post was clearer. Thank you I got it. I had it backwards before.