Contribe Help Center

What is a split test?

How we measure the value Contribe creates for your store

To quantify the value Contribe provides, we run a split test (also called A/B testing). During the test period, everyone who visits your website is shown one of two versions of it: one with no change at all, and one that includes the opportunity to contribute to a good cause through Contribe's solution.

Throughout the test, we measure two things:

  • Cart conversion rate — the percentage of customers who put a product in their cart and go on to actually order it.
  • Average order size — measured across the whole website, for everyone in the test.

Traffic is split, not chosen

Each visitor is randomly assigned to one of the two versions the moment they land on your site — nobody picks a side, and no visitor sees both. Because the split is random and the two groups are large enough, any difference we see afterwards can be attributed to the change itself, not to chance or to who happened to show up that day.

Visitors CHECKOUT · 199 KR Original 19.8% Cart Conversion Rate CHECKOUT · 199 KR 22.4% Cart Conversion Rate ↻ Click to replay ⇥ Click to finish

Turning the results into a value

After the test period ends, we compare the two groups and calculate the value the solution created. The difference in cart conversion rate between the two groups, multiplied by the average order size across the whole test, gives us the test results value — how much extra revenue the Contribe variant generated.

( 19.8% – 22.4% ) × = Conversion rate difference across the two groups Average order size for all during the period Test results value

From that value, we subtract Contribe's fee and the amount donated to the cause, leaving the net value that goes back to you.

Test results value – Contribe – Donation = Net value to you