CRO test · Xero × Etsy partner page · Win

Rearranging modules by engagement lifted revenue +117.5%

Putting the highest-performing content at the top of the page, before visitors reach the form.

Type
A/B test
Regions
AU, UK, US, NZ
Duration
4 weeks, 7 day maturity
Outcome
Win, shipped to all regions
+117.5%7d CMR ($2.6K vs $1.2K), 99% chance to beat
+84%Account activations (7d), 100% chance to beat

Hypothesis

If the modules with the highest interaction and engagement rates sit at the top of the page, paying orgs and CMR will increase, because users are more likely to interact with and convert on the modules they see first.

What the data showed

Heatmap data showed users engaging with the hero and several sections further down, but with a clear drop-off before they reached the form. The form had the highest engagement on the page (50.6%), yet only a 3.46% click rate, so many users were not ready to convert by the time they got there. Sections such as "How to connect" and "Real-time finances" performed well on attractiveness and engagement but sat too far down to influence the decision.

The change

The variant kept every module but reordered them by engagement and attractiveness data to guide users through the page and toward conversion.

Default
[TODO: add default screenshot]
Variant · winner
[TODO: add variant screenshot]

Result & action

CMR 7d rose +117.5% (interval −20.8% to +255.9%) at a 99% chance to beat, with an annualised uplift range of $52.1K to $103.5K. The interval is wide, so the headline number should be read as direction plus a strong probability, not a promise. Changes were pushed to production across all regions.

← Back to work