Membership Inventory Panel A/B Test

We ran an AB test to understand if adding an inventory panel similar to the one for physical products, would increase member area creation for eligible website users

Test Information:

  • Split: 2 way: 50/ 50 assignment between treatment and control to be triggered at the view to the commerce dashboard

  • Note exactly what happened on the eventing side given we followed defaulted to Praetor’s Assignment. More on what happened linked here: MIP Eventing Learnings

  • Start Date: 9/22/2022

  • End Date: 10/07/2022

    ○ Additional days added to ensure full 14 days of data.

    ○ Analytics will default to 9/23/2022 - 10/07/2022

Key Metrics:

  • Primary: 1-Day View Commerce Dashboard > View Creation Modal

  • Secondary:

    • % First Time Member Area Creators / Viewers of Commerce Dashboard (7 Day & 14 Day window)

    • View Commerce Dashboard > Create New Member Area (7-Day, 14-Day window)


AB Test Results Deck

Test Plan & Design

Previous
Previous

Member Areas Churn Readout

Next
Next

Tidal Search Relevancy