The hypothesis can be formulated using the framework:
Posted: Wed Jan 22, 2025 10:30 am
IF the subscription pop-up with information about the discount will appear immediately as soon as the user enters the site,
THEN users will subscribe more often and place an order immediately,
BECAUSE the message about the discount will encourage them not only to sign up for the newsletter, but also to make a purchase.
The last part of the hypothesis may contain guesses - this is normal. The experiment is conducted to confirm or disprove them.
There may be so many hypotheses that it will not be possible to test them all with one test. korea email list Therefore, we recommend reading our article on how to prioritize product research hypotheses .
Step 2: Define Metrics
An A/B test metric is an indicator used to evaluate whether a hypothesis has been confirmed or not. In the example above, where we formulated the hypothesis, the metrics for testing it will be conversion rates to target actions — subscription and order placement.
THEN users will subscribe more often and place an order immediately,
BECAUSE the message about the discount will encourage them not only to sign up for the newsletter, but also to make a purchase.
The last part of the hypothesis may contain guesses - this is normal. The experiment is conducted to confirm or disprove them.
There may be so many hypotheses that it will not be possible to test them all with one test. korea email list Therefore, we recommend reading our article on how to prioritize product research hypotheses .
Step 2: Define Metrics
An A/B test metric is an indicator used to evaluate whether a hypothesis has been confirmed or not. In the example above, where we formulated the hypothesis, the metrics for testing it will be conversion rates to target actions — subscription and order placement.