Skip to main content

How to setup lift test on MNTN (Manual Holdout only)

Updated over 2 months ago

This guide walks you through setting up a geo-based incrementality lift test for MNTN using the WorkMagic platform and manually configuring exclusions on MNTN.

Step 1: Create a New Lift Test in WorkMagic

Navigate to the Lift Test in the WorkMagic platform.

  • Select "Create new lift test".

  • Choose your primary metric (e.g. Orders or New Customers).

  • Under Test channel, select MNTN.

  • You’ll be notified that MNTN only supports manual holdout setup.

  • Click Continue.

Step 2: Select a Geo Pairing

  • Choose a recommended Geo-Pairing of control vs. test DMAs.

  • You will see projected percentages of total orders and sales per group.

  • Select one pairing that best matches your campaign scale or performance distribution.

  • Click Continue.

Note: Because MNTN only supports manual holdouts, historical ad data via API is not accessible to recommend geo-pairing, which has the highest chance to yield statistically significant results.

Step 3: Manual Holdout Setup Instructions

WorkMagic will display specific instructions for setting up the holdout on MNTN:

  1. Go to each MNTN campaign included in the test.

  2. In the Audience setup, click Edit to adjust targeting.

  3. Under the Location tab:

  4. Search for the Control DMAs selected in Step 2.

  5. Select each and click Excl (Exclude).

  6. Ensure each is set to type = DMA.

  7. Save the audience and exit editing.

  8. Go back to WorkMagic interface and click Finish and continue.

Step 4: Define Your Test Schedule

  1. Set the start and end dates of your lift test.

  2. Testing period and Cooling period is automatically defined.

  3. Click Continue.

Step 5: Review and Finalize

  1. The Test Name is automatically defined (e.g., 20250416 – MNTN – 9% Shopify Orders), you can edit the name if needed.

  2. Review all configurations:

    1. Purpose

    2. Primary Metric

    3. Geo Pairing

    4. Holdout setup reminder

    5. Scheduling

  3. If all looks correct, click Schedule now.

Did this answer your question?