Skip to main content

Lift Test 101

Updated over a week ago

Lift testing is a foundational methodology for marketers seeking to prove the true impact of their media investments. This article provides a comprehensive overview of how lift testing works, how WorkMagic supports it, and how you can successfully run and interpret lift tests using our platform.

1. Introduction to Lift Testing

What is a Lift Test?

A lift test is a controlled experiment that measures the incremental impact of your advertising. It works by comparing a Test group (exposed to ads) to a Control group (not exposed) and quantifying the difference in outcomes (e.g., orders, sales, new customers).

Why Lift Tests Matter in Marketing Analytics

Lift tests answer the question:

“What would have happened if we hadn’t run this channel/campaign?”

Unlike attribution models, lift tests isolate the causal effect of your advertising, helping you make smarter investment decisions based on actual performance rather than correlations.

Use Cases for Lift Testing

Lift testing is a powerful framework for answering a range of strategic marketing questions. Below are common use cases that WorkMagic can help you address:

  • Incrementality Determine whether your media spend is truly driving additional conversions that wouldn’t have occurred otherwise.

  • Halo Effect Measure the broader impact of a campaign across other sales channels apart from DTC—for example, how a TikTok campaign influences Amazon and offline store sales.

  • New Channel Launch Evaluate the effectiveness of introducing a new advertising platform to your media mix and its contribution to overall lift.

  • Media Mix Optimization Quantify the combined incrementality of channel mix, compare the incrementality of a channel mix or standalone channels (e.g. Google Pmax VS Meta + Google Pmax as a channel mix)

  • Optimal Spend Level (Coming soon) Identify the point at which additional spend begins to yield diminishing returns, helping you allocate budget more efficiently.

  • Promotions (Coming soon) Understand whether a promotion (e.g., limited-time offer, discount) is driving incremental lift or simply shifting existing demand.

2. How WorkMagic Supports Lift Testing

Overview of WorkMagic’s Lift Test Capabilities

WorkMagic is a managed experimentation platform that handles:

  • Test design and statistical modeling

  • Geo/audience segmentation / selection

  • Automatic Geo holdout implementation

  • Real-time monitoring

  • Final result analysis

Integration with Ad Platforms

WorkMagic supports automatic holdout setup and teardown via API for:

  • Meta Ads

  • Google Ads

  • TikTok Ads

  • Snapchat Ads ( Coming Soon)

For non-integrated platforms (e.g. AppLovin, MNTN, etc), we provide step-by-step instructions and DMA files to guide your team through manual setup.

Data Sources Used in Lift Testing

We ingest order and sales data at geo-level via:

  • Direct API integrations with ad platforms (e.g., Google Ads, Meta Ads, TikTok Ads)

  • First-party order data from your platform (e.g., Shopify)

  • Geo-level metrics for both Control and Test groups

3. How to Run a Lift Test on WorkMagic

Lift testing helps you evaluate the true effectiveness of your marketing efforts by measuring incrementality—the impact your ads had compared to a scenario where they were not shown. WorkMagic provides a step-by-step interface to configure and schedule a lift test.

Step 1 - Test Design

1. Choose the Test Type

You can run two types of lift tests on WorkMagic:

  • Test incrementality: Measure the additional value generated by your ads.

  • Launch new marketing channel: Evaluate the effect of introducing a new channel to your media mix.

2. Select the Primary Metric

Choose the key outcome you want to measure:

  • Orders

  • New customers

3. Select Test Country (Required) and Location Exclusion (Optional)

  • Currently, we support the US (Default), UK and Canada for Test Country

4. Select Test Channels

Available platforms and their holdout capabilities include:

Platform

Holdout Type

Meta Ads

Automatic / Manual Holdout

Google Ads

Automatic / Manual Holdout

TikTok Ads

Automatic / Manual Holdout

Snapchat Ads

Manual Holdout Only

MNTN

Manual Holdout Only

AppLovin

Manual Holdout Only

Other Platform

Manual Holdout Only

You can run 2-cell or 3-cell test. In each test cell/group, you can holdout multiple ad platforms (no limitations on the number).

Step 2 - Test Level

Decide the level at which you want the test to run:

  • Platform level – Select ad accounts (all are pre-selected by default).

  • Tactic level – Select tactics. If you don’t have any, you’ll be prompted to create one.

  • Campaign level – Select campaigns (supports search campaign name, and “select all”).

Note:

  • If your platform isn’t linked, you’ll see a prompt to connect (Only platforms with native integration).

  • For those platforms without native integration (Universal Ads, MNTN, Vibe, etc), you won't be able to select tactics or campaign level and you require to setup manually on the ad platform). You can either connect now or skip continuing with manual setup.

Step 3 - Review Geo-Pairing Recommendations

WorkMagic automatically recommends geo-pairs for your lift test. You’ll see two test methodologies:

  • Pause-to-Measure (PTM) – Ads run for most of your audience, but paused for a small holdout group. Best for campaigns with larger, established budgets.

  • Launch-to-Measure (LTM) – Ads only run for a small exposed group, while most of your audience remains as holdout. Best for new channels or smaller budgets.

Both methods measure incremental lift with the same confidence; the difference is how they split your audience and the budget required.

Note: We only support Manual Holdout for Launch to Measure (LTM) tests for now. You will need to manually implement the holdout on selected ad-platform.

For each geo pair, WorkMagic displays:

  • Holdout vs. exposed group size

  • Estimated test period

  • Estimated daily budget (marked Sufficient or Insufficient)

Click into a geo pair to see region details, alternative budget options, or set a custom test period (14–35 days).

Insufficient Ad Spend Alerts

  • Single Channel test:

Note: You may encounter a warning if your ad spend is insufficient to generate statistically significant results. In this case, you need to manually modify the daily budget on ad platform in order to get a statistically significant result, or contact the WorkMagic team.

  • Multi Channels test:

Note: For the multi-cell test, if one or more channels have insufficient daily spend, you will see the warning to increase daily spend for those specific channels

Channels Without Historical Cost Data

If your selected channel doesn’t have enough historical data, the recommended daily budget will show as Not available.

In this case, click Estimation Hypothesis and manually enter a Cost per Order value. WorkMagic will use that input to generate budget and test period estimates.

This ensures you can still run a lift test, even for new channels or ad types without past performance data.

Step 4 - Configure Setup Method

You can apply the holdout in two ways:

  • Automatic setup on WorkMagic - Recommended. (Unavailable if the platform only supports manual setup, isn’t connected, or if you selected launch-to-measure).

TikTok Ads: If using automatic setup, you’ll be guided to create and select audiences directly in TikTok Ads.

  • Manual setup on ad platform

    • Set up the holdout directly in your advertising platform if preferred.

  • If you choose Tactic level or Campaign level, you can export the campaign list for manual setup

Holdout API Limitations:

For Meta Ads:

  • WorkMagic will alert you if any ad creatives use deprecated sizes (e.g., 191x100), which may cause delivery issues during the holdout. You must correct these on Meta Ads before proceeding.

  • WorkMagic can't implement holdout to Advantage+ Shopping Campaign due to API limitation of Meta Ads.

For TikTok Ads:

  • WorkMagic can't implement holdout to Reach & Frequency Campaign due to API limitation of TikTok Ads.

Step 5 - Schedule the Test

Choose your start date and time, the testing and cooling period will be automatically selected.

  • Testing period (e.g., 21 days) -> you can customize this by clicking edit button. You can choose different test period and budget combinations from test estimator.

  • Cooling period (e.g., 7 days after testing ends) -> you can customize the cooling period by editing (duration must be between 1 and 7 days)

Step 6 - Review and Schedule

Before launching, confirm all details:

  • Test name.

  • Purpose and primary metric.

  • Selected test level and test budget.

  • Setup method.

  • Test dates and duration.

Once reviewed, click Schedule now to launch your lift test.

If you need further assistance at any step, please contact your WorkMagic data scientist or use the “Contact WorkMagic data scientist” link available in the interface.

Did this answer your question?