Lift testing is a foundational methodology for marketers seeking to prove the true impact of their media investments. This article provides a comprehensive overview of how lift testing works, how WorkMagic supports it, and how you can successfully run and interpret lift tests using our platform.
1. Introduction to Lift Testing
What is a Lift Test?
A lift test is a controlled experiment that measures the incremental impact of your advertising. It works by comparing a Test group (exposed to ads) to a Control group (not exposed) and quantifying the difference in outcomes (e.g., orders, sales, new customers).
Why Lift Tests Matter in Marketing Analytics
Lift tests answer the question:
“What would have happened if we hadn’t run this channel/campaign?”
Unlike attribution models, lift tests isolate the causal effect of your advertising, helping you make smarter investment decisions based on actual performance rather than correlations.
Use Cases for Lift Testing
Lift testing is a powerful framework for answering a range of strategic marketing questions. Below are common use cases that WorkMagic can help you address:
Incrementality Determine whether your media spend is truly driving additional conversions that wouldn’t have occurred otherwise.
Halo Effect Measure the broader impact of a campaign across other sales channels apart from DTC—for example, how a TikTok campaign influences Amazon and offline store sales.
New Channel Launch Evaluate the effectiveness of introducing a new advertising platform to your media mix and its contribution to overall lift.
Media Mix Optimization Quantify the combined incrementality of channel mix, compare the incrementality of a channel mix or standalone channels (e.g. Google Pmax VS Meta + Google Pmax as a channel mix)
Optimal Spend Level (Coming soon) Identify the point at which additional spend begins to yield diminishing returns, helping you allocate budget more efficiently.
Promotions (Coming soon) Understand whether a promotion (e.g., limited-time offer, discount) is driving incremental lift or simply shifting existing demand.
2. How WorkMagic Supports Lift Testing
Overview of WorkMagic’s Lift Test Capabilities
WorkMagic is a managed experimentation platform that handles:
Test design and statistical modeling
Geo/audience segmentation / selection
Automatic Geo holdout implementation
Real-time monitoring
Final result analysis
Integration with Ad Platforms
WorkMagic supports automatic holdout setup and teardown via API for:
Meta Ads
Google Ads
TikTok Ads
Snapchat Ads ( Coming Soon)
For non-integrated platforms (e.g. AppLovin, MNTN, etc), we provide step-by-step instructions and DMA files to guide your team through manual setup.
Data Sources Used in Lift Testing
We ingest order and sales data at geo-level via:
Direct API integrations with ad platforms (e.g., Google Ads, Meta Ads, TikTok Ads)
First-party order data from your platform (e.g., Shopify)
Geo-level metrics for both Control and Test groups
3. How to Run a Lift Test on WorkMagic
Lift testing helps you evaluate the true effectiveness of your marketing efforts by measuring incrementality—the impact your ads had compared to a scenario where they were not shown. WorkMagic provides a step-by-step interface to configure and schedule a lift test.
Step 1 - Test Design
1. Choose the Test Type
You can run two types of lift tests on WorkMagic:
Test incrementality: Measure the additional value generated by your ads.
Launch new marketing channel: Evaluate the effect of introducing a new channel to your media mix.
2. Select the Primary Metric
Choose the key outcome you want to measure:
Orders
New customers
3. Select Test Country (Required) and Location Exclusion (Optional)
Currently, we support the US (Default), UK and Canada for Test Country
4. Select Test Channels
Available platforms and their holdout capabilities include:
Platform | Holdout Type |
Meta Ads | Automatic / Manual Holdout |
Google Ads | Automatic / Manual Holdout |
TikTok Ads | Automatic / Manual Holdout |
Snapchat Ads | Manual Holdout Only |
MNTN | Manual Holdout Only |
AppLovin | Manual Holdout Only |
Other Platform | Manual Holdout Only |
You can run 2-cell or 3-cell test. In each test cell/group, you can holdout multiple ad platforms (no limitations on the number).
Learn More about: All you need to know about WorkMagic 3-cell lift test
Step 2 - Test Level
Decide the level at which you want the test to run:
Platform level – Select ad accounts (all are pre-selected by default).
Tactic level – Select tactics. If you don’t have any, you’ll be prompted to create one.
Campaign level – Select campaigns (supports search campaign name, and “select all”).
❗ Note:
If your platform isn’t linked, you’ll see a prompt to connect (Only platforms with native integration).
For those platforms without native integration (Universal Ads, MNTN, Vibe, etc), you won't be able to select tactics or campaign level and you require to setup manually on the ad platform). You can either connect now or skip continuing with manual setup.
Step 3 - Review Geo-Pairing Recommendations
WorkMagic automatically recommends geo-pairs for your lift test. You’ll see two test methodologies:
Pause-to-Measure (PTM) – Ads run for most of your audience, but paused for a small holdout group. Best for campaigns with larger, established budgets.
Launch-to-Measure (LTM) – Ads only run for a small exposed group, while most of your audience remains as holdout. Best for new channels or smaller budgets.
Both methods measure incremental lift with the same confidence; the difference is how they split your audience and the budget required.
❗Note: We only support Manual Holdout for Launch to Measure (LTM) tests for now. You will need to manually implement the holdout on selected ad-platform.
For each geo pair, WorkMagic displays:
Holdout vs. exposed group size
Estimated test period
Estimated daily budget (marked Sufficient or Insufficient)
Click into a geo pair to see region details, alternative budget options, or set a custom test period (14–35 days).
Insufficient Ad Spend Alerts
Single Channel test:
❗Note: You may encounter a warning if your ad spend is insufficient to generate statistically significant results. In this case, you need to manually modify the daily budget on ad platform in order to get a statistically significant result, or contact the WorkMagic team.
Multi Channels test:
❗Note: For the multi-cell test, if one or more channels have insufficient daily spend, you will see the warning to increase daily spend for those specific channels
Channels Without Historical Cost Data
If your selected channel doesn’t have enough historical data, the recommended daily budget will show as Not available.
In this case, click Estimation Hypothesis and manually enter a Cost per Order value. WorkMagic will use that input to generate budget and test period estimates.
This ensures you can still run a lift test, even for new channels or ad types without past performance data.
Step 4 - Configure Setup Method
You can apply the holdout in two ways:
Automatic setup on WorkMagic - Recommended. (Unavailable if the platform only supports manual setup, isn’t connected, or if you selected launch-to-measure).
TikTok Ads: If using automatic setup, you’ll be guided to create and select audiences directly in TikTok Ads.
Manual setup on ad platform
Set up the holdout directly in your advertising platform if preferred.
Holdout API Limitations:
For Meta Ads:
WorkMagic will alert you if any ad creatives use deprecated sizes (e.g., 191x100), which may cause delivery issues during the holdout. You must correct these on Meta Ads before proceeding.
WorkMagic can't implement holdout to Advantage+ Shopping Campaign due to API limitation of Meta Ads.
For TikTok Ads:
WorkMagic can't implement holdout to Reach & Frequency Campaign due to API limitation of TikTok Ads.
Step 5 - Schedule the Test
Choose your start date and time, the testing and cooling period will be automatically selected.
Testing period (e.g., 21 days) -> you can customize this by clicking edit button. You can choose different test period and budget combinations from test estimator.
Cooling period (e.g., 7 days after testing ends) -> you can customize the cooling period by editing (duration must be between 1 and 7 days)
Step 6 - Review and Schedule
Before launching, confirm all details:
Test name.
Purpose and primary metric.
Selected test level and test budget.
Setup method.
Test dates and duration.
Once reviewed, click Schedule now to launch your lift test.
If you need further assistance at any step, please contact your WorkMagic data scientist or use the “Contact WorkMagic data scientist” link available in the interface.