Incrementality Measurement

Why Attribution Is Not Enough

Incrementality measurement is defined as a testing methodology that isolates the causal impact of a marketing activity by comparing outcomes between exposed and unexposed audiences. Attribution tells you which channels were present in a conversion path. Incrementality tells you which channels actually caused the conversion. The difference matters enormously for budget decisions. Studies show that 50-80% of branded paid search conversions would have occurred organically (various Google/Bing studies, 2023-2024). Attribution gives that channel full credit. Incrementality reveals the true lift.

How Incrementality Testing Works

The basic design is a holdout test: show the campaign to a test group and withhold it from a control group. Compare conversion rates between the two groups. The difference is your incremental lift.

Component	Test Group	Control Group
Exposure	Sees the campaign/channel	Does not see the campaign/channel
Measurement	Conversions from exposed audience	Conversions from unexposed audience
Incremental lift	Test conversion rate minus control conversion rate

For example: if 4% of the test group converts and 2.5% of the control group converts, the incremental lift is 1.5 percentage points. That means 37.5% of the test group's conversions are genuinely incremental (1.5/4.0). The rest would have happened without the campaign.

This is simpler in concept than in execution. B2B SaaS faces three specific challenges: small audience sizes make statistical significance harder to achieve, long sales cycles mean you need to run tests for months, and account-based motions make clean holdout groups difficult to construct.

What Incrementality Testing Typically Reveals

The channels that receive the most attribution credit are rarely the channels with the highest incremental impact. Branded paid search is the most common example. It receives enormous attribution credit because it is often the last click before conversion. But incrementality tests consistently show that most of those clicks would have gone to organic search results. The actual lift is a fraction of what attribution reports.

Conversely, upper-funnel channels like content marketing, podcasts, and brand advertising often show higher incrementality than attribution suggests. They create demand that converts through other channels, receiving no attribution credit for the conversion they caused. This is why leading marketing organizations use incrementality as a complement to attribution, not a replacement.

Running Incrementality Tests in B2B

Design tests with at least 90 days of run time and audience sizes large enough for statistical confidence. A paid social holdout test needs thousands of accounts in each group to detect a meaningful lift in B2B, where conversion rates are often below 2%. Geographic holdouts (suppressing a campaign in specific regions) work well when audience sizes are too small for random individual holdouts.

Start with your highest-spend channels because that is where the largest budget savings live. If incrementality testing reveals that your $200K/month paid search campaign has only 30% incremental lift, you have found $140K of potential reallocation. Apply those savings to channels with higher incremental impact and measure the net effect on total pipeline velocity and revenue.

Building Incrementality into Your Measurement Stack

Layer incrementality on top of attribution to create a calibrated measurement system. Use attribution for tactical daily and weekly decisions. Use incrementality to calibrate attribution and validate channel-level budget allocation quarterly. Use marketing mix modeling for annual strategic planning. Together, these three methods triangulate the truth more effectively than any single approach.

The companies that do this well update their attribution model weights based on incrementality results. If testing shows that a channel's true incremental contribution is 40% of its attributed contribution, adjust the model. Over time, this calibration process makes your attribution data increasingly reliable for marketing spend optimization decisions.