Are Paid Ads Creating New Customers or Taking Credit for Sales That Would Happen Anyway?

Advertising platforms can report purchases, leads, and revenue after someone interacts with an advertisement. These reports are useful, but they do not always prove that the advertisement caused the conversion.

Some customers may already know the business, regularly purchase its products, or be ready to convert through another channel. Advertising might influence the timing of the decision without creating a completely new sale.

Advertising incrementality testing helps businesses estimate how many conversions occurred because of their campaigns and how many might have happened without paid media. This distinction can lead to more reliable budget and campaign-scaling decisions.

What Is Advertising Incrementality Testing?

Advertising incrementality testing measures the additional results caused by advertising.

It attempts to answer a simple question:

What happened because the advertisements were shown that would not have happened otherwise?

Suppose a platform reports 1,000 purchases from a campaign. If 300 of those customers would have purchased without seeing the advertisements, the campaign’s incremental contribution may be closer to 700 purchases.

This does not mean the platform report is necessarily incorrect. The platform may accurately show that those customers interacted with the campaign. Incrementality testing asks a different question about causation.

Strong performance marketing should consider both attributed conversions and the additional business value created by advertising.

Why Can Attribution Overstate Campaign Impact?

Attribution assigns credit for a conversion to one or more marketing interactions.

A customer may discover a company through organic search, subscribe to its emails, read several reviews, see a retargeting advertisement, and then purchase. The advertising platform may claim the purchase because the customer clicked or viewed the ad before converting.

The campaign participated in the journey, but it may not have been the original or decisive cause.

Attribution can overstate performance when advertisements frequently reach:

·        Existing customers

·        Previous website visitors

·        Email subscribers

·        People searching for the brand

·        Customers already planning to purchase

·        Users exposed to several marketing channels

A paid advertising expert should examine how ads influence the broader customer journey instead of relying on one attribution report.

What Is the Difference Between Attribution and Incrementality?

Attribution asks:

Which interaction should receive credit for the conversion?

Incrementality asks:

Would the conversion have happened without the advertising?

Both questions are useful, but they serve different purposes.

Attribution helps businesses understand how customers interact with marketing channels. Incrementality helps determine whether advertising generated additional demand or simply received credit for demand that already existed.

A campaign may show a strong attributed return while producing a smaller incremental effect. Another campaign may receive limited platform credit but influence customers earlier in the buying journey.

How Does an Incrementality Test Work?

A basic incrementality test compares two similar groups.

The test group receives the advertising treatment, while the control group does not. The business then compares conversion behavior between them.

For example:

·        Test group conversion rate: 6%

·        Control group conversion rate: 4%

·        Estimated incremental lift: 2 percentage points

The difference suggests that advertising generated additional conversions beyond the level that occurred naturally.

The groups should be as similar as possible. If one group contains more loyal customers, higher-income buyers, or stronger markets, the comparison may be misleading.

What Can Be Used as a Control Group?

The appropriate control depends on the platform, audience, geography, and available data.

Possible methods include:

Audience Holdout

A portion of an eligible audience is deliberately prevented from seeing the campaign. Its behavior is compared with the exposed group.

Geographic Testing

Advertising runs in selected locations while comparable locations receive reduced or no advertising.

Time-Based Testing

A campaign is paused or reduced during a defined period, and business results are compared with an appropriate baseline.

Platform Experiments

Some advertising systems provide built-in testing methods that divide audiences into treatment and control groups.

Each approach has limitations. Seasonality, competitor activity, promotions, and unrelated business changes can influence the outcome.

Which Campaigns Are Most Likely to Receive Excess Credit?

Retargeting and branded search campaigns often reach people who already know the business.

These campaigns can still be valuable. Retargeting may answer an objection, remind a customer about an unfinished purchase, or make the next step easier. Branded search can help customers find the correct page and protect the search experience.

However, some of these customers may have converted without the advertisement.

The issue is not whether these campaigns should exist. The issue is whether their reported conversions should be treated as completely new business.

Reliable conversion tracking provides the foundation, while incrementality testing adds context about what the tracked conversions actually represent.

Why Does Incrementality Matter for Budget Allocation?

If a business allocates budget only according to attributed return, it may invest heavily in campaigns that capture existing demand while underfunding campaigns that create new demand.

For example, a retargeting campaign may report a very high return because it reaches recent website visitors. A prospecting campaign may report a lower immediate return because it introduces the company to new customers.

The prospecting campaign could still be more important for long-term growth.

Incrementality testing helps businesses compare the additional value generated by:

·        Prospecting campaigns

·        Retargeting

·        Branded search

·        Promotional advertising

·        Customer retention campaigns

·        Different platforms

·        Different geographic markets

Budget can then be allocated according to genuine business contribution rather than platform credit alone.

Can Incrementality Be Measured for Lead Generation?

Yes, but lead-generation businesses should measure more than form submissions.

An advertisement may increase lead volume without increasing qualified opportunities or customers. The test should follow leads through the sales process.

Useful outcomes include:

·        Qualified leads

·        Booked appointments

·        Attended appointments

·        Sales opportunities

·        Closed customers

·        Revenue

·        Profit

A campaign generating incremental form submissions but no additional customers may not be creating meaningful value.

Relevant campaign case studies can demonstrate how advertising activity connects with lead quality, sales performance, and customer acquisition.

How Much Data Does an Incrementality Test Need?

A test needs enough observations and conversions to separate real effects from random variation.

Small businesses may struggle to create large control groups because removing part of the audience from advertising reduces available reach. Low conversion volume can also make results unstable.

Businesses with limited data can begin with:

·        Larger geographic groups

·        Longer testing periods

·        One clearly defined conversion

·        Fewer simultaneous campaign changes

·        Consistent offers and pricing

·        Careful comparison with historical patterns

The test should not be stopped as soon as one group appears stronger. Short-term variation can create a false conclusion.

What Can Make an Incrementality Test Misleading?

Several factors can affect test quality:

·        Unequal audience groups

·        Changes in pricing or promotions

·        Seasonal demand

·        Competitor activity

·        Website changes

·        Tracking failures

·        Different inventory levels

·        Sales-team capacity

·        Customers moving between test locations

·        Other marketing campaigns launched during the test

The business should document any events that may influence results.

A test does not need to be perfect to provide value, but its limitations should be understood before changing a large budget.

How Should Incrementality Results Be Reported?

The report should clearly separate observed results from interpretation.

It may include:

·        Test and control group sizes

·        Advertising spend

·        Conversion rates

·        Incremental lift

·        Incremental conversions

·        Cost per incremental conversion

·        Revenue from incremental customers

·        Important test limitations

Historical results and reviews can provide additional context, but comparisons should use similar offers, markets, and measurement periods.

Businesses should avoid presenting incremental estimates as exact facts. The result is usually a range based on the quality and scale of the test.

How Can Creative Affect Incremental Growth?

Creative designed only for people already familiar with the company may capture demand without expanding it.

Incremental growth often requires messages that help new audiences understand:

·        The problem

·        Why the problem matters

·        Available solutions

·        The brand’s point of difference

·        Evidence supporting the offer

·        The appropriate next step

A full-funnel marketing approach can combine demand creation, consideration, and conversion instead of expecting every advertisement to produce an immediate sale.

Creative should be evaluated by its role in the customer journey, not only its last-click results.

Final Thoughts

Advertising reports show which campaigns were associated with conversions, but association does not always prove that advertising created those results.

Advertising incrementality testing compares exposed and unexposed groups to estimate how many additional customers, leads, or sales were genuinely caused by paid media.

This information helps businesses evaluate retargeting, prospecting, branded search, and other campaigns more realistically. It also supports better budget allocation by distinguishing between capturing existing demand and creating new growth.

Frequently Asked Questions

1. Is incrementality testing the same as A/B testing?

No. A/B testing compares two variations, while incrementality testing compares advertising exposure with a control group that does not receive the treatment.

2. Can small businesses run incrementality tests?

Yes, but they may require longer testing periods or simpler geographic and time-based methods because conversion volume is limited.

3. Does a non-incremental campaign have no value?

Not necessarily. It may support customer experience or protect existing demand, but its contribution should not be mistaken for entirely new growth.

4. Which metric is most useful in an incrementality test?

Cost per incremental customer or conversion is particularly useful because it measures additional results rather than attributed results alone.

5. How often should incrementality be tested?

Testing may be useful after major budget changes, new platform investments, campaign restructuring, or when attributed results appear unusually strong.