Skip to content
Rich Tank5 Oct 262 min read

Incrementality before attribution: a practical marketing test plan

A practical guide to choosing an incrementality question, treatment, control, outcome and decision rule before trusting attributed conversions.

Quick answer

Attribution assigns credit within a measurement model; incrementality asks what additional outcome happened because of the activity. Start with one causal question, define an eligible population, create a credible treatment and control, measure the same downstream outcome in both groups and decide in advance how the result will change budget or execution.

Attributed conversions are useful for reporting journeys, but they do not automatically show what would have happened without the campaign. That distinction matters when teams use platform totals to justify marginal spend.

Incrementality is not a replacement for everyday reporting. It is a focused way to answer expensive questions about causal impact.

State one decision-sized question

Frame the study around a choice the business can actually make.

Examples include whether a channel creates additional qualified leads, whether a new campaign expands demand or captures existing demand, and whether a website treatment improves completion among eligible visitors.

Name the population, intervention, outcome and time window. Avoid questions so broad that different mechanisms and audiences become inseparable.

  • Who is eligible?
  • What changes for treatment?
  • What is withheld or unchanged for control?
  • Which outcome would alter the decision?

Separate attribution from causal lift

Do not compare numbers that answer different questions as if they were interchangeable.

Google describes Conversion Lift as the difference in conversions between groups exposed and not exposed to ads. Standard attributed conversions instead follow the conversion action's attribution settings and windows.

The two views can coexist. Attribution helps operate campaigns; lift evidence helps estimate whether activity produced additional outcomes. Differences are a reason to investigate, not to select whichever number is larger.

Protect the comparison

A useful control should differ from treatment mainly in the intervention being tested.

Watch for overlapping campaigns, audience contamination, uneven budgets, seasonality and operational changes during the test. Record them rather than explaining them away afterwards.

Google Ads experiments split traffic or budget between an original and trial campaign, but auction dynamics can still produce unequal exposure. Review actual delivery and eligibility before interpreting the result.

Make uncertainty visible in the decision

A test result is a range of plausible effects under assumptions, not a permanent truth.

Predefine the primary metric, guardrails, minimum useful effect and stopping approach. Avoid repeatedly checking and ending only when the preferred answer appears.

Document what the study cannot tell you, then apply the result at the same level as the test. A result for one audience or period does not automatically justify an account-wide rule.

Further reading

Sources

  1. About Conversion Lift — Google Ads Help
  2. Test with confidence with the Experiments page — Google Ads Help
  3. Monitor your experiments — Google Ads Help
avatar
Rich Tank
Rich Tank is a founder, consultant and product-minded marketer with experience across growth, CRM, digital strategy and user experience. He has spent his career helping businesses improve how they attract, convert and support customers online. He writes about digital experience, website journeys, marketing technology and the broader challenge of creating websites that are both effective and easy to use. Based in London, Rich is particularly interested in the intersection of user behaviour, conversion and product thinking.

RELATED ARTICLES