Skip to content
  • By Unknown author
  • /

Attribution Capture vs Incrementality: What Each Can Prove

Understand the difference between recorded acquisition context, attribution credit and incremental impact, with a worked example and experiment-readiness checks.

Attribution capture records available acquisition context. An attribution model assigns credit under a rule. Incrementality measurement estimates the additional outcomes caused by an intervention relative to a counterfactual. These answer different questions: a source attached to a sale does not show whether the sale would have happened without that marketing activity.

Summary: Use capture to preserve evidence, attribution rules to organize credit and a suitable causal design to estimate additional impact. Good tracking supports measurement but does not create a control group. Before making budget claims, define the outcome, comparison, uncertainty and conditions under which the result can be interpreted.

FunnelSheet publishes ClickTrail. This article explains measurement concepts and uses clearly hypothetical examples. It does not report an experiment, a customer lift result or an independently tested comparison between vendors.

What does source capture establish?

Capture can establish that a record contains an observed signal under a particular implementation. For example, a form entry may preserve the source associated with a visitor’s retained arrival context. That is useful for operational tracing, but it is not a complete history of every influence on the buyer.

ClickTrail’s WordPress documentation explicitly separates campaign-context capture from proving which click caused a sale. Missing signals remain a limitation. A populated field is evidence about the capture path, not automatic evidence of causal impact.

What does an attribution model add?

An attribution rule determines how recorded outcomes are associated with recorded touches. First-touch and last-touch reports can assign the same sale differently because their rules answer different descriptive questions. Neither assignment alone creates an estimate of what would have happened without the campaign.

Suppose a hypothetical customer discovers a business through organic search, returns through an advertisement and purchases. A first-touch report and a last-touch report may emphasize different sources. Both can be internally consistent while leaving the causal question unanswered.

The disagreement is not automatically a collection bug. Diagnose whether the reports use the same eligible records, time windows, outcome definitions and credit rules before trying to make totals match.

What does incrementality measurement require?

Incrementality requires a defensible comparison with what would have happened without the intervention. A randomized treatment and control design is one possible approach. Other designs require their own assumptions and validation; a simple before-and-after revenue comparison cannot rule out seasonality or other simultaneous changes.

AppsFlyer offers an Incrementality product. Its existence should not be confused with a guarantee that any campaign or account is immediately suitable for an informative experiment. Evaluate design, data requirements and interpretation for the actual intervention.

How can attributed and incremental outcomes differ?

Consider a simplified hypothetical randomized experiment with equal eligible populations and the same observation window. The treatment group records 120 conversions and the control group records 100. The difference is 20 conversions, while relative lift against the control result is 20%.

This arithmetic is illustrative, not evidence of statistical significance. A real analysis must consider uncertainty, assignment, sample size, contamination and whether the comparison was implemented correctly. Unequal populations would require an appropriate rate-based or otherwise adjusted comparison, not subtraction of raw counts.

Even if an attribution report associated all 120 treatment conversions with the campaign, that would not make all 120 incremental. Some outcomes may have occurred without the intervention. Conversely, recorded touch history may miss parts of a campaign’s effect.

What must be reliable before testing?

Start with a stable outcome definition. If one group counts submitted forms and the other counts qualified leads, their difference is not a clean measure of the intervention. Keep observation windows and inclusion rules consistent, and distinguish revenue from pipeline value.

Readiness question Why it matters
Is the outcome defined consistently? Prevents a metric change from looking like lift
Can repeated events be identified? Reduces duplicate-outcome distortion
Is assignment implemented as designed? Protects the intended comparison
Are missing outcomes understood? Exposes differential measurement loss
Is uncertainty reported? Prevents false certainty from noisy differences
Were decision rules set beforehand? Reduces opportunistic interpretation

This is an experiment-readiness checklist, not a universal experiment specification. A measurement specialist should adapt the design to the business and available data.

What should a team do when volume is too limited?

Do not manufacture certainty. If an experiment cannot answer the question with useful precision, report that limitation. Continue improving record quality and choose a design or measurement horizon appropriate to the decision, with expert input where needed.

Descriptive attribution still has value: it helps inspect acquisition patterns and operational handoffs. Label it accurately rather than presenting it as causal proof. Better instrumentation does not automatically solve an underpowered or confounded study.

Which layer should you improve first?

  1. If source fields are missing from conversion records, inspect capture and handoffs.
  2. If reports disagree, compare definitions, joins, dates and attribution rules.
  3. If the question is whether marketing created additional outcomes, evaluate a causal measurement design.
  4. If the evidence is inconclusive, preserve uncertainty in the budget recommendation.

The right next step follows the question. ClickTrail can be evaluated for its documented capture boundary; incrementality requires a separate design and evidence standard. Neither layer should be asked to prove something it was not built to establish.

CategoriesUncategorized