Every Metric Reflects Its Measurement

No metric is a neutral window into reality. Every number reflects definitions, choices and assumptions about what is being measured and how.

Every Metric Reflects Its Measurement

Principle

Every metric reflects its measurement.

Commercial metrics inherit the assumptions embedded in the process that produces them.


Metrics are often treated as objective descriptions of reality.

They are compared, benchmarked and trusted as though the numbers speak for themselves.

They do not.

Every commercial metric is the result of a measurement process. Before a KPI appears on a dashboard, decisions have already been made about what to observe, what to ignore and how commercial reality should be represented.

By the time a metric is calculated, most of its meaning has already been determined.

Understanding a metric therefore begins long before its formula.

It begins with understanding its measurement.

Measurement Comes Before Metrics

Measurement is not reporting.

Reporting communicates results.

Measurement determines what those results actually represent.

Every measurement requires assumptions.

Which events belong together?

Which outcomes matter?

Which relationships are causal rather than coincidental?

These decisions are methodological.

The metric simply expresses them numerically.

This is why metrics should never be confused with reality itself.

They are representations of reality, constructed through the choices made during measurement.

Change the measurement, and the metric changes with it.

Even if the formula remains exactly the same.

ROAS Is a Good Example

Return on Advertising Spend appears to be a simple metric.

Advertising investment is compared with revenue.

The formula is straightforward.

The measurement is not.

Advertising spend is usually known with precision.

Revenue is where uncertainty begins.

Was the revenue merely observed?

Was it attributed to advertising?

Was it genuinely incremental?

The formula cannot answer these questions.

It simply accepts the revenue it receives.

Consequently, ROAS reflects far more than advertising performance.

It reflects the assumptions used to define commercial return.

When the Formula Does Not Change

Imagine two campaigns.

Both invest €10,000.

Both report €80,000 in revenue.

Both produce a ROAS of 8.

The metrics are identical.

Now suppose we improve the measurement.

A causal evaluation shows that the first campaign generated €80,000 in incremental sales.

The second generated only €30,000.

Nothing changed in the formula.

Nothing changed in the reported ROAS.

Only the measurement changed.

Yet our understanding of commercial performance changes completely.

One campaign created demand.

The other mainly received credit for demand that would probably have existed anyway.

The mathematics never failed.

The assumptions behind the measurement did.

Why In-Store Retail Media Makes This Principle Visible

This principle applies to every commercial metric.

In-Store Retail Media simply makes it easier to observe.

Advertising appears immediately before purchase.

Exposure and transaction occur within the same commercial environment.

The sequence feels convincing.

The shopper saw the advertisement.

The shopper bought the product.

Therefore, the advertisement caused the purchase.

Sometimes it did.

Sometimes it merely accompanied a decision that had already been made.

As advertising moves closer to the point of purchase, attribution becomes easier.

For exactly that reason, incrementality becomes more important.

Incrementality does not replace attribution.

It tests whether attribution reflects commercial reality.

Better Metrics Begin With Better Measurement

Organisations often try to improve their metrics.

They redesign dashboards.

They introduce new KPIs.

They refine formulas.

These efforts are valuable.

But they begin too late.

A metric cannot be better than the measurement that produced it.

Mathematical precision cannot compensate for methodological weakness.

Improving measurement improves every metric built upon it.

Improving metrics does not necessarily improve measurement.

Commercial Measurement is therefore not primarily about producing better numbers.

It is about producing better representations of commercial reality.

A Principle for Commercial Measurement

Every metric reflects its measurement.

The formula gives a metric its structure.

Measurement gives it its meaning.

This principle extends far beyond ROAS.

It applies equally to conversion rate, market share, customer lifetime value, sales growth and every commercial KPI.

The question is not whether a metric is mathematically correct.

The more important question is whether its measurement faithfully represents commercial reality.

Commercial decisions depend on metrics.

Metrics depend on measurement.

Everything else follows from there.

This essay is part of the In-Store Retail Media Framework under Commercial Measurement. New readers can begin with Start Here or explore the Principles that guide the Journal.

Subscribe to Agustín Gutiérrez

Don’t miss out on the latest issues. Sign up now to get access to the library of members-only issues.
jamie@example.com
Subscribe