Back to All stories

The metrics that flatter you

Sign-ups, page views and total users all go up and to the right. That is exactly why they are so dangerous to run a product on.

A leaderboard of bars with a flat line running across them
A leaderboard of bars with a flat line running across them
Daniel Côté

Contributing Editor

Up and to the right

There is a particular kind of chart that every board deck contains. It counts something cumulative — total sign-ups, total downloads, lifetime users — and it only ever rises, because nothing can be subtracted from it. It is the most reassuring image in business, and it tells you almost nothing.

Why they seduce

Flattering metrics are not lies. They are true numbers that answer the wrong question. Total sign-ups tells you that marketing is working. It does not tell you whether anyone found the product useful, came back or paid. A team that steers by it will keep buying traffic for a product that is quietly failing.

A number that cannot go down cannot tell you that something is wrong.

What to watch instead

Prefer rates to totals, cohorts to aggregates and behaviors to visits. The share of new customers who reach the first valuable action in a week. The retention of this month’s cohort against last month’s. Revenue per active customer. These numbers fall when things go wrong, which is exactly what makes them useful.

Keep the flattering charts if they cheer the team up. Just don’t let them anywhere near a decision.

About the writer

Daniel Côté Daniel Côté writes essays on behavioral economics and design ethics. He trained in decision research before moving into product, and is suspicious of any chart that only ever goes up. He writes for readers who have to defend a number in a meeting and want to know what it can and cannot prove.

[ More from Daniel ]

For pitches, data you would like us to look at and letters to the editor, write to us any time. We read everything.

Free. One study, one teardown and one thing to test, every Tuesday morning. Nothing else.

(The Tuesday brief)