Goodhart's Law: When a Measure Becomes a Target, It Stops Being a Good Measure
From cobras in India to nail factories in the Soviet Union; from Microsoft's "token maxing" leaderboards to Vietnam's 10% GDP target for 2026–2030 - the same trap keeps repeating. In 1975, an economist at the Bank of England stated an overarching principle: any statistical regularity will collapse once it's used as an operating target. This piece explains the law, walks through the classic examples, then applies it to two cases: measuring software engineer productivity, and measuring Vietnam's pace of development through GDP.
Stated the Law
AI Slow Dev
GDP Overstated
2026–2030
Note: This piece draws on Charles Goodhart's original 1975 text, Marilyn Strathern's 1997 work, the METR report on AI's impact on developer productivity, the Pragmatic Engineer survey, the Google DORA Report 2024, academic working papers on GDP falsification in China, and public reports from IMF, World Bank, OECD Economic Survey Vietnam 2025, and East Asia Forum.
The "law" here isn't an immutable physical law but a social-statistical regularity: it describes the tendency of systems of people once they're being measured. It doesn't predict with precision - it warns of a trap that can be avoided with careful measurement design.
I. Goodhart's Original Statement
Charles Goodhart was a British economist, at the time an adviser at the Bank of England. In 1975, in a paper titled Problems of Monetary Management: The U.K. Experience, presented at the Reserve Bank of Australia, he observed something strange: every time the Bank of England picked a monetary aggregate (say, M3) as a target for controlling inflation, that aggregate quickly lost the indicator value it used to have.
"Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes."
In plain terms: any statistical regularity will tend to break down once it comes under pressure for control purposes. - Charles Goodhart, Problems of Monetary Management: The U.K. Experience, Papers in Monetary Economics, Reserve Bank of Australia, 1975.
Context: in the 1970s, Britain was suffering high inflation. The monetary authority, under the influence of monetarist thinking, decided to target M3 (a broad money-supply aggregate). The reasoning: historically, M3 had a fairly stable correlation with nominal GDP. Control M3, and you'd control inflation.
But banks and financial institutions reacted. They invented new deposit products (not counted in M3), reclassified assets, and kept expanding credit without M3 rising. The target was met on paper - M3 stayed within its band - but the real economy wasn't actually being reined in. M3 stopped being a good measure of economic activity the moment it became a policy target.
Two decades later, in 1997, anthropologist Marilyn Strathern condensed this principle into the line everyone quotes today:
In other words: once a measure becomes the target, it stops functioning as a good measure. - Marilyn Strathern, 1997, restating Goodhart
II. Why Does This Happen?
The underlying mechanism is the gap between what we actually care about and what we can measure. We care about the health of the economy - we measure GDP. We care about developer productivity - we measure commits. We care about teaching quality - we measure test scores. In every case, what we measure is only a proxy (a stand-in variable) for the real thing.
A good proxy is one that correlates strongly with the real thing - as long as no one is thinking about gaming it. But the moment the proxy is declared the target - rewards, punishments, promotions, and budget all tied to it - people inside the system learn to maximize the proxy without maximizing the real thing. The correlation between proxy and reality shatters.
The proxy correlates with the real thing that matters
Attach rewards and sanctions to the number
Correlation breaks. The proxy looks great; the real thing gets worse
Worth emphasizing: Goodhart does not require anyone to cheat. Even if 100% of the actors in a system are perfectly honest, the mere fact that they optimize the proxy (because that's what gets rewarded) means the real thing gets sacrificed along whatever dimensions aren't being measured. This is called the "strong form" of Goodhart's Law.
III. Three Classic Examples
TargetReduce the number of cobras on the streets of Delhi.
PolicyThe colonial government offered a bounty for every cobra carcass turned in.
ResultAt first, the number of carcasses turned in rose and the number of cobras on the streets fell. Then people started breeding cobras at home just to kill them for the bounty. When the government caught on and scrapped the program, the breeders released their entire stock. The number of cobras on the streets ended up higher than before the policy.
LessonThe proxy "number of carcasses turned in" did not measure the real thing: "the number of wild cobras on the streets."
TargetProduce enough nails for the entire planned economy.
PolicyQuotas were assigned by nail count. Factories responded by producing millions of tiny, hair-thin nails, useless for anything.
ResponseGosplan switched the quota to nail weight (tons). Factories immediately switched to producing nails the size of railway spikes - equally useless.
LessonNo single physical metric can capture "nails that are actually useful to the economy." That's an inherently multidimensional judgment.
TargetReduce healthcare costs. Proxy: average LOS (length of stay).
PolicyReward hospitals with the lowest LOS.
ResultHospitals discharged patients before they had fully recovered. Average LOS looked great on paper. But the 30-day readmission rate spiked. Total cost didn't fall - in some cases it even rose, since emergency readmission is more expensive than a normal hospital stay.
LessonA single-dimension proxy always misses hidden costs. To measure "real healthcare savings," you have to track LOS, readmission rate, outcomes, and patient satisfaction all at once.
IV. Case 1 - Measuring Software Engineer Productivity
More than half a century after Goodhart, the software industry has replayed the Bank of England's exact trap - the only difference is that M3 has been swapped for "lines of code," "commits," "PRs merged," and, most recently, "AI tokens spent."
A 2025 survey by Pragmatic Engineer of 180+ companies found that around 30% of organizations still use Lines of Code or PRs merged per developer as a productivity KPI. What stands out is that in the AI era, LOC has become a self-destructing metric - LLMs generate code at essentially zero cost. A developer using Copilot can 5x their LOC output without solving a single additional problem. The consequence: code bloat, accumulating maintenance debt, and that debt lands on a different team - so no one is accountable, and the dashboard number still looks great.
This is Goodhart, verbatim: LOC used to be a weak-but-correlated proxy for output back when code was hand-written. Once LOC became a KPI and, at the same time, tools that generate LOC for free appeared, the correlation broke completely.
Pragmatic Engineer reported in early 2026 that some units inside Microsoft, Meta, and Salesforce built leaderboards ranked by AI token consumption. Developers who ran agents the most and wrote the longest prompts were held up as exemplars; token spend crept into performance reviews. The implicit message: "using AI more = being productive."
Developers reacted exactly as Goodhart would predict: token maxing - writing pointlessly long prompts, running agents through repeated loops with duplicate queries, just to inflate the number. The token metric measures cost, not outcome. When cost is turned into a rewarded target, the system automatically optimizes toward… burning more money.
A randomized controlled study by the nonprofit METR (July 2025), covering 16 experienced open-source developers across 246 tasks: developers believed AI made them 24% faster. In reality, AI made them 19% slower. The gap between perceived and actual performance was more than 40 percentage points. Google's DORA Report 2024 recorded a parallel finding: high AI adoption came with both higher throughput and a 7.2% increase in delivery instability.
In other words, vendors picked the metric "lab task completion time" - and that metric shows a result of +55%. But when you measure something closer to real value (time to PR merge, defect escape rate, maintenance cost six months out), the correlation between "using AI heavily" and "actual productivity" nearly disappears, and even turns negative in some cohorts.
These three cases illustrate the same pattern: every popular productivity metric is a proxy, and Goodhart kicks in the moment an incentive is attached to it. The industry's answer - packaged into frameworks like DORA, SPACE, and DX Core 4 - isn't "pick a better metric" but "use several metrics at once, balancing speed against quality, quantitative against qualitative." So that every speed metric is offset by a quality metric. So that no one can optimize along one dimension without it showing up on another.
Why does using multiple metrics resist Goodhart?
Goodhart collapses when a proxy is optimized along a single dimension. If you measure both Deployment Frequency (speed) and Change Failure Rate (quality), a developer can't game both at once: deploying often without adequate testing pushes CFR up; testing too thoroughly pushes DF down. The two metrics hold each other in check through a physical trade-off.
But this isn't a magic formula. If you only look at the combined score across the whole set of metrics (say, a simple average), Goodhart still applies - actors will game whichever metric is easiest to move to pull the total up. Keeping the metrics separate, looking at each dimension individually, is what actually resists it.
See the companion deep-dive on measuring engineering productivity in the AI era on grimlogs.com, published the same day.
V. Case 2 - Measuring Vietnam's Pace of Development Through GDP
Moving from nail factories and AI tokens to a national-scale proxy: GDP. And the question is: when a country turns the GDP growth figure into a political target tied to the Party Congress's five-year cycle, what happens?
Vietnam is preparing for the 14th Party Congress. The stated target: GDP growth for 2026–2030 reaching double digits - around 10% a year. According to analysis by East Asia Forum (June 2025), this is a level Vietnam has not hit since 1985; the most recent peaks were 9.5% in 1995 and 9.3% in 1996, during the early reform period when the base was very low.
Forecasts from international organizations are considerably more cautious:
By East Asia Forum's calculations, hitting 10% annual growth would require Vietnam's TFP (total factor productivity) to grow at 5.7% per year - more than three times its historical pace. Even if capital accumulation grows at 10% a year (a very high rate), the required TFP level remains far beyond what the current structure can deliver.
This is precisely the situation Goodhart warned about: a statistical quantity (GDP) that used to be a fairly reliable indicator of economic welfare is now under pressure for control purposes - specifically, controlling the political narrative of a five-year cycle. The real risk isn't "whether 10% gets hit or not," but the distortions to the statistical and decision-making system once every level of government knows it has to hit the number.
A Lesson From the Neighbor's Backyard
The closest institutional parallel: China. For decades, provincial GDP growth was the KPI that determined the career advancement of provincial officials. Academic papers (including Ni & Jiang 2024, and Diminishing Target-based GDP Manipulation in the Journal of Public Economics, 2025) provide empirical evidence: provincial officials manipulated data to hit their targets.
In 2015, several northeastern Chinese provinces admitted to fabricating GDP data; in 2017, two more provinces were caught. The mechanism: provincial officials were rewarded with promotion based on local growth rates; they reacted exactly per the Goodhart formula - optimizing the proxy (the reported number), not the real thing (their province's actual economic welfare).
Vietnam is not China. The statistical apparatus, the processes, and the degree of independence of the General Statistics Office differ substantially. But the incentive mechanism - a growth KPI tied to the political cycle, quotas handed down to each province - is structurally similar from a game-theory standpoint. The OECD's Economic Survey of Vietnam 2025 and the IMF's Article IV report both stress the same message, in diplomatic language: growth quality matters more than growth speed; the focus needs to shift from inputs (capital) to productivity; the statistical framework needs stronger independence and transparency.
Goodhart Looks at GDP: Three Faces of Distortion
| Dimension of distortion | When GDP is a neutral measure | When GDP becomes a mandatory target |
|---|---|---|
| Data quality | Collected per technical standards; errors are random. | Pressure to hit targets at the provincial level; errors trend systematically one way (upward). |
| Investment structure | Investment flows to where returns are highest. | Public investment pours into "GDP-flattering" projects (large infrastructure) even where TFP is low. Risk of overcapacity. |
| Macro balance | Credit, the exchange rate, and the budget are managed independently. | To sustain headline growth, credit is easily loosened → asset bubbles, exchange-rate pressure, the public-debt ceiling gets tested. |
| Structural reform | Prioritized because it builds long-run productivity. | Delayed because it causes "short-term pain" - cutting weak state-owned enterprises, restructuring banks, and land reform all temporarily slow GDP. |
| Political allocation | Officials are evaluated on multiple dimensions. | Provincial officials optimize the metric; whatever isn't measured (environment, inequality, local fiscal health) gets neglected. |
Not all of these faces are bound to occur in Vietnam. But they mark the risk space that Goodhart warns will open up once an economic proxy is turned into a rigid political target. What East Asia Forum calls "a double-digit target that is mathematically unrealistic yet politically useful" is itself an acknowledgment of this point: a high target can force out structural reform if it's interpreted correctly; or force out inflated numbers if it's interpreted the wrong way.
The Question International Organizations Are Asking
OECD Economic Survey Vietnam 2025 and IMF Article IV 2025 propose supplementary indicators alongside GDP - not replacements. The logic is precisely the Goodhart-resistant logic: keep GDP as one dimension, but never let it stand alone.
This set of indicators paints a multidimensional picture that a single GDP figure can't replace. And crucially: because of the trade-off structure between the dimensions (growing fast via credit widens the credit gap; growing via public investment raises public debt) - it's very hard to game all of them at once. This is the Goodhart-resistant mechanism built into macro design.
VI. Conclusion: Measurement Epistemology
Goodhart isn't saying measurement is useless. He's saying measurement has regimes: some uses make for a good measure, others don't.
Three principles for avoiding the trap - equally true for measuring developer productivity and for measuring a nation's pace of development:
- Use several metrics at once, and don't collapse them into a single number. Keep the dimensions separate so the trade-offs reveal themselves. DORA has 4 metrics; DX Core 4 has 4 metrics; the IMF/OECD recommend viewing GDP alongside TFP, ICOR, credit gap, and debt service.
- Balance speed metrics against quality metrics, quantitative against qualitative. Every number that's easy to inflate must be paired with one that's hard to fake. In engineering: deploy frequency paired with change failure rate. In macro: GDP paired with job quality, regional disparity, and budget sustainability.
- Separate diagnostics from targets. Not every metric needs to become a KPI. Many metrics are useful precisely because they aren't tied to an incentive. Turning them into a KPI destroys that usefulness - exactly per Goodhart's original 1975 statement.
From the Bank of England in 1975 to Microsoft in 2026 and Vietnam's 2026–2030 GDP target, the principle hasn't changed. Systems of people are smarter than systems of metrics. If a metric is single-dimensional and carries an incentive, people will find a way to make the number look good without making the real thing any better - usually not out of malice, but because that's the rational response of an actor facing a poorly designed system.
Goodhart's Law doesn't tell us to stop measuring. It tells us to measure more, across more dimensions, and with more humility about what any single number can actually tell us.
- Charles Goodhart (1975), Problems of Monetary Management: The U.K. Experience, Papers in Monetary Economics, Reserve Bank of Australia.
- Marilyn Strathern (1997), restating Goodhart - quoted via Hoskin (1996).
- METR (Jul 2025), Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (arXiv 2507.09089).
- Google DORA Research, DORA Report 2024 - AI adoption & delivery stability.
- Gergely Orosz, Measuring the impact of AI on software engineering, Pragmatic Engineer Newsletter, 2025–2026 (survey of 180+ companies).
- Hillel Wayne, Goodhart's Law in Software Engineering, Buttondown (Jul 2024).
- East Asia Forum (Jun 2025), Vietnam's double-digit growth target is unrealistic yet useful.
- World Bank (Mar 2025), Vietnam Taking Stock Report - 6.8% / 6.5% forecast.
- IMF (Sep 2025), Vietnam Article IV Consultation Staff Report.
- OECD (2025), OECD Economic Surveys: Viet Nam 2025 - Strengthening the macroeconomic foundations for growth.
- Ni & Jiang (2024), Career Incentives and GDP Falsification, China Economics Summer Institute.
- Diminishing Target-based GDP Manipulation: Evidence from China, Journal of Public Economics (2025).
- The China Project (Sep 2019), The Quantified Country: China runs on numbers - even if the numbers lie.
03 Discussion
Leave a note
A considered space for questions, counterpoints, and useful additions. Civil, on-topic, signed.
Reader notes
...Loading notes...