Tech
A Political Risk Score Is Not a Prediction
A league table can make political instability look deceptively straightforward. Country A is ninth; Country B is fourth. A green arrow signals improvement, a red one deterioration. The precision is reassuring because the underlying subject is so difficult to measure. But before any country receives a rank, someone has made a decision that may shape the entire result: which countries have enough evidence to qualify?
That is the missing-data trap. A table can be numerically correct for every country it includes and still give readers a misleading impression of the world it claims to describe. The countries left out, the age of the evidence, and revisions to the underlying sources can matter as much as the number beside a flag. In cross-country political analysis, coverage belongs in the findings. It should not be relegated to a technical appendix that few readers will open.
Consider a ranking of 80 fully assessed countries. A country placed tenth is tenth among those 80. Calling it tenth in the world requires something more: comparable assessments of the countries outside the table, or a defensible explanation of why they do not belong in the comparison. Add 15 countries and its position may change even if conditions within it remain exactly the same. A reader following the arrow sees apparent improvement or decline. The analyst may simply have changed the sample.
A recent example comes from ConflictMeter’s public release, which I develop independently. Its September 2026 production snapshot covers 96 countries for structural pressure and “activation,” the model’s measure of mobilization. Only 81, however, have the additional inputs required for a full Global headline score. The other 15 have core and activation coverage but lack the complete set of “accelerants,” the model’s additional measures of economic pressure and narrative fragmentation. The full-coverage public ranking therefore compares 81 countries. Explaining that boundary is as important as naming the country at the top.
Missing values invite tidy repairs. An absent observation can be entered as zero, carried forward indefinitely from an earlier release, or replaced with a regional average. Each approach fills a spreadsheet cell, but each also changes what the result means. Zero says that the measured condition is absent.
A missing value says that it has not been observed, or that the available observation cannot be used. Substituting one for the other turns a gap in knowledge into a claim about reality.
Some model-based estimates of missing values can be scientifically defensible. Their assumptions must be explicit, their uncertainty reflected in the results, and their performance appropriately validated. For a public composite index intended to be auditable, leaving an observation missing may sometimes be the more honest choice. A clearly labeled partial profile tells readers where the evidence stops. An apparently complete score built partly from estimates needs to make those estimates equally visible.
Coverage is only one source of confusion. Another is time. Researchers often download the latest version of a database and use it to rebuild historical series. That can improve retrospective research, but it does not reproduce the information available to a policymaker or reader at the time. If a data provider revises an estimate for 2024, a chart assembled today may show a different value for that year. The historical event has not changed; the evidence or assessment of it has.
The World Bank’s own guidance explains that past observations in its World Development Indicators can change when the database is updated, often because of better surveys, improved estimates, or methodological revisions. The July WDI release updated several categories of indicators, including national accounts and population estimates. These revisions can make a database more useful. They also make it essential to identify the version of a time series used in an analysis, especially when comparing results published at different times.
The same problem extends beyond economics. V-Dem publishes a versioned dataset archive; version 16 was issued in March 2026. A 2025 observation taken from that release may differ from the assessment in an earlier version. Unless the release is recorded, a historical comparison can quietly combine political developments with revised judgments or measurement methods. Readers may reasonably assume that a changing line represents a changing country when part of the movement comes from the measurement process.
For that reason, ConflictMeter distinguishes “Vintage” history, based on source releases available at a particular cutoff, from “Reconstructed” history, which uses subsequently revised material. The project’s authorized public baseline for score movements begins with the 2025 vintage. Earlier years can have component histories without being presented as though a fully comparable composite score had been published for them. This is a discipline of recordkeeping, not evidence of scientific validity. The index still requires external assessment of what it measures and the limits of its predictive usefulness.
A further temptation appears when an index uses a scale from 0 to 100. Readers can easily interpret 78 as 78 percent. Yet a transformed composite score may indicate only a position on a chosen scale. Without calibration against observed events and a transparent definition of the outcome, it cannot establish a 78 percent chance of turmoil or civil conflict. Two decimal places can make a score look more exact. They cannot turn it into a forecast.
The definition of conflict matters just as much as the scale. The Uppsala Conflict Data Program defines state-based armed conflict around a contested issue concerning government or territory, involving armed force between two parties, at least one of them a state government, and at least 25 battle-related deaths in a calendar year. An index measuring social polarization, political distrust, or mobilization measures something different. Its output should not be treated as a count of armed conflicts, or as a probability of them, without the evidence needed to support that interpretation.
None of this requires abandoning comparison. It requires giving readers enough information to understand the comparison being made. How many countries qualify, and why are the others absent? Which source release and observation year supplied each input? Are the countries assessed with the same model and measurements? Does a reported movement use a stable comparison group, and does it distinguish source revisions from changes in conditions? Is the score an index of conditions or a validated prediction of a specified event? These questions should be answerable before a ranking becomes a headline.
Country pages, downloadable source maps, and clear methodologies help readers examine those answers. An interface can show that a component is unavailable instead of displaying it as zero. Coverage of a ranking can explain its boundaries before promoting an arresting top ten. These practices do not settle whether the underlying theory is sound. They give readers a better chance of identifying its weaknesses and challenging its conclusions.
International datasets make possible comparisons that would otherwise be difficult or impossible. Their value does not excuse ambiguity about what those comparisons represent. A rank stripped of its comparison group, data vintage, and definition is a number wearing the costume of certainty. If readers cannot see who is missing, what changed, and what was measured, they are being asked to trust the list rather than understand it.