Census weighting:the arithmetic, worked through

    Weighting is the least glamorous part of any research method and the part that decides whether the answer means anything. This page works it through with numbers: what weighting to official statistics does, what the same result looks like without it, and why the unweighted version misleads in a consistent direction rather than randomly.

    The problem weighting solves

    Whoever answers a question is never a cross-section of a country. In conventional research the people who respond are the people who are reachable, available and willing, and those three filters are not neutral. In a simulation the equivalent problem is that the profiles generated skew towards whoever is easiest to describe.

    Weighting is the correction. Every respondent, real or simulated, is assigned a weight so that the groups they belong to contribute to the total in the proportion those groups occupy in the population, as measured by an official source — the Census Bureau in the United States, CBS in the Netherlands.

    It is worth being clear about what this does and does not fix. Weighting corrects composition. It cannot correct for a group being systematically misunderstood: if a segment's responses are wrong, scaling them up makes the error larger, not smaller.

    A worked illustration

    Illustrative arithmetic using two real Dutch population shares. The acceptance figures per segment are made up for the example and are not results from a run.

    Steady aspirers

    Share of population
    21.9%
    Accepts (illustrative)
    40%

    Self-reliant establishment

    Share of population
    6.9%
    Accepts (illustrative)
    80%

    What the two numbers do to the result

    Treat those two segments as equal voices and you average 40% and 80% and report 60% acceptance. That is the unweighted answer, and it is the answer you get by default from any method that does not correct for composition.

    Weight them by population share and the arithmetic changes. The two segments together are 28.8% of the population; within that, the mainstream segment is roughly three quarters of the pair. The weighted result across the pair is about 50%, not 60% — because the segment that is three times larger was reported as though it were the same size as the smaller one.

    Ten points, from one correction, on two segments. Across eight segments with shares that differ by a factor of three or more, the gap between the weighted and unweighted answer is routinely large enough to reverse a decision.

    The direction of the error is the part that should worry you. It is not noise. The enthusiastic, articulate, easily-described segment is over-represented in unweighted output every single time, which means unweighted results are consistently more optimistic than the population they claim to describe.

    How the weighting is built here

    Two layers, applied in both markets. Neither layer contains data about identifiable individuals — the source material is aggregate statistics.

    • Demographic layer: age band, educational attainment, household income band and geographic spread, in the proportions published by the national statistics office — the U.S. Census Bureau for the American panel, CBS for the Dutch one.
    • Value layer: eight value segments in the United States, eight value groups in the Netherlands. This groups people by what they want and distrust rather than by what they earn, which is where most disagreement about a product or a message actually lives.
    • Results are computed per segment and then combined by population share, so the reported total is a weighted total rather than an average of segments.
    • Every report shows the per-segment figures alongside the total, because the total on its own hides the thing you needed to know.
    • Segmentation and population shares are refreshed when new national statistics are published.

    What weighting still does not buy you

    A correctly weighted simulation is still a simulation. Weighting is a statement about composition, not about correctness: it guarantees that the groups are present in the right proportions, and guarantees nothing whatsoever about whether each group's simulated response resembles what those people would really say.

    It also does not create statistical significance. Significance comes from sampling real units from a real population with known probability. Nothing here is sampled, so there is no margin of error to quote and none is quoted.

    Reynard is a simulation. It is not fieldwork, it carries no statistical significance, and it cannot replace talking to a customer. Treat it as a fast, structured second opinion that tells you where to look — not as evidence.

    Keep reading

    Run the free check first

    One check costs nothing and needs no account. You see the format of the output before you decide whether it is worth paying for a full run.

    Start the free check