A sample is an estimate, not a miniature certainty

Suppose you want to know what proportion of a large group prefers one option over another. Asking everyone may be impractical, so you ask a sample and use its answers to estimate the group’s view. Even if the sample is chosen carefully, a different set of people could give a somewhat different answer. That natural variation is called sampling error.

A margin of error gives a range for the sampling uncertainty around an estimate under stated assumptions. If a survey reports 50% with a margin of error of plus or minus 5 percentage points, its interval runs from 45% to 55%. The margin is expressed in percentage points, not as 5% of the reported figure. It is not a guarantee that the true value lies in that interval; its meaning depends on the method used to produce it.

Why a bigger sample helps, but not as quickly as you might think

For a proportion measured in a simple random sample, uncertainty generally shrinks in proportion to the square root of the sample size. In practical terms, cutting the margin of error in half takes roughly four times as many responses, not twice as many. Increasing a sample from 400 to 800 helps, but it does not double the precision.

As a rough illustration, at a commonly used 95% confidence level, a simple random sample of 100 has a margin of error of about 10 percentage points for a proportion near 50%. With 400 responses, it is about 5 points; with 1,600, about 2.5 points. These are approximate figures for that specific setup, not universal margins. The calculation changes with the estimate, the sampling design and, in some cases, the size of the population being studied.

What a margin of error does—and does not—cover

A 95% confidence interval describes a procedure: if the same sampling method were repeated many times, about 95% of the resulting intervals would contain the population value. It does not mean there is a 95% chance that a fixed population value lies in this one completed interval. That distinction may not change how you read an everyday survey, but it helps prevent a margin of error from sounding more certain than it is.

The familiar margin-of-error calculation usually addresses random sampling variation. It does not automatically account for people who could not be reached, chose not to respond, misunderstood a question or answered differently because of its wording. Nor can a large sample fix a systematic problem with who was invited. Ten thousand responses from an unrepresentative pool can give a very precise estimate of the wrong group. Some survey methods use weighting or more complex sampling designs; their published margins may account for parts of that design, so check how they were calculated.

Read the number that applies to the result

An overall survey may have a large sample, while a result for a smaller subgroup rests on far fewer responses. A finding about 200 respondents within a survey of 2,000 should not be read as though all 2,000 answered for that subgroup. Smaller subgroup samples generally have wider margins of error. If you are comparing age groups, regions or other categories, look for each group’s sample size rather than relying only on the headline total.

Comparisons also need their own uncertainty check. If one survey reports 52% and another reports 48%, the four-point gap is not automatically meaningful—or automatically meaningless—because both have margins of error. The uncertainty in the difference depends on how the samples and estimates relate to each other. Likewise, overlapping individual intervals are not a dependable shortcut for deciding whether a difference is clear. When available, use an interval for the difference itself, and avoid treating a small lead as settled when uncertainty is substantial.

A practical checklist for judging precision

Start by asking who the result is meant to describe and how respondents were selected. Then find the sample size for the specific estimate, the confidence level and any stated margin of error. Check whether the figure is a proportion, an average or a comparison: each can require a different calculation. Look at the question wording and response options, too, because statistical precision cannot repair an unclear question.

Finally, match your conclusion to the resolution of the evidence. A wide interval may support a broad observation without supporting an exact ranking or a claim that views have shifted slightly. A narrow interval makes a number more precise under the survey’s assumptions, but it does not by itself establish that the sample represents the intended population. Sample size tells you how much random variation to expect; the quality of the method helps determine whether the estimate is useful at all.

Back to category ↗