A pattern is a starting point, not an explanation

Suppose a survey finds that people who use a planning app report finishing more projects. It is tempting to conclude that the app makes people more productive. That might be true, but another possibility is that people who are already motivated are more likely both to download the app and to finish projects. Motivation could help explain the observed relationship without the app having caused the difference.

A confounding variable is a factor related to both the possible cause and the outcome being studied. It can make a relationship look stronger, weaker or even different in direction than it would otherwise appear. Spotting a confounder does not prove that the original finding is wrong. It shows why the finding alone may not settle a cause-and-effect question.

Start with a simple map of the claim

To examine a finding, name its three parts: the proposed cause, the measured outcome and plausible alternative factors. In the app example, app use is the proposed cause and completed projects are the outcome. Motivation is one possible alternative factor. Available free time, the difficulty of each project and access to support might matter too.

Ask whether each proposed factor could reasonably influence who uses the app and who completes projects. A factor linked only to the outcome may still be useful for understanding the result, but it is not necessarily a confounder. The aim is not to invent every imaginable explanation. It is to identify a manageable set of alternatives that fit the setting and could meaningfully change how the finding is interpreted.

Look at how the comparison was made

The study design determines how much a finding can tell you. If researchers simply compare existing app users with nonusers, the groups may differ before anyone opens the app. If participants are randomly assigned to use an app or not, pre-existing differences are less likely to be systematically concentrated in one group. Random assignment is useful for studying causation, though it cannot fix every problem, such as poor measurement or participants not following their assigned approach.

For an observational study, ask who entered each group and why. Were participants recruited from the same setting? Did one group tend to have more time, resources or prior experience? Was the outcome measured in the same way for everyone? These questions can reveal alternative explanations even when the reported numbers are accurate.

Understand what adjustments can and cannot do

Researchers may try to account for confounding by comparing similar participants, examining results within subgroups or using statistical models that include measured factors. For example, they might compare app users and nonusers who reported similar levels of prior project completion. If the relationship remains, that is more informative than an unadjusted comparison, but it is not automatic proof that the app caused the result.

An adjustment can address only factors measured well enough to use. Motivation, for instance, may be difficult to capture with a short survey question. Researchers also need to choose adjustments thoughtfully: adding every available variable to a model does not guarantee a fair comparison and can sometimes introduce new problems. When reading a finding, look for an explanation of why particular factors were considered, not just a statement that the results were “controlled.”

Reach a conclusion that fits the evidence

A practical check is to ask: What else could produce this pattern? How was that possibility assessed? Would the conclusion change if an important factor had not been measured? You may not be able to answer every question from a brief summary. That limitation is itself useful information: it signals that a confident causal claim may be premature.

Careful wording helps preserve what the evidence actually shows. “App users reported completing more projects” describes an observed relationship. “The app increased project completion” makes a causal claim that needs stronger support. Considering confounders does not mean dismissing every interesting result. It means treating a pattern as a clue, testing reasonable alternatives and keeping the conclusion proportionate to the comparison that was made.

Back to category ↗