When a pattern is not the whole explanation

Suppose a school compares exam scores for students who attended an optional study group with scores for those who did not. The attendees score higher on average. It is tempting to conclude that the study group raised their scores. But students chose whether to attend, and that choice may reflect differences that existed before the group met. Some attendees may have had more time to study or stronger preparation. Those differences could contribute to both attendance and exam performance.

A confounding variable is a factor related to both the potential cause being studied and the outcome being measured. Here, available study time could be related to joining the group and to scoring well. The score difference may be genuine, yet the explanation “the study group caused it” remains uncertain. Confounding matters because it can make an effect look larger, smaller, or even different in direction from what it would look like in a fairer comparison.

Look for what differs between the groups

To identify a possible confounder, begin with two questions: What predicts who ends up in each group? What else might affect the outcome? For the study-group example, prior subject knowledge, free time, access to a quiet place to work, and motivation are worth considering. A factor is a plausible confounder when it could influence both attendance and scores, not merely because it is associated with one of them.

The direction of the distortion is not always obvious. Motivated students might be more likely to join the group and earn high scores, making the group appear more effective than it is. Alternatively, students who are struggling might be especially likely to seek help, making a useful group appear less effective. Before interpreting an association, ask who selected into each group and what their starting circumstances were.

Do not confuse a confounder with part of the pathway

Timing helps clarify the role of a variable. A confounder generally exists before, or independently of, the exposure being examined. If students already differed in preparation before joining the study group, prior preparation could confound the comparison. But if the group encourages students to practice more afterward, that extra practice may be part of how the group affects scores. Treating it as something to remove from the analysis could hide part of the effect you want to understand.

It is also important not to call every unexplained factor a proven confounder. You may suspect that motivation influenced both attendance and performance without having measured it. In that case, describe it as a plausible alternative explanation. This distinction keeps the discussion honest: you have identified a reason for caution, not demonstrated exactly how much of the score difference it explains.

Check what the study did to address the problem

When evaluating a finding, look first at how the comparison groups were formed. Random assignment, when practical and carried out well, can help distribute both known and unknown preexisting differences between groups. Observational studies cannot rely on that protection, but researchers can measure relevant starting characteristics and compare more similar participants. For example, they might compare study-group attendees and nonattendees who had similar earlier scores.

Such adjustments can improve a comparison, but they are not a guarantee. A study may omit an important factor, measure it poorly, or have too few comparable people in each group. Check whether the authors report what they adjusted for and why those factors matter. If you cannot tell how the groups differed before the outcome was measured, be careful about treating the reported difference as a causal effect.

Communicate what the evidence actually supports

Precise wording prevents an interesting result from turning into an unsupported claim. “Students who attended the group scored higher” describes the observed pattern. “The group improved scores” claims a cause. The second statement needs stronger support, including attention to plausible confounders. You can still explain why a result is useful while saying what it cannot establish.

For your own projects, write down likely confounders before collecting data, record relevant starting conditions when appropriate, and note which factors you could not measure. When presenting a finding, separate the observation from your interpretation: state the pattern, name the main alternative explanations, and explain how the study design addressed them. The goal is not to dismiss every association. It is to make sure your conclusion is no stronger than the comparison behind it.

Back to category ↗