Forms · Glossary

What is a leading question in a survey?

A leading question is worded so that one answer is easier, more expected or more agreeable than the others. It can steer through an adjective, through an assumption built into the sentence, or through the context the preceding questions created. The respondent answers honestly and the data is still wrong.

Nobody sets out to write one. They appear because the person writing the survey already knows what they hope to find, and that expectation leaks into the wording in ways that are invisible from the inside.

· Co-founder

6 min read · Published

Leading, loaded and neutral
TypeExampleNeutral version
Leading adjectiveHow helpful was our friendly support team?How helpful was the support team?
Assumed premiseWhat did you enjoy most about the event?What, if anything, did you enjoy about the event?
Loaded wordDo you support the wasteful spending on the new system?Do you support the spending on the new system?
Unbalanced scaleExcellent, very good, good, fairExcellent, good, fair, poor, very poor
Prestige cueMost customers upgrade. Will you upgrade?Are you planning to upgrade?
One sided askShould the council improve the park?Should the council spend more, the same or less on the park?

The three ways a question leads

Through wording, through structure, and through context. Wording is the obvious one: an adjective like friendly, convenient or award winning attached to the subject tells the respondent what answer is expected. Structure is subtler. A scale with three positive points and one negative one produces positive answers, and a question that offers only one direction of change, such as asking whether something should be improved, never collects the view that it should be left alone. Context is the hardest to see, because a question can be perfectly neutral on its own and still be led by the three questions before it. Ask people about a series of problems and then ask for an overall rating, and the rating will be lower than if the order were reversed.

Leading against loaded

The two terms are often used interchangeably and it is worth keeping them apart. A leading question makes one answer easier. A loaded question embeds an assumption the respondent has not accepted, so any answer concedes it: asking how somebody dealt with the delays assumes there were delays. Loaded questions are harder to detect because the assumption is usually true from the writer's point of view, which is exactly why it went unnoticed. The fix for a leading question is neutral wording and a balanced scale. The fix for a loaded one is to ask about the premise first, then ask about the consequence only of those who confirmed it.

Balanced options and the if anything trick

Two small habits remove most accidental leading. Balance the scale so there are as many negative points as positive ones, with a matched intensity at each end, and label them in words rather than leaving people to infer the middle. And add if anything to open questions that assume an experience occurred: what, if anything, would you change gives people permission to say nothing, which is both honest and useful information. The same applies to closed questions about future behaviour, where offering a no plans to option removes the pressure to name a date. None of this makes a survey longer and all of it makes the results more defensible.

Testing for leading before you send

The most reliable check is to give the draft to somebody who does not share your expectation and ask them what answer they think you are hoping for. If they can tell, the question leads. A second check is to write the opposite version of each item and see whether it sounds odd: if asking whether a service was unhelpful feels strange while asking whether it was helpful feels natural, the natural version is carrying a thumb on the scale. A third is to run the survey past five real respondents and ask them to think aloud, which catches the questions people interpret differently from the way they were meant.

Building neutral questions in a form

Neutral wording has to live in the label, because a classic field's description is not shown to the respondent. Any framing, caveat or definition belongs in the label itself, in the placeholder, or in a paragraph block above the field. On a conversational form the description does render beneath the question label, which gives a little more room. Keep scale options balanced in the option list of a radio field, and lay them out in one, two or three columns so the positive and negative ends carry equal visual weight rather than one side wrapping.

Neutral wording in recurring surveys

A leading item is most expensive in a tracking survey, because the bias is baked into every wave and the trend looks perfectly healthy. Fixing it breaks the series, which is why teams put the fix off and the flawed item survives for years. The way out is to run both versions for one wave, on split halves of the sample, so the size of the shift is measured rather than guessed. Then report the two series with a clear note about where the change happened. It is more work than a quiet rewrite and it is the only version that leaves the history usable. The same approach handles a change of scale length or a change of question order, both of which shift results by more than most people expect. Whatever you do, record the wording of every item alongside the data for each wave, because reconstructing it from memory two years later is impossible.

Questions people ask

Is every leading question deliberate?

Very few are. Most come from writing a survey to confirm something the team already believes, or from copying marketing language into a research instrument. That is why an outside reader is worth more than another internal review, since the people who wrote the questions cannot hear the assumption in them.

Does the order of questions matter?

Yes, and more than most people expect. Questions earlier in a survey prime the ones after them, so a block of detailed complaints followed by a general rating produces a worse rating than the reverse order. Put general questions before specific ones when you want an unprimed overall view.

How do I ask about a problem without assuming it happened?

Ask whether it happened first, then ask about it only of the people who said yes. Conditional logic in this product is jump rules only, so that means routing to a later question rather than revealing one in place. It is a small amount of extra work and it removes the loaded premise entirely.

Are unbalanced scales ever acceptable?

They are used deliberately in some contexts, such as consumer ratings where nearly everybody chooses the top half and extra resolution at the top is useful. Outside that, an unbalanced scale reads as an attempt to manufacture a good result, and anybody reviewing the methodology will say so.

Do incentives make leading worse?

They can. A respondent who wants the reward and senses what answer is expected will give it, particularly on screening and satisfaction questions. Neutral wording matters more when an incentive is offered, and it is worth adding a quality check somewhere in the middle of the survey rather than relying on the wording alone.

Can a leading question be fixed in analysis?

Not reliably. You can sometimes bound the effect by comparing with a neutrally worded version in a later wave, but that breaks the trend line. The practical answer is to catch it before sending, because the cost of a rewrite is minutes and the cost of a leading item in a tracking survey is every wave it appeared in.

Make one with forms

The button opens the generator with this use case already described. Change the wording to match your own.

Create a form with OneCraft

Related questions

Step by step in the builder: Create a form from scratch with AI, then Every form field and when to use it.

Sources

Written and checked by the OneCraft team. Last checked .