Straight-lining (also called flatlining) is a form of response bias where a survey respondent selects the same answer option for every item in a matrix or series of questions without reading each item individually, significantly reducing data quality.
Why Straight-Lining Happens
Straight-lining is primarily driven by survey fatigue and cognitive overload. When respondents encounter a long matrix question with many items, the effort of reading and evaluating each item independently becomes high. The path of least resistance is to select the same response for all items. This is a form of satisficing - meeting a minimum threshold of response effort rather than providing accurate answers.
Other contributing factors include a lack of motivation, time pressure, and cognitive difficulty with items or scale labels - making consistent selection easier than careful evaluation.
How to Detect Straight-Lining
Straight-lining is identified by comparing responses across all items in a matrix. Detection approaches include:
- Standard deviation check - respondents with a standard deviation of zero across all matrix items have straight-lined. Low standard deviation (below 0.5 on a 5-point scale) is a flag for further review.
- Reverse-item check - including items worded in the opposite direction from others in the battery. A respondent agreeing with both a positively and negatively worded version of the same item has likely not read carefully.
- Completion time - responses completed faster than a reasonable minimum reading time are flagged as potentially inattentive.
- Attention check questions - items with a clearly correct answer hidden in the survey to confirm the respondent is reading carefully.
Design Changes That Reduce Straight-Lining
The most effective design change is reducing matrix length. Matrices with more than eight to ten items show significantly higher straight-lining rates. Split long matrices into multiple shorter ones separated by other question types. Adding variety in question format between matrices gives respondents cognitive breaks that reset attention.
Including at least two reverse-worded items in any matrix longer than five items serves as both a detection mechanism and a deterrent. Randomising item order within matrices removes the predictability that makes consistent selection easier.
Frequently Asked Questions
Studies estimate that between 5% and 15% of online survey respondents show some degree of straight-lining behaviour, with higher rates in longer surveys and surveys with large matrix questions.
Yes, in most cases. Straight-lined responses do not reflect genuine opinions and including them distorts results. The standard practice is to flag suspected straight-liners and exclude them from analysis, reporting the exclusion rate in the methodology section.
Qualtrics offers response time tracking and attention check question support. Straight-lining detection based on standard deviation requires post-collection analysis in Qualtrics Crosstabs, exported data, or statistical software.
Write two or three items that express the opposite meaning of positive items in the battery. A respondent who agrees with both a positively and negatively worded version of the same item is likely straight-lining.
Deploy Your Survey to 27+ Platforms
Convert Word, PDF, and Excel survey instruments to Qualtrics, REDCap, SurveyMonkey, and more. No manual programming required.
Start Converting Free