Survey validity is the extent to which a survey instrument measures what it is intended to measure - that the questions accurately capture the construct of interest and that scores reflect the true underlying attribute being studied.
Types of Validity in Survey Research
Validity in survey research takes several distinct forms:
- Face validity - the instrument appears, on its surface, to measure the intended construct. The weakest form of validity but the minimum threshold for most applied surveys.
- Content validity - the instrument covers the full domain of the construct being measured, without omitting important dimensions.
- Construct validity - the scores on the instrument relate to other measures in theoretically predicted ways.
- Criterion validity - the instrument predicts or correlates with an external criterion measure. Concurrent validity means it correlates with a present criterion; predictive validity means it predicts a future outcome.
- Discriminant validity - the instrument measures its intended construct distinctly from other related constructs.
Validity vs Reliability
Validity and reliability address different measurement quality concerns. Reliability asks whether the instrument produces consistent results. Validity asks whether consistent results actually reflect the intended construct.
A survey can be reliable without being valid. A bathroom scale that consistently reads 5kg too high is reliable but not valid. In survey research, a measure of "customer satisfaction" that actually captures response speed to a specific support channel may be highly reliable but has low construct validity as a measure of overall satisfaction.
How to Establish Validity
For validated research instruments used in academic or clinical research, establishing validity requires a formal validation study, expert review of content coverage, and factor analysis to confirm the internal structure.
For applied survey research, face validity and content validity are the minimum standards. Expert review of the instrument by a subject matter expert is the most practical validation approach. The AI Survey Advisor provides automated review of instrument wording for issues undermining face and content validity.
Frequently Asked Questions
Reliability refers to consistency of measurement. Validity refers to accuracy - whether the survey measures what it claims to measure. A survey can be reliable without being valid: consistently measuring the wrong thing is reliable but not valid.
Face validity is the most basic form of validity: the survey appears, on its surface, to measure the intended construct. It is assessed through simple review. Face validity alone is insufficient for academic research but is the minimum standard for most applied surveys.
Construct validity is established through convergent and discriminant validity testing. Convergent validity confirms the measure correlates with other measures of the same construct. Discriminant validity confirms it does not correlate too highly with measures of different constructs.
No. Translated instruments, adapted instruments, or instruments deployed with significantly different populations from those used in the original validation study may not retain their original validity properties.
Deploy Your Survey to 27+ Platforms
Convert Word, PDF, and Excel survey instruments to Qualtrics, REDCap, SurveyMonkey, and more. No manual programming required.
Start Converting Free