A Review of Conceptual Approaches and Empirical Evidence on Probability and Nonprobability Sample Survey Research

A Review of Conceptual Approaches and Empirical Evidence on Probability and Nonprobability Sample Survey Research
Author/editor: Cornesse, C, Blom, A, Dutwin, D, Krosnick, J, De Leeuw, E, Legleye, S, Pasek, J, Pennay, D, Phillips, B, Sakshaug, J, Struminskaya, B & Wenz, A.
Published in (Monograph or Journal): Journal of Survey Statistics and Methodology
Publisher: Oxford Academic
Year published: 2020
Volume no.: 8
Issue no.: 1
Page no.: 4 - 36

Abstract

There is an ongoing debate in the survey research literature about whether and when probability and nonprobability sample surveys produce accurate estimates of a larger population. Statistical theory provides a justification for confidence in probability sampling as a function of the survey design, whereas inferences based on nonprobability sampling are entirely dependent on models for validity. This article reviews the current debate about probability and nonprobability sample surveys. We describe the conditions under which nonprobability sample surveys may provide accurate results in theory and discuss empirical evidence on which types of samples produce the highest accuracy in practice. From these theoretical and empirical considerations, we derive best-practice recommendations and outline paths for future research

Updated:  26 February 2020/Responsible Officer:  Centre Director/Page Contact:  CASS Marketing & Communications