Learn probability vs. non-probability sampling, when to use each, and how to reduce bias—plus tools to size your sample and reach target audiences.

SurveyMonkey logo

Summary

  • Sampling is a critical process in market research that uses a smaller subset of respondents to draw reliable conclusions about a larger target population, helping organizations save time and resources.
  • Sampling methods are broadly divided into two categories: probability sampling, which uses random selection to achieve statistically generalizable results, and non-probability sampling, which relies on convenience or specific criteria to gather practical, exploratory insights.
  • Choosing the right approach requires balancing research goals, budget, and the need for precision, often utilizing tools like sample size calculators to determine the optimal number of participants needed to achieve trustworthy data.

Good research starts with a good sample. The group you choose to survey shapes everything that follows, from how accurate your results are to whether you're hearing from the people who actually matter to your business. Sampling connects a small group of responses to a larger target audience, helping you save time, stretch your budget, and eliminate guesswork.

Sampling methods fall into two primary categories: probability sampling and non-probability sampling.

  • Probability methods are a random sample that give every individual a known, non-zero chance of selection, offering measurable confidence and statistically generalizable results.
  • Non-probability methods are a representative sampling that rely on convenience, quotas, or expert judgment, giving you practical reach when strict representativeness is hard or unnecessary.

This guide breaks down the essential sampling methods, clear real-world examples, and a decision framework to help you choose the right approach, so you can build a sampling plan you stand behind and insights you can trust.

Sampling utilizes data from a small group, such as a simple random sample, and allows marketers to draw conclusions about a much larger target population.

Before you choose a method, align on three basics:

  • Population: the full group you want to learn about (for example, all US adult toothpaste buyers).
  • Sampling frame: the practical list you’ll draw names from (e.g., your CRM list of past buyers or a national panel of verified consumers).
  • Sample: the subset of people you actually invite to take the survey.

Why sample at all? A full census is rarely practical. It’s too slow, expensive, and hard to control for quality. Sampling lets you move quickly and still make reliable decisions. Say a regional coffee chain wants to vet a new roast. Instead of surveying every loyalty member, they can sample key segments by region or age, field in a week, and launch with confidence.

Use SurveyMonkey’s Audience Panel to get insights from your target audience.

The various types of sampling methods will generally fall into one of two categories. The first category is random sampling while the second category is representative sampling.

A random sample is a sample of randomly selected individuals, designed to represent the population as a whole. Simple random samples can help companies and other organizations draw broad conclusions about people in general.

If a company is trying to sell a product that essentially everyone might use, such as toothpaste, a simple random sample can help them draw broad conclusions. What flavors of toothpaste do people typically prefer? When do people typically brush their teeth? What type of toothbrush do most people use? These are questions that can be effectively answered by asking a wide range of people for their opinion, rather than limiting the survey to a deliberately narrow group.

In contrast, researchers using representative sampling don’t want a random sample of all people. Instead, they want a random sample of people who are representative of a specific group. For example, if a company is selling a product that only some people use, such as skiing equipment, they’d want a sample of individuals who actually use that particular product.

Representative samples can be broken down in myriad different ways. In the example above, “people who ski” could be a distinctive group that helps filter the broader population. In other instances, you might consider breaking the population down by age, demographics, location, income, hobbies, profession, or other traits. As long as you can find enough survey takers to generate statistically significant conclusions, you will have a considerable amount of flexibility when creating a representative group.

Use SurveyMonkey Audience to tap into demographic balancing or choose more flexible targeting.

Slider choosing gender percentage targeting

Probability sampling is a type of sampling in which every single member of a group has a non-zero probability of being selected for the survey. Probability sampling can still exist within a filtered group (such as American adults), as long as every representative of this subgroup has a chance of being selected.

Here are the types of probability sampling methods.

Sampling methodDescriptionBest used forExample
Simple Random Sampling (SRS)Every person in the sampling frame has an equal, known chance of selection (e.g., using a random number generator).Broad-appeal products/services requiring clean inference to the entire frame with minimal assumptions.Assigning every employee an ID number and using a random number generator to select 50 staff members for a survey.
Systematic SamplingStarts at a random point on an ordered list and selects every nth person after that.Large, organized lists free of hidden patterns (e.g., customer IDs, employee rosters).Exporting 200,000 loyalty members and inviting every 200th ID to collect 1,000 survey responses.
Stratified Random SamplingDivides the frame into distinct subgroups (strata) by traits (e.g., region, plan tier) and randomly samples within each group.Lowering variance and ensuring proportional representation across key population segments.A ski brand dividing target markets into West, Midwest, and Northeast regions, then randomly sampling within each.
Cluster SamplingDivides the population into naturally occurring groups (clusters), then randomly selects entire clusters (or samples within selected clusters).Geographically dispersed populations where listing every individual is difficult or costly.A national study randomly selecting school districts (stage 1), then schools (stage 2), then teachers (stage 3).

Simple random sampling is a probability sampling method where every individual in the target population has an equal, known chance of being selected.

It is an ideal choice when you have a clean list of your entire population and want to make statistically valid generalizations with minimal assumptions, though it requires an up-to-date sampling frame and can be operationally intensive to execute.

You are evaluating employee satisfaction across a company with 500 staff members. To select a fair sample, you assign a unique identification number (1–500) to each employee and use a random number generator to pick 50 numbers.

Everyone on the payroll has an identical chance of inclusion, but if certain departments have lower response rates, you may still face non-response bias.

Systematic sampling is a sampling method that  starts from a random point in your list and then selects every nth person after that.

This is a quick and operational way to pull an evenly spaced sample when your list is large, organized, and free of hidden patterns, but if your list is sorted by a variable related to your research outcome (like purchase frequency), it can unintentionally bias the results.

Systematic samples are at risk for periodicity (pattern bias) if the underlying list has a recurring cycle.

You are researching customer preferences for a retail brand, so you export an ordered list of 200,000 loyalty members and invite every 200th member ID to gather 1,000 completed surveys.

This is an efficient way to pull a sample, but if the database happens to be sorted by purchase frequency or sign-up date, selecting at fixed intervals means your sample may not be representative of all loyalty members.

A stratified random sample divides the population into meaningful subgroups (strata)—such as region, plan tier, or company size—and then randomly selects participants from within each group.

This is a powerful way to lower variance and guarantee representation across key subgroups, but strata must be mutually exclusive and clearly defined to avoid overlap.

Stratified samples are at risk for misclassification bias if respondents are placed into the wrong groups or if strata boundaries are poorly defined.

You are researching helmet preferences for a ski equipment brand across different geographic markets, so you divide your customer database into regional strata (West, Midwest, and Northeast) and randomly sample within each group.

This ensures every region is represented, but if your regional classifications overlap or if you fail to maintain random selection within each stratum, your sample will not be representative of the overall customer base.

Cluster sampling is a type of sampling that divides the population into naturally occurring groups called clusters—such as stores, schools, or cities—and randomly selects entire clusters to survey the people within them.

This is a cost-effective way to conduct multi-market testing when recruitment or travel costs are high, but because individuals within the same cluster tend to share similar traits, it requires larger sample sizes to preserve precision.

Cluster samples are at risk for cluster bias if the selected groups are not representative of the broader population.

You are evaluating shopper reactions to a new display for a national retail chain, so you randomly select 30 store locations and survey the shoppers inside those specific stores.

This simplifies data collection, but because shoppers at those 30 locations may share unique regional or demographic traits, the sample may not be representative of all customers nationwide.

A multistage sample selects participants in multiple sequential steps, first choosing larger clusters and then randomly sampling individuals from within those selected groups.

This is a practical and scalable way to conduct large-scale studies across geographically dispersed populations, but each stage of selection adds potential sampling variation. Multistage samples are at risk for compounded sampling error if randomization is not strictly maintained at every single level.

You are researching teacher satisfaction across a national school network, so you first randomly select a set of school districts, then randomly select specific schools within those districts, and finally survey teachers within those chosen schools.

This makes fieldwork manageable without a master list of every teacher, but if any selection stage introduces bias, the final sample will not be representative of the entire national teaching staff.

While probability sampling can be used to draw conclusions from random (though sometimes slightly modified) groups, non-probability sampling uses groups that are a bit more deliberately structured. 

Non-probability sampling can help reduce random biases and, in many instances, ensure that key portions of a broader population are included within the sampled population. 

There are five primary types of non-probability sampling methods.

Sampling methodDescriptionBest used forExample
Convenience SamplingRecruits individuals who are easiest to reach or most readily available to the researcher.Quick pulse checks, early concept testing, or website feature scoping.Intercepting visitors on a website to gather instant feedback on a new homepage layout.
Judgmental (Purposive) SamplingResearchers deliberately hand-pick participants based on specific criteria, traits, or expertise.Qualitative depth, niche B2B roles, or rare customer cohorts.Selecting 30 hospital administrators with health-record purchasing authority for in-depth feedback.
Opt-In SamplingParticipants self-select to join the study after seeing an open call for responses.Gathering qualitative ideas and feedback from highly engaged users.Placing a survey link in an email newsletter asking power users to evaluate a new software feature.
Snowball SamplingExisting participants refer or recruit acquaintances who meet the study's specific criteria.Reaching hard-to-find, hidden, or niche populations.Interviewing five cybersecurity leads and asking each to refer two peers in threat intelligence.
Quota SamplingSets specific target counts for subgroups (e.g., age, gender, income) and recruits non-randomly until filled.Approximating population balance when true probability sampling is unfeasible or too costly.Conducting a consumer study requiring 200 responses split evenly across age bands and income tiers.

Quota sampling is a type of sampling that sets specific demographic or behavioral targets, such as 30% ages 18–34, 40% ages 35–54, and 30% ages 55+, and recruits participants non-randomly until each quota is filled.

This is a fast and flexible way to get directional reads that mirror your market's top-line demographics for brand trackers or concept tests, but because recruitment within each quota is not random, it cannot produce statistically generalizable results.

Quota samples are at risk for selection bias and sampling bias because researchers often recruit the most accessible individuals within each subgroup.

You are testing a new advertising campaign for a streaming service, so you set target quotas for age and region to ensure each group is proportionally represented in your survey responses.

This guarantees that your sample matches your target demographic mix, but as participants within each age and regional bracket self-select or are recruited on a first-come basis, the sample is not representative of all streaming subscribers.

Convenience sampling is a sampling method that recruits from easy-to-reach sources, like intercepts, website pop-ups, email lists, or social followers.

This is an easy and inexpensive way to gather initial data, conduct early-stage pilots, or run quick temperature checks, but there is no way to tell if the sample is representative of the population, so it can’t produce generalizable results.

Convenience samples are at risk for both sampling bias and selection bias because your most reachable customers may differ significantly from the rest of your target market.

You are gathering fast feedback on potential new menu items for a regional café chain, so you post a survey link on the homepage of your loyalty app for one afternoon.

This is a convenient way to collect immediate user input, but as you only surveyed active loyalty app users who logged in during that specific timeframe, the sample is not representative of all café customers.

Snowball sampling is a sampling method in which qualified respondents refer acquaintances from their own personal or professional networks who also meet the study's entry criteria.

This is a practical way to reach hidden, sensitive, or hard-to-find populations—such as professionals in rare roles or micro-communities—where no central list exists, but because referrals stay within connected social networks, it cannot produce generalizable results. 

Snowball samples are at risk for both sampling bias and network homophily bias because participants naturally recruit people similar to themselves.

You are studying decision-making processes among early-stage biotech founders, so you interview five founders in your network and ask each of them to refer two peers from their own founder networks.

This helps you access a rare, closed group of professionals, but because the new participants are tied to the original contacts' professional circles and geographical hubs, the sample is not representative of all biotech founders.

A purposive sample, or judgement sampling, involves intentionally recruiting participants with specific expertise, traits, or roles because their input is uniquely valuable to the research topic.

This is an effective way to gather specialized insights for expert interviews or B2B concept tests where deep domain knowledge matters more than statistical representativeness, but because participants are hand-picked, it cannot produce generalizable results across a broader audience.

Purposive samples are at risk for both researcher bias and selection bias based on how inclusion criteria are defined and applied.

You are evaluating a new vendor-management workflow for aerospace companies, so you hand-pick and interview 15 senior procurement leaders in the aerospace industry.

This ensures every respondent has the necessary decision-making authority to give actionable feedback, but because you only selected specific high-level executives, the sample is not representative of all employees or managers in the aerospace sector.

Opt-in sampling relies on volunteers who proactively join research panels or sign up for surveys, often incentivized by rewards or personal interest.

This is a highly efficient and cost-effective way to quickly reach large audiences or specialized target niches, but because participants choose whether or not to participate, it cannot produce statistically generalizable results.

Opt-in samples are at risk for both self-selection bias and sampling bias toward hyper-engaged users or "professional respondents."

You are researching public opinion on a proposed tax law, so you post an interactive poll on a news website’s homepage allowing any visitor to voluntarily submit their views.

This is an easy way to gather a high volume of responses quickly, but as you only surveyed people who visited that specific website and chose to participate, the sample is not representative of the broader population.

The fundamental difference between probability and non-probability sampling lies in how participants are selected.

DimensionProbability samplingNon-probability sampling
Selection mechanismRandom selection (every unit has a known, non-zero chance).Non-random selection (driven by accessibility, judgment, or quotas).
Primary objectiveProduce statistically generalizable findings about a target population.Gather quick insights, test hypotheses, or reach hard-to-access groups.
Sampling bias riskLow (randomization minimizes subjective researcher bias).High (vulnerable to selection, convenience, and self-selection bias).
Statistical validityHigh (enables margin of error and confidence interval calculations).Low (cannot calculate statistical margin of error or population variance).
Population list needed?Yes, typically requires a comprehensive sampling frame.No, can be conducted without a formal population list.
Cost & timeHigher cost and longer execution time due to frame setup and tracking.Lower cost and faster turnaround time.
Common methodsSimple Random, Systematic, Stratified, Cluster.Convenience, Judgmental (Purposive), Quota, Snowball, Opt-In.
Best used forDefinitive market research, opinion polling, and academic studies.Exploratory research, pilot testing, UX testing, and niche B2B studies.

Selecting the right sampling method depends on balancing your specific research goals, available budget, and the need for statistical generalizability.

Use the decision matrix below to map your research objective to the recommended sampling method and understand the primary rationale behind each choice.

Research goal Recommended methodCategoryWhy choose this method
Make statistically valid claims about a general population (e.g., broad consumer preference)Simple random sampling (SRS)ProbabilityGives every individual an equal chance of selection, minimizing selection bias and allowing clean statistical inference.
Sample quickly from a large, organized list (e.g., CRM records, employee rosters)Systematic samplingProbabilityFaster and easier to execute than full SRS while maintaining random spacing across the entire list (provided no periodic patterns exist).
Ensure key subgroups are represented proportionally (e.g., comparing regions, income tiers)Stratified random samplingProbabilityGuarantees representation across key strata and reduces sampling variance, giving higher precision with smaller sample sizes.
Study geographically dispersed populations efficiently (e.g., nationwide school districts, hospitals)Cluster samplingProbabilitySaves significant field costs by sampling entire naturally occurring groups or areas instead of creating a full national list of individuals.
Run quick pulse checks or early usability tests on a tight budgetConvenience samplingNon-probabilityMaximizes speed and minimizes cost when speed matters more than strict statistical representativeness.
Gather deep qualitative insights from specialized experts or rare roles (e.g., B2B decision-makers)Judgmental (purposive) samplingNon-probabilityEnsures every participant meets strict qualifications so resources aren't wasted on non-relevant respondents.
Collect feedback from your most engaged or enthusiastic usersOpt-in samplingNon-probabilityCaptures high-detail qualitative feedback from motivated users willing to share ideas.
Reach hidden, hard-to-find, or niche populations (e.g., specialized engineers, rare condition patients)Snowball samplingNon-probabilityLeverages existing network trust and peer referrals to access populations without an available sampling frame or list.
Approximate population demographics when random sampling isn't feasibleQuota samplingNon-probabilityEnsures balanced demographic proportions (e.g., age, gender mix) without requiring a comprehensive random list frame.

When it comes to survey precision, three numbers do most of the work:

  • Sample size (n): the more people you survey, the smaller your sampling error
  • Confidence level: how sure you want to be that your results reflect the real population—commonly 90% or 95%
  • Margin of error (MOE): the wiggle room around your results (for example, ±3 points)

As your sample size grows, your margin of error shrinks, but not in a straight line. Doubling your responses doesn’t cut the margin of error in half.

Example: At a 95% confidence level, if 30% of respondents say they’d “definitely buy,”

  • n = 400 gives a margin of error of about ±4.8 points.
  • n = 1,000 narrows it to about ±3.1 points.

Bigger samples give tighter estimates, but after a point, you’re spending more for only slightly more precision. The key is to find a sample size that’s big enough to trust and small enough to field efficiently.

Use our sample size calculator to back into n for your target MOE, then verify with the margin of error calculator.

Survey sampling with a market research panel, like SurveyMonkey Audience or our integrated global panel, makes it easy to reach verified, high-quality respondents fast. Panels give you control over who you ask, the questions you pose, and how results are segmented across demographics, roles, or regions.

You can build studies around countless dimensions: age, geography, industry, job title, company size, and more. These panels power insights across everything from market sizing and product testing to brand tracking and consumer behavior. By using a trusted panel, you get reliable data from real people and a clearer view of your broader market.

Each sampling method has trade-offs. A simple random sample minimizes bias and supports broad conclusions, but it can be slow or costly. Convenience or quota sampling moves faster, but you’ll need to watch for overrepresented groups. The right method depends on your goals, your audience, and your timeline.

Start by clarifying what you want to learn and who you need to hear from. Then factor in time, budget, and accessibility. With planning and the right tools, you can choose a sampling method that fits your project and your precision needs.

To make it easier, use our sample size calculator, margin of error calculator, and survey templates to design a study you can stand behind. When you’re ready to reach verified respondents, tap into SurveyMonkey Audience, a network of more than 80 million people ready to share feedback that helps you make confident, data-driven decisions.

Reach the exact people you need with the powerful targeting capabilities of SurveyMonkey Audience.

Collect market research data by sending your survey to a representative sample.

Test creative or product concepts using an automated approach to analysis and reporting.