Random Sampling and Bias
A free Statistics and Data Analysis lesson from the “Collecting Data” unit, with a worked example and practice problems including step-by-step solutions.
Random sampling gives every member of a population a fair chance to be selected. Bias happens when the sampling method systematically favors some outcomes over others. This lesson builds the habit of reading the context first, choosing the right statistical tool, calculating carefully, and then writing what the result means. By the end, students should be able to do the computation and explain why that computation answers the question.
What you'll learn
- Explain why random sampling matters
- Identify common sources of bias
- Connect representative samples to generalization
Worked example
Problem. A sample statistic describes:
- Worked Example: First identify exactly what the question is asking: A sample statistic describes:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- A statistic is computed from sample data.
- A parameter describes the population.
Answer: the sample
Practice problems
1. Practice case A: A sample statistic describes:
Choices: the null hypothesis · the sample · the entire population with certainty · the placebo
Show solution
- Warm-up: First identify exactly what the question is asking: A sample statistic describes:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- A statistic is computed from sample data.
- A parameter describes the population.
- Verify the selected choice by checking that it satisfies the original prompt and that the other choices fail the same test.
Answer: the sample
2. Practice case B: Random sampling mainly helps a study:
Choices: remove every outlier · make all variables categorical · generalize to a population · prove causation by itself
Show solution
- Warm-up: First identify exactly what the question is asking: Random sampling mainly helps a study:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- Random sampling helps the sample represent the population.
- That supports generalizing results.
- Verify the selected choice by checking that it satisfies the original prompt and that the other choices fail the same test.
Answer: generalize to a population
3. Practice case C: Voluntary response samples are risky because:
Choices: they are always too large · they have no variables · they prove causation · people with strong opinions may be overrepresented
Show solution
- Warm-up: First identify exactly what the question is asking: Voluntary response samples are risky because:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- Voluntary samples depend on who chooses to respond.
- That can create bias.
- Verify the selected choice by checking that it satisfies the original prompt and that the other choices fail the same test.
Answer: people with strong opinions may be overrepresented
4. Practice case D: Random assignment mainly helps an experiment:
Choices: compare treatments fairly · choose a representative sample · increase every p-value · turn a table into a graph
Show solution
- Warm-up: First identify exactly what the question is asking: Random assignment mainly helps an experiment:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- Random assignment balances other factors across treatment groups.
- That supports fair treatment comparison.
- Verify the selected choice by checking that it satisfies the original prompt and that the other choices fail the same test.
Answer: compare treatments fairly
5. Practice case E: A placebo is:
Choices: a residual from a model · a fake treatment used for comparison · the sample mean · the population size
Show solution
- Warm-up: First identify exactly what the question is asking: A placebo is:
- Compare each answer choice with the calculation or rule, and eliminate choices that do not satisfy the condition.
- A placebo looks like a treatment but lacks the active ingredient.
- It helps measure expectation effects.
- Verify the selected choice by checking that it satisfies the original prompt and that the other choices fail the same test.
Answer: a fake treatment used for comparison
Practice this interactively with instant feedback and an AI tutor.
Practice Random Sampling and Bias Take the free placement check