20 medium SAT Evaluating statistical claims questions
Medium is where most scores are actually won and lost. These questions are not tricky for the sake of it, but every one of them has a wrong answer built to catch a specific shortcut.
Every question below is a real item from the SAT Climb bank, tagged medium by the same difficulty model the app uses to build your practice. Pick an answer before you open the explanation.
Math · Problem-Solving and Data Analysis~0.4 — rare, but easy points per testMedium tier
A university library surveyed 180 students who had checked out textbooks during the first week of the semester about their study habits. Of those surveyed, 74% reported studying in the library at least twice per week. Based on the results, which of the following is the largest population to which the results can be generalized?
Show the answer and explanation
Why D is right
The sample was drawn only from students who checked out textbooks during the first week, representing students who prepare early for courses. These students may have different study habits than other students. The results can only be generalized to students who checked out textbooks during the first week of the semester.
Why the others are wrong
AThis overgeneralizes to all university students. Students who check out textbooks early may be more studious than the general student population.
BThis confuses the measured outcome (library study frequency) with the sampled population (early textbook borrowers).
CThis extends to all library users when the sample only included those who checked out textbooks in the first week, excluding students who only use study spaces or computers.
Question 2Medium
A sociologist surveyed 300 college students and found that students who participated in at least one extracurricular activity reported higher overall life satisfaction than students who did not participate in any extracurricular activities. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This was an observational study that measured existing participation patterns and self-reported satisfaction without randomly assigning students to participate or not participate in activities. The study establishes an association for the surveyed students but cannot determine causation.
Why the others are wrong
AThis overgeneralizes from the surveyed students to all college students and incorrectly asserts causation from observational data.
CThis ignores confounding factors such as academic performance, social support networks, financial security, and mental health that also influence life satisfaction.
DThis incorrectly claims causation from an observational study. Students who choose to participate in activities may differ in other ways that affect life satisfaction.
Question 3Medium
A market research firm surveyed 600 shoppers by interviewing people leaving a single grocery store location. The survey estimated that 55% of shoppers prefer organic produce, with a margin of error of±4%.
If the same survey were conducted by randomly selecting 600 shoppers from customer records across all store locations in the chain instead of interviewing people at one location, what would happen to the margin of error?
Show the answer and explanation
Why D is right
Surveying shoppers at only one location creates a biased sample because that location may attract customers with different preferences than the overall customer base. Random selection across all locations provides a more representative sample and decreases the margin of error.
Why the others are wrong
AWhile the sample size remains constant, the sampling method matters. Random sampling across all locations reduces bias compared to single-location sampling.
BThis incorrectly suggests that geographic diversity increases error. A more representative sample across locations reduces bias and decreases margin of error.
CThis applies an arbitrary numerical relationship. While the improved method does decrease margin of error, it is not necessarily cut in half.
Question 4Medium
A researcher surveyed 200 adults who reported sleeping fewer than 6 hours per night and 200 adults who reported sleeping 7 to 9 hours per night. The researcher found that those who slept fewer than 6 hours per night had a higher incidence of cardiovascular disease. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This was an observational study in which the researcher surveyed adults about existing sleep habits and health outcomes. Observational studies can identify associations between variables but cannot establish causation because other factors may influence both sleep duration and cardiovascular disease.
Why the others are wrong
AThis conclusion claims causation, but the observational design does not allow for causal claims since participants were not randomly assigned to sleep duration groups.
CThis overgeneralizes the finding to claim that all adults in the group will develop the disease, when the study only found higher incidence, not universal occurrence.
DThis ignores potential confounding variables such as diet, exercise, stress, or genetic factors that could influence both sleep patterns and cardiovascular disease.
Question 5Medium
A college administrator surveyed 150 students who visited the campus health center during flu season about their vaccination status. Of those surveyed, 78% reported having received a flu vaccine. Based on the results, which of the following is the largest population to which the results can be generalized?
Show the answer and explanation
Why B is right
The sample consists only of students who visited the campus health center during flu season, which is not representative of all students at the college. Therefore, the results can only be generalized to the population from which the sample was drawn: students who visited the campus health center during flu season.
Why the others are wrong
AThis overgeneralizes the results. Students who visit the health center during flu season may have different vaccination rates than the general student population.
CThis extends the generalization beyond the college where the survey was conducted, which is not justified by the sample.
DThis confuses the outcome variable (vaccination status) with the population. The survey sampled health center visitors, not vaccine recipients.
Question 6Medium
A researcher surveyed 200 adult residents in a coastal city and found that those who reported eating fish at least three times per week had, on average, lower resting heart rates than those who reported eating fish less frequently. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This was an observational study in which the researcher measured existing behaviors and outcomes without randomly assigning participants to treatment groups. Observational studies can only establish association, not causation, and conclusions are limited to the population actually surveyed.
Why the others are wrong
AThis incorrectly claims causation from an observational study. Without random assignment, confounding variables could explain the observed relationship.
CThis overgeneralizes beyond the study population of coastal city residents to all adults, which the study design does not support.
DThis ignores potential confounding variables. Factors such as overall diet quality, exercise habits, or socioeconomic status could explain the observed association.
Question 7Medium
A public health researcher reviewed medical records for 800 adults and found that those who regularly consumed coffee had a lower incidence of type 2 diabetes than those who did not consume coffee. Which conclusion is best supported by the study design?
Show the answer and explanation
Why C is right
The researcher conducted an observational study by reviewing existing medical records without manipulating coffee consumption or randomly assigning participants. This design supports identifying an association between coffee consumption and diabetes incidence but not a causal relationship.
Why the others are wrong
AThis ignores potential confounding variables such as diet quality, exercise habits, body weight, genetics, and other lifestyle factors that could influence diabetes risk.
BThis asserts causation from observational data, which is not justified because the researcher did not control who consumed coffee or account for all potential confounders.
DThis makes an absolute overgeneralization that all coffee drinkers will avoid diabetes, when the study only found lower incidence on average in a specific group of 800 adults.
Question 8Medium
A retail store manager surveyed 250 customers who used a loyalty card during December about their shopping preferences. Of those surveyed, 88% reported shopping at the store at least once per month. Based on the results, which of the following is the largest population to which the results can be generalized?
Show the answer and explanation
Why C is right
The sample consists only of loyalty card users during December, a holiday shopping month. These customers are likely more frequent shoppers than non-loyalty cardholders or customers surveyed at other times. The results can only be generalized to customers who used a loyalty card during December at the retail store.
Why the others are wrong
AThis overgeneralizes to all store customers. Loyalty card users in December may be more frequent shoppers than occasional or non-loyalty customers.
BThis extends the generalization far beyond the specific store to all regional shoppers, which is not justified by the sample.
DThis confuses the measured outcome (shopping frequency) with the sampled population (December loyalty card users).
Question 9Medium
A researcher surveyed 200 adults who regularly visit a particular gym and found that those who reported spending more time exercising each week also reported lower stress levels. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This was an observational study where the researcher surveyed existing gym members about their exercise habits and stress levels. Because no random assignment or manipulation of variables occurred, the study can only support a conclusion about association, not causation.
Why the others are wrong
AThis incorrectly claims causation from an observational study. Without random assignment to exercise conditions, confounding variables could explain the relationship.
CThis overgeneralizes beyond the study population. The survey only included adults at one particular gym, so conclusions cannot be extended to all adults.
DThis ignores potential confounding variables. Other factors such as diet, sleep, or socioeconomic status could influence both exercise time and stress levels.
Question 10Medium
A technology company randomly assigned 120 employees to either work from home or work in the office for 3 months. At the end of the period, employees who worked from home reported higher job satisfaction scores than employees who worked in the office. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This randomized experiment assigned employees to work locations, allowing for causal conclusions within the studied population. Random assignment controls for differences between employees, establishing that working from home caused higher satisfaction for those studied.
Why the others are wrong
AThis uses association language appropriate for observational studies, but the randomized design supports a stronger causal conclusion for the employees in the study.
CThis ignores other factors affecting job satisfaction such as compensation, management style, workload, and career development opportunities, even though the study isolated the location effect.
DThis overgeneralizes from 120 employees at one company to all employees without considering differences in job types, personalities, or home situations.
Question 11Medium
A music streaming service surveyed 300 users who created playlists labeled as classical music about their listening preferences. Of those surveyed, 68% reported listening to music for more than 2 hours per day. Based on the results, which of the following is the largest population to which the results can be generalized?
Show the answer and explanation
Why B is right
The sample was drawn specifically from users who created classical music playlists, a self-selected subset with particular music preferences. The results can only be generalized to users who created playlists labeled as classical music, not to all service users or all classical music listeners.
Why the others are wrong
AThis overgeneralizes to all service users. Classical music playlist creators may have different listening habits than users with other music preferences.
CThis extends beyond the specific streaming service to all classical music listeners, and includes people who don't use the service.
DThis confuses the measured outcome (listening duration) with the sampled population (classical playlist creators).
Question 12Medium
An agricultural scientist randomly assigned 100 corn plants to receive either a new irrigation system or a standard irrigation system. After one growing season, plants that received the new irrigation system had greater average height than plants that received the standard system. Which conclusion is best supported by the study design?
Show the answer and explanation
Why D is right
This was a randomized experiment with random assignment to irrigation systems. Random assignment controls for confounding variables such as soil quality and genetic variation, allowing a causal conclusion about the irrigation system's effect.
Why the others are wrong
AThis choice uses association language inappropriate for a randomized experiment. The study design with random assignment supports a causal conclusion, not merely an associational one.
BRandom assignment ensures that soil quality and other confounding factors are distributed evenly between groups, so soil differences cannot explain the results.
CThis choice overgeneralizes to all corn plants in any environment when the study examined 100 plants under specific conditions that may not represent all growing environments.
Question 13Medium
A medical researcher randomly assigned 240 patients with insomnia to receive either a new sleep medication or a standard sleep medication for 8 weeks. Patients who received the new medication reported better sleep quality than those who received the standard medication. Which conclusion is best supported by the study design?
Show the answer and explanation
Why C is right
This randomized experiment assigned patients to different medications, allowing the study to establish a causal relationship. Random assignment controls for confounding variables, showing that the new medication caused better sleep quality compared to the standard medication for the patients studied.
Why the others are wrong
AThis uses association language appropriate for observational studies, but the randomized experimental design actually supports a causal conclusion.
BThis overgeneralizes from 240 study patients to all people with insomnia, which is not justified by the study design.
DThis ignores other factors that influence sleep quality, such as stress levels, sleep environment, and lifestyle habits, even though the study isolated the medication effect.
Question 14Medium
A fitness app company sent a survey to 500 users who had logged workouts for at least 20 days in the previous month. Of those surveyed, 92% reported being satisfied with the app. Based on the results, which of the following is the largest population to which the results can be generalized?
Show the answer and explanation
Why C is right
The sample consists only of frequent users who logged at least 20 workouts in the previous month. These active users are likely to have different satisfaction levels than occasional or inactive users. The results can only be generalized to users who logged workouts for at least 20 days in the previous month.
Why the others are wrong
AThis overgeneralizes to all app users. The sample excluded less active users, who may have different satisfaction levels.
BThis extends beyond the specific app studied to all fitness apps, which is not justified by the sample.
DThis confuses the outcome being measured (satisfaction) with the population sampled (frequent users of this specific app).
Question 15Medium
An economist analyzed employment data from 400 companies and found that companies with flexible work-from-home policies had lower employee turnover rates than companies without such policies. Which conclusion is best supported by the study design?
Show the answer and explanation
Why C is right
This was an observational study analyzing existing company policies and turnover data without randomly assigning companies to implement or not implement flexible work policies. The study can establish an association for the companies analyzed but cannot determine causation.
Why the others are wrong
AThis ignores confounding factors such as compensation levels, company culture, management quality, and career development opportunities that also affect employee turnover.
BThis overgeneralizes from the 400 companies analyzed to all companies and incorrectly claims causation from an observational study.
DThis incorrectly asserts causation from observational data. Companies that offer flexible policies may differ in other ways that affect turnover.
Question 16Medium
A researcher surveyed 200 adults who regularly drink coffee and found that those who reported drinking more than 3 cups per day also reported higher productivity levels at work compared to those who drank fewer cups. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
This was an observational study where the researcher surveyed existing coffee drinkers without manipulating their consumption. The study can only establish an association between coffee consumption and self-reported productivity among the surveyed adults, not a causal relationship.
Why the others are wrong
AThis conclusion asserts causation, but the observational design does not control for confounding variables and cannot establish that coffee causes productivity changes.
CThis overgeneralizes to all adults when the study only surveyed a specific group of 200 coffee drinkers, not a representative sample of all adults.
DThis ignores potential confounding factors such as sleep quality, job type, or stress levels that could influence both coffee consumption and productivity.
Question 17Medium
A nutritionist examined dietary records and blood pressure measurements from 500 adults in a community health database. The analysis revealed that adults who consumed more than 2300 milligrams of sodium per day had higher average blood pressure than those who consumed less sodium. Which conclusion is best supported by the study design?
Show the answer and explanation
Why A is right
The nutritionist conducted an observational study by examining existing dietary records and health data without manipulating any variables. This design can reveal associations between sodium intake and blood pressure but cannot establish that one causes the other.
Why the others are wrong
BThis claims causation from an observational study, which is not justified because the nutritionist did not control sodium intake or randomly assign participants to different sodium levels.
CThis generalizes the finding to all adults and makes a prescriptive claim about reducing sodium, going beyond what the observational data from this specific community can support.
DThis ignores other factors that influence blood pressure such as body weight, physical activity, genetics, and other dietary components.
Question 18Medium
A botanist randomly assigned 80 tomato plants to receive either a new fertilizer or a standard fertilizer for 12 weeks. Plants receiving the new fertilizer produced an average of 15 more tomatoes than plants receiving the standard fertilizer. Which conclusion is best supported by the study design?
Show the answer and explanation
Why C is right
This was a randomized experiment with random assignment to fertilizer types. Random assignment controls for confounding variables and allows the botanist to make causal conclusions about the effect of the new fertilizer.
Why the others are wrong
AThis understates what the study design supports. Because plants were randomly assigned to fertilizer conditions, a causal conclusion is justified, not merely an associational one.
BThis overgeneralizes the specific numerical result. While causation can be inferred, the exact average of 15 more tomatoes applies to this sample and these conditions, not necessarily all tomato plants.
DThis incorrectly suggests confounding was not controlled. Random assignment balances variables like sunlight exposure across groups, so observed differences can be attributed to the fertilizer.
Question 19Medium
A sports science team randomly assigned 60 high school athletes to either a traditional training program or a plyometric training program for 8 weeks. At the end of the study, athletes in the plyometric group showed significantly greater improvements in vertical jump height than those in the traditional program. Which conclusion is best supported by the study design?
Show the answer and explanation
Why C is right
This was a randomized experiment where athletes were randomly assigned to training programs. Random assignment allows researchers to establish causation because it controls for confounding variables, making it possible to conclude that the plyometric training caused the observed improvement.
Why the others are wrong
AThis overgeneralizes beyond the study population of 60 high school athletes to all athletes in any sport, which is not warranted by the study design.
BThe study measured only vertical jump height, not all measures of athletic performance, so this conclusion extends beyond what was tested.
DThis incorrectly suggests an observational design where athletes self-selected their program, when in fact they were randomly assigned.
Question 20Medium
An economist analyzed employment data from 1000 college graduates and found that those who completed internships during college had higher starting salaries than those who did not complete internships. Which conclusion is best supported by the study design?
Show the answer and explanation
Why B is right
The economist conducted an observational analysis of existing employment data without randomly assigning students to complete or not complete internships. This design can identify an association between internships and salaries but cannot establish causation.
Why the others are wrong
AThis claims causation from observational data, which is not justified because students self-selected whether to complete internships and other factors may differ between the two groups.
CThis overgeneralizes the finding to claim that every student with an internship will earn more, when the study found only a difference in average salaries.
DThis ignores confounding factors such as major, academic performance, networking, socioeconomic background, and the quality of the degree program.
What to do after medium
Medium is the tier that decides most scores. If these are landing, the hard set is where the remaining points are.
Questions are written by SAT Climb and drawn from its own item bank. SAT® is a registered trademark of College Board, which is not affiliated with and does not endorse SAT Climb.