Significance Testing for AP Statistics (page 2)
Practice problems for these concepts can be found at:
- Inference for Means and Proportions Multiple Choice Practice Problems for AP Statistics
- Inference for Means and Proportions Free Response Practice Problems for AP Statistics
- Inference for Means and Proportions Review Problems for AP Statistics
- Inference for Means and Proportions Rapid Review for AP Statistics
The steps in the hypothesis-testing procedure is as follows:
- State hypotheses in the context of the problem. The first hypothesis, the null hypothesis, is the hypothesis we are actually testing. The null hypothesis usually states that there is no bias or that there is no distinction between groups. It is symbolized by H0.
The second hypothesis, the alternative hypothesis, is the theory that the researcher wants to confirm by rejecting the null hypothesis. The alternative hypothesis is symbolized by HA. There are three forms for the alternative hypothesis: ≠ , >, or <. That is, if the null is H0: μ1 – μ2 = 0, then HA could be:
- HA: μ1 – μ2 = 0 (this is called a two-sided alternative)
- HA: μ1 – μ2 > 0 (this is a one-sided alternative)
- HA: μ1 – μ2 < 0 (also a one-sided alternative)
(In the case of the one-sided alternative HA: μ1 – μ2 > 0, the null hypothesis is sometimes written H0: μ1 – μ2 ≤ 0.)
If you stated a significance level, the conclusion can be based on a comparison of the P-value with α. If you didn't state a significance level, you can argue your conclusion based on the value of the P-value alone: if it is small, you have evidence against the null; if it is not small, you do not have evidence against the null.
The conclusion can be (1) that we reject H0 (because of a sufficiently small P-value) or (2) that we do not reject H0 (because the P-value is too large). We never accept the null: we either reject it or fail to reject it. If we reject H0, we can say that we accept HA or, preferably, that we have evidence in favor of HA.
Significance testing involves making a decision about whether or not a finding is statistically significant. That is, is the finding sufficiently unlikely so as to provide good evidence for rejecting the null hypothesis in favor of the alternative? The four steps in the hypothesis testing process outlined above are the four steps that are required on the AP exam when doing inference problems. In brief, every test of a hypothesis should have the following four steps:
- State the null and alternative hypotheses in the context of the problem.
- Identify the appropriate test and check that the conditions for its use are present.
- Do the correct mechanics, including calculating the value of the test statistic and the P-value.
- State a correct conclusion in the context of the problem.
z-Procedures versus t-Procedures
In this chapter, we explore inference for means and proportions. When we deal with means, we may use, depending on the conditions, either t-procedures or z-procedures. With proportions, assuming the proper conditions are met, we deal only with large samples—that is, with z-procedures.
When doing inference for a population mean, or for the difference between two population means, we will usually use t-procedures. This is because z-procedures assume that we know the population standard deviation (or deviations in the two-sample situation) which we rarely do. We typically use t-procedures when doing inference for a population mean or for the difference between two population means when:
- The sample is a simple random sample from the population
- The sample size is large (rule of thumb: n ≥ 30) or the population from which the sample is drawn is approximately normally distributed (or, at least, does not depart dramatically from normal)
- The samples are simple random samples from the population
- The population(s) from which the sample(s) is (are) drawn is normally distributed (in this case, the sampling distribution of will also be normally distributed)
- The population standard deviation(s) is (are) known.
You can always use z-procedures when doing inference for population means when:
Historically, many texts allowed you to use z procedures when doing inference for means if your sample size was large enough to argue, based on the central limit theorem, that the sampling distribution of is approximately normal. The basic assumption is that, for large samples, the sample standard deviation s is a reasonable estimate of the population standard deviation σ. Today, most statisticians would tell you that it's better practice to always use t-procedures when doing inference for a population mean or for the difference between two population means. You can receive credit on the AP exam for doing a large sample problem for means using z-procedures but it's definitely better practice to use t-procedures.
When using t-procedures, it is important to check in step II of the hypothesis test procedure, that the data could plausibly have come from an approximately normal population. A stemplot, boxplot, etc., can be used to show there are no outliers or extreme skewness in the data. t-procedures are robust against these assumptions, which means that the procedures still work reasonably well even with some violation of the condition of normality. Some texts use the following guidelines for sample size when deciding whether of not to use t-procedures:
- n < 15. Use t-procedures if the data are close to normal (no outliers or skewness).
- n > 15. Use t-procedures unless there are outliers or marked skewness.
- n > 40. Use t-procedures for any distribution.
For the two-sample case discussed later, these guidelines can still be used if you replace n with n1 and n2.
- Kindergarten Sight Words List
- First Grade Sight Words List
- 10 Fun Activities for Children with Autism
- Signs Your Child Might Have Asperger's Syndrome
- Theories of Learning
- A Teacher's Guide to Differentiating Instruction
- Child Development Theories
- Social Cognitive Theory
- Curriculum Definition
- Why is Play Important? Social and Emotional Development, Physical Development, Creative Development