Statistics - NHST Errors

Card Puncher Data Processing

Error

Type I

Probability of Type I errors increases when researchers conduct multiple NHSTs.

A Type I error means that the null hypothesis is true, but you reject the null hypothesis.

If you set your p-level for significance at 0.05, that means that if the null hypothesis is true then you have a 5% chance of getting data as extreme or more so than the observed data, and thus a 5% chance of rejecting the null hypothesis even though the null hypothesis is true.

If you repeat the pairwise test for different pairs, that 5% chance for each pairwise test accumulates.

For example, if you do 14 pairwise tests using p = 0.05 as the threshold for significance, then the chance of making a Type I error is : <math>1 - 0.95^{14}= 51 \% </math>

because the probability of several independent events all occurring is the product of their individual probabilities.

Type II

Many fields of research are plagued by a large degree of sampling error, which makes it difficult to detect an effect, even when the effect exists





Discover More
Card Puncher Data Processing
Statistics - Levene's test (Homogeneity variance test)

A Levene's test is essentially like a t-test but instead of comparing means it's comparing variances. If the test is significant, the homogeneity variance assumption is violated but we have a significant...
Card Puncher Data Processing
Statistics - Null Hypothesis Significance Testing (NHST)

NHST is a procedure for testing the Null Hypothesis. It's a binary decision: Reject or Retain the Null Hypothesis Ie Retain the Null Hypothesis or the alternative hypothesis. Before starting any...
Sampling Error
Statistics - Sampling Error

The sampling error is the inaccuracy that results from estimating using a sample, rather than the entire population. The Sampling error is the difference between the population and the sample. Whenever...



Share this page:
Follow us:
Task Runner