Table of Contents
Sampling distribution is the probability of distribution of statistics from a large population by using sampling technique. Sampling helps in getting average results about a large population through choosing selective samples. The results obtained from observing or analyzing samples help in concluding opinion regarding a whole population from which samples are drawn.
The sampling results are compiled on the basis of expected frequency of occurrence of an event or statistic in whole population. Each sample contributes in calculation of some statistics comprising on random variables. These random variables have probability distribution which is calculated on the basis of the samples chosen.
Types of sampling distribution
There are two types of sampling distribution, i.e.:
- The sampling distribution of a proportion
- The sampling distribution of a mean
This kind of error results when the statistical characteristics are estimated from a single subset or incomplete portion of population instead of whole population. This kind of error indicates that the sampling results don’t depict average results from statistics of whole population hence are not reliable.
Samples are chosen on random basis from a population known as parameter. Samples chosen from the whole population show random results on the basis of their repeated selection.
Sampling variability refers to the fact that statistical information embedded in each sample varies from sample to sample. It increases with an increase in sample size. It is based on different sets of populations and relates characteristics from which samples are drawn. It is another name for range indicating range of different values belonging to different samples from different populations.
Sampling Distribution of a Proportion
There are several ways to calculate sampling distribution of a proportion. The population portion Ƥ indicates the proportion of items of individuals in a whole population with specific characteristics or interests. Here, the sample proportion is denoted by ƥ. It shows specific characteristics of sample proportion which only belong to the specific part of population to which they belong.
In a sample of 200 adults, 160 have smart phones. And if we want to find out the proportion of individuals with a smart phone in a whole population we need to calculate through the following formula:
ƥ = 160 / 200
The sampling distribution of proportion has the following properties:
- Mean (µ ƥ): it is also pronounced as mu sub-p-hat. It indicates the population proportion ƥ.
- Standard Error (σ ƥ): it is pronounced as sigma sub p-hat. It is indicated by . In the formula of standard error, due to n being the dominator, the error has an inversely proportional relationship with sample size or number of samples chosen from specific population and vice versa.
In case the sample size is larger or ƥ is closer to 0.50, it indicates that the distribution of sample proportion is equal to normal distribution.
Example of Sampling distribution of a proportion
In a survey conducted which involves an ACT test each year to find out the proportion of students who like to take help for math skills. If it is assumed on the basis of researches in previous years that 38 % of the total students responded with yes to ACT test, it shows that the population proportion is equal to 0.38. The distribution of two responses show a result of Yes = 38 % and No = 62 %.
In this case the sample proportion ƥ can be calculated by using standard error formula, i.e., . If the total number of students is 1,000 and Ƥ is 0.38, the standard error will be as follows:
= 0.015 or 1.5%
Due to large number of students, i.e., 1,000 the population proportion is closer to normal distribution.
Normal Model for Proportions
The normal distribution also known as bell curve indicate average results from a population. It gives appearance of bell with equally distributed curves on right and left side as shown below.
The normal model for proportions have several properties including
- The mean, median and mode of the normally distributed proportions are equal
- The curve of the normal distribution is symmetric at the center around the mean µ.
- The normal distribution shows a perfectly divided curve from the middle of total distribution
- The total areas covered by the whole proportion curve denotes value 1.
Elements of normal model for distributions
The key elements in any situation which involves normal model for display distribution of proportion comprises on the mean and standard deviation. Same like in sampling distribution of proportion the population portion is denoted by “Ƥ” and sample proportion by “ƥ” in normal distribution curve.
Conditions for normal model for distribution
Normal model for distribution should fulfill three mandatory conditions in order to find out mean and standard deviation of sample proportion.
The independence Assumption: It is mandatory that individuals or samples from a population are independent from each other.
The 10 % condition: It is mandatory that the sample size is less than 10 % of the total population to which it belongs.
The Success/Failure condition: The binomial approximation condition is applied here to find out success/failure through approximately normal condition through (1 – Ƥ). To meet this condition nƥ should be ≥ 10.
Practical application of conditions
In case a survey is conducted in order to find out the role of industrial pollution as a major reason for global warming. If it is believed that 45 % of population of London considers it true and a sample of 100 people is taken. What is the expected probability that 47 % of total respondents of sample of 100 people will approve this perception?
In order to find out the probability, first of all the conditions of normal approximation have to be confirmed.
Independence condition: The sample size of 100 people have been chosen randomly, hence, it is considered that they are independent of each other fulfilling this condition.
10 % condition: The sample of 100 people out of total population of London city does not even constitute 1 % of total population. Hence, the 10 % condition has also been met.
In this case nƥ = 100 (0.45)
= 45 ≥ 10
(1 – Ƥ) = 100 (0.55)
= 55 ≥ 10
Hence, it is proved that all conditions have been met, so normal approximation can be used in this case. The mean of a sample is equal to sample proportion ƥ.
In this case mean is
Standard deviation for this survey will be calculated using the same formula
Putting values in the formula we find out:
Once we have mean and standard deviation of the survey data, we can find out the probability of a sample proportion of 0.47 who consider industrial activities as a major source of global warming in London. Here, Z score conversion formula will be used to find out the required probability, i.e.:
Z = x – μ / σ
Putting the values in Z-score formula. The probability of sample proportion of 0.47 is
= (0.47 − 0.45/ 0.0497)
as ( ≥ 0.47)
And Now ( ≥ 0.40)
≥ 0 − 0 ≤ ≤ 0.4
0.5 − 0.1554 = 0.3446.
Hence there is 0.3446 probability that 47 % of total respondents of sample of 100 people will approve this perception.
Sampling Distribution of the Mean
The mean of sample distribution refers to the mean of the whole population to which the selected sample belongs. It is the same as sampling distribution for proportions. The sampling distribution of the mean of a sample size is important but complicated for concluding results about a population except for a very small or very large sample size.
The difference between these two averages is the sampling variability in the mean of a whole population. This variability can be resolved through modeling sample averages.
The Fundamental Theorem of Statistics
There are two fundamental theorems of statistics also known as fundamental theorems of probability, i.e.:
- The law of large numbers
- The central limit theorem
The Central Limit Theorem (CLT)
It states that if the number of sample size is large, it results in normal distribution of mean of sample size of n number of population. It provides mean and standard deviation of sampling distribution in terms of sample size, the mean of whole population µ and the variance of whole population σ.
CLT is helpful in measuring statistics computationally, hence, it is used in several statistical tests. It interconnects important elements of sample distribution including mean, standard deviation, sample size, variances and accuracy of point estimates.
For accurate calculations of CLT, the observations should be collected independently and randomly. For effective measurement of CLT, the following facts have to be considered.
- Population distribution is not important for CLT
- If sample size n is large, it does not get impacted even if population distribution is symmetric or skewed
- Normal model can be used to interpret the distribution of the sample mean because sample mean has an approximate normal distribution
CLT is useful if all three conditions are fulfilled, including:
Independent groups: The sample size selected should be independent of each other and selected randomly.
Independence/Randomization: The sample size n should be large enough i.e. at-least 30 samples.
10 % Condition: The sample size should not be larger than 10% of the population size from which it has to be selected.
In order to check out the feasibility of the data, first, we need to check out whether it meets the conditions of not.
- The sample size of 100 apples have been chosen randomly, hence, it is considered that they are independent of each other fulfilling this condition.
- The sample size is 100 apples, whereas minimum size required is 30, so sample size condition is fulfilled.
- 100 apples make up 1 % of total population of apples in orchard, so less than 10 % condition has also been fulfilled.
Hence, all conditions are fulfilled, CLT can be used to measure the required probability in this case. In this case:
Mean µ = 0.34 lbs.
Using Z score formula: Z = x – μ / σ
= (0.32 − 0.34/ 0.01)
As ≤ −2 = ≥ 2 = ≥ 0 – (0 ≤ ≤2)
Hence, the probability that the probability that the weight of the sample size of 100 apples is less than 0.32 lbs. is 2.
Variation and Means
The variation factor in case of mean is less observed as compared to the individual values. Following points are helpful in understanding variation and means.
- The average values or mean of a sample gets stable with increase in its size.
- The larger a sample group, the better it represents the whole population.
- The average or mean of a population should be pretty stable to represent the population as a whole.
- With an increase in sample size, the standard deviation of the sample mean falls. For example, in case we would have chosen 400 apples in illustration of CLT instead of 100 apples, the standard deviation would have gone down to 0.05 from 0.01.
Following common issues with sampling distribution should be taken into account:
- Sampling distribution and the distribution of sample are two different factors. They should not be confused with each other. Sampling distribution refers to distribution of statistics from the sample.
- The observations which are not independent should be avoided as these are not useable in case of CLT.
- Small sample size should be investigated carefully for skewed distributions, since, when sample size is small, the normal approximation does not work well and vice versa.