Table of Contents

## Sampling Distribution

Sampling distribution is the **probability of distribution of statistics from a large population by using sampling technique**. Sampling helps in getting average results about a large population through choosing selective samples. The results obtained from observing or analyzing samples help in concluding opinion regarding a whole population from which samples are drawn.

The sampling results are compiled **on the basis of expected frequency of occurrence** of an event or statistic in whole population. Each sample contributes in calculation of some statistics comprising on random variables. These random variables have probability distribution which is calculated on the basis of the samples chosen.

### Types of sampling distribution

There are two types of sampling distribution, i.e.:

- The sampling distribution of a proportion
- The sampling distribution of a mean

### Sampling Error

This kind of error results when the statistical characteristics are estimated from a **single subset or incomplete portion of population** instead of whole population. This kind of error indicates that the sampling results **don’t depict average results** from statistics of whole population hence are not reliable.

**Example:**In case a person measures weight of 1,000 people in a city which has total population of 50,000. The results which will be generated on the basis of samples chosen for 1,000 individuals will not be helping to conclude result for whole population of 50,000 people. It is known as sampling error.

### Sampling Variability

Samples are **chosen on random basis from a population known as parameter**. Samples chosen from the whole population show random results on the basis of their repeated selection.

Sampling variability refers to the fact that **statistical information embedded in each sample varies from sample to sample**. It increases with an increase in sample size. It is based on different sets of populations and relates characteristics from which samples are drawn. It is another name for** range indicating range of different values belonging to different samples from different populations**.

## Sampling Distribution of a Proportion

There are several ways to calculate sampling distribution of a proportion. The **population portion Ƥ indicates the proportion of items of individuals in a whole population with specific characteristics or interests**. Here, the sample proportion is denoted by ƥ. It shows specific characteristics of sample proportion which only belong to the specific part of population to which they belong.

**Illustration**

In a sample of 200 adults, 160 have smart phones. And if we want to find out the proportion of individuals with a smart phone in a whole population we need to calculate through the following formula:

ƥ = 160 / 200

= 0.80

### Properties

The sampling distribution of proportion has the following properties:

**Mean (µ ƥ)**: it is also pronounced as mu sub-p-hat. It indicates the population proportion ƥ.**Standard Error (σ ƥ**): it is pronounced as sigma sub p-hat. It is indicated by. In the formula of standard error, due to n being the dominator, the error has an inversely proportional relationship with sample size or number of samples chosen from specific population and vice versa.

In case the sample size is larger or ƥ is closer to 0.50, it indicates that the distribution of sample proportion is equal to normal distribution.

### Example of Sampling distribution of a proportion

In a survey conducted which involves an ACT test each year to find out the proportion of students who like to take help for math skills. If it is assumed on the basis of researches in previous years that 38 % of the total students responded with yes to ACT test, it shows that the population proportion is equal to 0.38. The distribution of two responses show a result of Yes = 38 % and No = 62 %.

In this case the sample proportion ƥ can be calculated by using standard error formula, i.e.,

Due to large number of students, i.e., 1,000 the population proportion is closer to normal distribution.

## Normal Model for Proportions

The normal distribution also known as bell curve indicate average results from a population. It gives appearance of bell with equally distributed curves on right and left side as shown below.

The normal model for proportions have **several properties** including

- The mean, median and mode of the normally distributed proportions are equal
- The curve of the normal distribution is symmetric at the center around the mean µ.
- The normal distribution shows a perfectly divided curve from the middle of total distribution
- The total areas covered by the whole proportion curve denotes value 1.

### Elements of normal model for distributions

The key elements in any situation which involves normal model for display distribution of proportion comprises on the mean and standard deviation. Same like in sampling distribution of proportion the population portion is denoted by “Ƥ” and sample proportion by “ƥ” in normal distribution curve.

### Conditions for normal model for distribution

Normal model for distribution **should fulfill three mandatory conditions** in order to find out mean and standard deviation of sample proportion.

**The independence Assumption**: It is mandatory that individuals or samples from a population are independent from each other.

**The 10 % condition**: It is mandatory that the sample size is less than 10 % of the total population to which it belongs.

**The Success/Failure condition**: The binomial approximation condition is applied here to find out success/failure through approximately normal condition through (1 – Ƥ). To meet this condition nƥ should be ≥ 10.

### Practical application of conditions

In case a survey is conducted in order to find out the role of industrial pollution as a major reason for global warming. If it is believed that 45 % of population of London considers it true and a sample of 100 people is taken. What is the expected probability that 47 % of total respondents of sample of 100 people will approve this perception?

In order to find out the probability, first of all the conditions of normal approximation have to be confirmed.

**Independence condition**: The sample size of 100 people have been chosen randomly, hence, it is considered that they are independent of each other fulfilling this condition.

**10 % condition**: The sample of 100 people out of total population of London city does not even constitute 1 % of total population. Hence, the 10 % condition has also been met.

**Success/Failure condition**:

In this case nƥ = 100 (0.45)

= 45 ≥ 10

(1 – Ƥ) = 100 (0.55)

= 55 ≥ 10

Hence, it is proved that all conditions have been met, so normal approximation can be used in this case. The mean of a sample is equal to sample proportion ƥ.

In this case mean is

= 0.45

Standard deviation for this survey will be calculated using the same formula

=

Putting values in the formula we find out:

=

= 0.0497

Once we have mean and standard deviation of the survey data, we can find out the probability of a sample proportion of 0.47 who consider industrial activities as a major source of global warming in London. Here, Z score conversion formula will be used to find out the required probability, i.e.:

Z = x – μ / σ

Putting the values in Z-score formula. The probability of sample proportion of 0.47 is

= (0.47 − 0.45/ 0.0497)

= 0.40

as ( ≥ 0.47)

And Now ( ≥ 0.40)

≥ 0 − 0 ≤ ≤ 0.4

0.5 − 0.1554 = 0.3446.

Hence there is 0.3446 probability that 47 % of total respondents of sample of 100 people will approve this perception.

## Sampling Distribution of the Mean

The mean of sample distribution refers to the mean of the whole population to which the selected sample belongs. It is the same as sampling distribution for proportions. The sampling distribution of the mean of a sample size is important but complicated for concluding results about a population except for a very small or very large sample size.

**Example**: In this case we have selected 500 male students between 20—25 years from a college and measured their heights. The average height for them is measured to be 5 ft 7 inches. And again we selected another 500 male students from another college of the same age group, now the average measure is 5 ft 6.5 inches.

The difference between these two averages is the sampling variability in the mean of a whole population. This variability can be resolved through modeling sample averages.

## The Fundamental Theorem of Statistics

There are two fundamental theorems of statistics also known as fundamental theorems of probability, i.e.:

- The law of large numbers
- The central limit theorem

### The Central Limit Theorem (CLT)

It states that if the number of sample size is large, it results in normal distribution of mean of sample size of n number of population. It provides mean and standard deviation of sampling distribution in terms of sample size, the mean of whole population µ and the variance of whole population σ.

CLT is **helpful in measuring statistics computationally**, hence, it is used in several statistical tests. It interconnects important elements of sample distribution including mean, standard deviation, sample size, variances and accuracy of point estimates.

For accurate calculations of CLT, the observations should be collected independently and randomly. For effective measurement of CLT, the following facts have to be considered.

- Population distribution is not important for CLT
- If sample size n is large, it does not get impacted even if population distribution is symmetric or skewed
- Normal model can be used to interpret the distribution of the sample mean because sample mean has an approximate normal distribution

### Conditions

CLT is useful if all three conditions are fulfilled, including:

**Independent groups**: The sample size selected should be independent of each other and selected randomly.

**Independence/Randomization**: The sample size n should be large enough i.e. at-least 30 samples.

**10 % Condition**: The sample size should not be larger than 10% of the population size from which it has to be selected.

**Example**: We select 100 apples from an orchard to measure their average weight from total 10,000 apples. The average weight of each apple is 0.34 lbs. The standard deviation in this case is 0.1lbs. We need to find out the probability that the weight of the sample size of 100 apples is less than 0.32 lbs.

In order to check out the feasibility of the data, first, we need to check out whether it meets the conditions of not.

- The sample size of 100 apples have been chosen randomly, hence, it is considered that they are independent of each other fulfilling this condition.
- The sample size is 100 apples, whereas minimum size required is 30, so sample size condition is fulfilled.
- 100 apples make up 1 % of total population of apples in orchard, so less than 10 % condition has also been fulfilled.

Hence, all conditions are fulfilled, CLT can be used to measure the required probability in this case. In this case:

Mean µ = 0.34 lbs.

Using Z score formula: Z = x – μ / σ

= (0.32 − 0.34/ 0.01)

= 2

As ≤ −2 = ≥ 2 = ≥ 0 – (0 ≤ ≤2)

Hence, the probability that the probability that the weight of the sample size of 100 apples is less than 0.32 lbs. is 2.

## Variation and Means

The **variation factor in case of mean is less observed as compared to the individual values**. Following points are helpful in understanding variation and means.

- The average values or mean of a sample gets stable with increase in its size.
- The larger a sample group, the better it represents the whole population.
- The average or mean of a population should be pretty stable to represent the population as a whole.
- With an increase in sample size, the standard deviation of the sample mean falls. For example, in case we would have chosen 400 apples in illustration of CLT instead of 100 apples, the standard deviation would have gone down to 0.05 from 0.01.

### Cautions

Following common issues with sampling distribution should be taken into account:

- Sampling distribution and the distribution of sample are two different factors. They should not be confused with each other. Sampling distribution refers to distribution of statistics from the sample.
- The observations which are not independent should be avoided as these are not useable in case of CLT.
- Small sample size should be investigated carefully for skewed distributions, since, when sample size is small, the normal approximation does not work well and vice versa.