View source for Basics: Testing the Proportion in a Binary Population/nl

{{Languages|Basics: Testing the Proportion in a Binary Population}}
{{DISPLAYTITLE:Testing the Proportion in a Binary Population }}

Assume a random variable <math>X</math> has only two possible outcomes. We call the statistical population of <math>X</math> binary. If <math>X</math> is an indicator variable storing the information about the existence (or non-existence) of a feature, we can carry out statistical inference about the proportion of elements within the population possessing the property of interest (<math>\pi </math>) or not (<math>
1-\pi </math>). As in other parametric tests, the inference relates to a hypothetical value, here <math>\pi _{0}</math>, that represents a hypothetical proportion of population elements having the property of interest.
We will introduce statistical test procedures based on a ''simple random sample'' of size <math>n</math>. This ensures that the [[Glossary/en#S|sample variables]] <math>X_{1},\ldots ,X_{n}</math>, which are indicator variables with outcomes measured as either <math>0</math> or <math>1</math>, are independent and identically distributed Bernoulli variables. As usual the significance level is denoted by <math>\alpha </math>.
=== Hypotheses ===
Depending on the application at hand, one- or two-sided tests are formulated:
1) <math>\text{H}_{0}:\pi =\pi _{0},\text{H}_{1}:\pi \neq \pi _{0}.</math>
2) <math>\text{H}_{0}:\pi \leq \pi _{0},\text{H}_{1}:\pi >\pi _{0}.</math>
3) <math>\text{H}_{0}:\pi \geq \pi _{0},\text{H}_{1}:\pi <\pi _{0}.</math>
Our earlier remarks on the choice of null and alternative hypothesis in the section on testing population means also apply in this environment.
=== Test statistic and its distribution; decision regions ===
The sample proportion <math>\widehat{\pi }=\frac{X}{n}=\frac{1}{n}\sum_{i=1}^{n}\,X_{i}</math> is a suitable estimator of the population parameter <math>\pi </math>. The estimator <math>X=\sum_{i=1}^{n}\,X_{i},</math> is a simple transformation of <math>\widehat{\pi }</math> (<math>X=n\cdot \widehat{\pi }</math>), which contains all the important information. It counts the number of elements in the sample possessing the property of interest. As has already been shown, <math>X</math> follows a Binomial distribution with parameters <math>n</math> and <math>\pi
</math>: <math>X\thicksim B\left( n;\,\pi \right) </math>. As <math>n</math> is chosen by the decision-maker, <math>\pi </math> is the only remaining parameter needed to completely specify the Binomial distribution. Following the logic applied in all parametric hypothesis testing problems, we assume <math>\pi </math> to be <math>\pi _{0}</math>, that is, we determine the distribution of the test statistic given the hypothetical proportion <math>\pi _{0}</math> is the one prevailing in the population: <math>
\pi =\pi _{0}</math>. Hence, the estimator <math>X</math> becomes our , since it has a Binomial distribution with parameter <math>n</math> and <math>\pi _{0}</math> under <math>\text{H}_{0}</math>: <math>V=X\overset{\text{H}_{0}}{\thicksim }B\left( n;\,\pi _{0}\right) .</math>
The rejection region of the null hypothesis contains all realizations of <math>V</math> for which the cumulated probabilities don’t exceed the <math>\alpha </math>. The critical values can be read from the numerical table of the cumulative distribution function <math>F_{B}\left(
x\right) </math> of <math>B\left( n;\,\pi _{0}\right) </math>, by following these rules:
1)
The lower [[Glossary/en#C|critical value]] <math>c_{l}</math> is the realization <math>x</math> of <math>X</math>, for which the cumulative [[Glossary/en#D|distribution function]] just exceeds the value <math>\alpha /2</math>: <math>F_{B}\left( c_{l}-1\right) \leq \alpha /2</math> and <math>F_{B}\left( c_{l}\right) >\alpha /2</math>.
The upper critical value <math>c_{u}</math> is the argument <math>x</math> of the cumulative [[Glossary/en#D|distribution function]] that returns a probability equal to or greater than <math>1-\alpha /2</math>: <math>F_{B}\left( c_{u}-1\right) <1-\alpha /2</math> and <math>F_{B}\left( c_{u}\right) \geq 1-\alpha /2</math>.
The ''rejection region'' for H<math>_{0}</math> is given by<math>\left\{ v\,|\,v<c_{l}\,\text{ or }\,v>c_{u}\right\} </math>, such that
<math>P\left( V<c_{l}|\pi _{0}\right) +P\left( V>c_{u}|\pi _{0}\right)
\leq \alpha </math>.
For the ''non-rejection region'' for H<math>_{0}</math> we have<math>\left\{ v\,|\,c_{l}\leq v\leq c_{u}\right\} </math>, such that
<math>P\left( c_{l}\leq V\leq c_{u}|\pi _{0}\right) \geq 1-\alpha </math>.
2)
The [[Glossary/en#C|critical value]] <math>c</math> is the smallest realization of the test statistic that occurs with cumulated probability of at least <math>1-\alpha </math> : <math>F_{B}\left( c-1\right) <1-\alpha </math> and <math>F_{B}\left( c\right) \geq
1-\alpha </math>.
The ''rejection region'' for H<math>_{0}</math> is then<math>\left\{ v\,|\,v>c\right\} </math>, such that
<math>P\left( V>c|\pi _{0}\right) \leq \alpha </math>.
The ''non-rejection region'' for H<math>_{0}</math> is<math>\left\{ v\,|\,v\leq c\right\} </math>, such that
<math>P\left( V\leq c|\pi _{0}\right) \geq 1-\alpha </math>.
3)
The critical value <math>c</math> is determined as the smallest realization of the test statistic that occurs with cumulated probability of at least <math>\alpha </math>: <math>
F_{B}\left( c-1\right) \leq \alpha </math> and <math>F_{B}\left( c\right) >\alpha </math>.
The ''rejection region'' for H<math>_{0}</math> is <math>\left\{ v\,|\,v<c\right\} </math>, such that
<math>P\left( V<c|\pi _{0}\right) \leq \alpha </math>.
The ''non-rejection region'' for H<math>_{0}</math> is given by<math>\left\{ v\,|\,v\geq c\right\} </math>, such that
<math>P\left( V\geq c|\pi _{0}\right) \geq 1-\alpha </math>.
As <math>V=X</math> is a discrete random variable, the given significance level <math>\alpha
</math> will generally not be fully utilized (exhausted). The actual [[Glossary/en#S|significance level]] <math>\alpha _{a}</math> will only by chance reach that level and will usually be smaller. The above tests are thus conservative with respect to the utilization of the allowance for the maximum probability of the type I error.
Given the sample size <math>n</math> is sufficiently high, the estimator <math>\widehat{\pi}</math> can be standardized to give the test statistic <math>V=\frac{\widehat{\pi}-\pi_{0}}{\sigma_{0}\left( \widehat{\pi}\right)}=\frac{
\widehat{\pi}-\pi_{0}}{\sqrt{\frac{\pi_{0}\,\left( 1-\pi_{0}\right)}{n}}}.</math>
Here, <math>\sigma_{0}\left( \widehat{\pi}\right)</math> is the standard deviation of the estimation function <math>\widehat{\pi}</math> under <math>\text{H}_{0}</math>.
Under <math>\text{H}_{0}</math>, <math>V</math> has approximately standard normal distribution (i.e. normal with mean 0 and variance 1). Critical values for the given significance level can be taken from the cumulative standard normal distribution table. Decision regions for the one- and two sided tests are determined in the same way as those for the approximate population mean test for unknown <math>\sigma </math>: In fact, a hypothesis about a proportion is a hypothesis about an expectation (of a binary indicator variable): <math>E\left(
\widehat{\pi }\right) =\pi </math>.
=== Sampling and computing the test statistic ===
Once a sample of size <math>n</math> has been drawn, we have realization <math>x_{1},\ldots
,x_{n}</math> of the sampling variables, <math>X_{1},\ldots ,X_{n}</math>, and can compute the realized value <math>v</math> of the <math>V</math>.
=== Test decision and interpretation ===
See the remarks for the <math>\mu</math> test.
=== Power Curve <math>P\left( \pi \right) </math> ===
The ''power'' curve of the large-sample test based on <math>V=\frac{\widehat{\pi }-\pi _{0}}{\sigma _{0}\left( \widehat{\pi }\right) }=
\frac{\widehat{\pi }-\pi _{0}}{\sqrt{\frac{\pi _{0}\,\left( 1-\pi
_{0}\right) }{n}}}</math> can be calculated explicitly for all test situations in the same manner as the [[Glossary/en#P|power]] curve for the population mean tests.
The power curve of the exact test based on <math>V=X</math> is computed using the ''Binomial distribution'' (as this is the distribution underlying the [[Glossary/en#T|test statistic]]) for all <math>0\leq \pi \leq 1</math> and fixed <math>n</math>.
From the definition <math>P\left( \pi \right) =P\left( V=X\in \,\text{rejection region for H}
_{0}\,|\,\pi \right)</math> it follows
1) for the two-sided test <math>P\left( \pi\right)=P\left( V<c_{l}\,|\,\pi \right)+P\left(
V>c_{u}\,|\,\pi \right)=P\left( V\leq c_{l}-1\,|\,\pi \right)+\left[1-
P\left( V\leq c_{u}\,|\,\pi \right)\right],</math>
2) for the right-sided test <math>P\left( \pi\right)=P\left( V>c\,|\,\pi \right)=1- P\left( V\leq
c\,|\,\pi \right),</math>
3) for the left-sided test <math>P\left( \pi\right)=P\left( V<c\,|\,\pi \right)=P\left( V\leq
c-1\,|\,\pi \right).</math>
Given the respective critical values, the probabilities can be looked up in the numerical table of the cumulative Binomial .
For <math>\pi =\pi _{0}</math>, the power curve equals the actual <math>\alpha _{a}</math>.
Imagine a ‘binary population’ of <math>N=3,250</math> economics students, an unknown proportion of which is enthusiastic about statistics. We define the random variable <math>X</math> to assume one if the statistical element (‘economics student’) likes statistic and zero if not.
We believe that half of the students fancy learning statistical concepts (our hypothetical proportion is thus <math>\pi _{0}=0.5</math>) and want to test whether this informed guess is true in statistical terms, at a [[Glossary/en#S|significance level]] of <math>\alpha </math> on the basis of a random sample of size <math>n</math>: <math>\text{H}_{0}:\pi =\pi _{0}=0.5\quad \text{ versus }\quad \text{H}_{1}:\pi
\neq \pi _{0}=0.5.</math>
In this interactive example you can repeat this test as often as you like. In each run a new sample is simulated (drawn). You can interact by deciding about <math>\alpha </math> and <math>n</math> in each repetition. In particular, you can try the following combinations:
* Hold [[Glossary/en#S|significance level]] <math>\alpha </math> and sample size <math>n</math> constant;
* vary the [[Glossary/en#S|significance level]] <math>\alpha </math> and keep the sample size <math>n</math> constant;
* set <math>n</math> to a new level and hold <math>\alpha </math> constant; or
* change both the [[Glossary/en#S|significance level]] <math>\alpha </math> and the sample size <math>n</math>.

[[File:nl_s2_52_e_5.gif]]

One of the raison d’etres of financial intermediaries is their ability to efficiently assess the credit-standing (‘creditworthiness’) of potential borrowers.
The management of ABC bank decides to introduce an extended credit checking scheme if the proportion of customers with repayment irregularities isn’t below <math>20</math> per cent. The in-house statistician conducting the statistical test is asked to keep the probability of not deciding to improve the credit rating procedure even though the proportion is ‘really’ above <math>20</math> per cent low (i.e. to keep <math>\alpha </math> low).
The random variable <math>X:</math> ‘credit event’ or ‘repayment problems’ is defined as an indicator variable taking on zero (‘no’) or one (‘yes’). The actual proportion <math>\pi </math> of clients having trouble with servicing the debt is unknown. The hypothetical boundary value for testing this population proportion is <math>\pi _{0}=0.2</math>.
=== Hypothesis ===
Deviations from the hypothetical parameter into one direction are of interest; thus, a one-sided test will be employed. As the bank hopes to prove that the evaluation processes in place are sufficient, i.e. the proportion of debtors displaying irregularities in repaying their loans is less than <math>20</math> per cent, this claim is formulated as the alternative hypothesis: <math>\text{H}_{0}:\pi \geq \pi _{0}=0.2\quad \text{ versus }\quad \text{H}
_{1}:\pi <\pi _{0}=0.2</math>
The properties of this test with respect to the bank managers’ requirements have to be evaluated to ensure the test really meets their needs.
The type I error, which can be made if the null hypothesis is rejected, is here: <math>'\text{H}_{1}^{' }|\text{H}_{0}=\text{'do not-reject that the proportion of problematic debtors}<0.2; \text{no new guidelines}\,|\,
\text{in reality, unreliable debtors make up at least 20 per cent; credit process has to be reviewed}.</math>
If the test results in the non-rejection of the null hypothesis, a type II error might occur: <math>
'\text{H}_{0}^{' }|\text{H}_{1}=\text{'do not-reject that the proportion of problematic debtors} \geq 0.2; \text{new evaluation process to be developed}\,|\,\text{in reality, unreliable debtors make up no more than 20 per cent; no need for action}.</math>
The type I error represents the risk the managers of the ABC bank want to cap. Its maximum level is given by the [[Glossary/en#S|significance level]], which has been set to a sufficiently low level of <math>0.05</math>.
The type II error represents the risk of a costly introduction of new credit evaluation processes without management-approved need. The impact of this scenario on the banks’ profitability is difficult to assess, as the new process will lead to a repricing of credits and thus may also generate cost ''savings''.
The following two alternatives are both based on the above test.
A random sample is drawn from the population of <math>10,000</math> debtors without replacement. This is reasonable, if <math>n/N\leq 0.05</math>, as then the random sample can then be regarded as ‘simple’.

=== 1st alternative ===
To curb costs, a sample size of <math>n=30</math> is chosen. The sampling-theoretical requirement <math>n/N\leq 0.05</math> is fulfilled.
=== Test statistic and its distribution; decision regions ===
The estimator <math>X:</math> ‘Number of clients with irregularities in debt servicing in sample of size 30’ can directly serve as our test statistic <math>V</math>. Under <math>
\text{H}_{0}</math>, <math>V=X</math> has Binomial distribution <math>B\left( 30;\,0.2\right) </math>. A small <math>V</math> supports the . The critical value <math>c</math> is the smallest realization of <math>
X</math>, for which <math>F_{B}\left( x\right) </math> equals to or is greater than <math>\alpha </math> , i.e. it has to satisfy: <math>F_{B}\left( c-1\right) \leq \alpha
=0.05</math> and <math>F_{B}\left( c\right) >\alpha =0.05</math>. In the numerical table of the cumulative [[Glossary/en#D|distribution function]] of <math>B\left(
30;\,0.2\right) </math> we find <math>c=3</math>, and thus we have the following decision regions:
Rejection region for H<math>_{0}</math>:<math>\left\{ v\,|\,v<3\right\} =\left\{ 0,1,2\right\} </math>, with <math>P\left( V<5|0.2\right) =0.0442</math>.
Non-rejection region for H<math>_{0}</math>:<math>\left\{ v\,|\,v\geq 3\right\} =\left\{ 3,4,\ldots ,30\right\} </math>, with <math>P\left( V\geq 3|0.02\right) =0.9558</math>.
Because <math>V=X</math> is a discrete random variable, the given isn’t exhausted: i.e. <math>\alpha _{a}=0.0442</math> <math><\alpha =0.05.</math>
=== Sampling and computing the test statistic ===
<math>30</math> randomly selected debtors are investigated with respect to reliability in debt servicing. Assume <math>5</math> of them haven’t always fulfilled their contractual obligations: <math>v=5</math>.
=== Test decision and interpretation ===
As <math>v=5</math> belongs to the non-rejection region for H<math>_{0}</math>, the is not-rejected. Even though the sample proportion <math>
x/n=5/30=0.167</math> is smaller than the hypothetical boundary proportion <math>\pi
_{0}=0.2</math>, which should favour H<math>_{1}</math>, we cannot conclude <math>\text{H}_{0}</math> is false: at a [[Glossary/en#S|significance level]] of <math>0.05</math>, the difference cannot be regarded as statistically significant. In other words: It is far too likely that the difference has arisen from sampling variability due to the small sample size to be able to reject the null hypothesis. It is important to observe that it’s not merely the value of the point [[Glossary/en#E|estimator]] compared to the hypothetical value that leads to a non-rejection or rejection of the null hypothesis, but intervals that take into account the random character of the estimator (i.e. the difference is compared to an appropriate, case specific, statistical yardstick to determine what is statistically significant large, and hence small, deviations/differences). Based on a random sample of size <math>n=30</math> and a [[Glossary/en#S|significance level]] <math>\alpha =0.05</math>, we were unable to show statistically, that the proportion of trouble debtors is significantly smaller than <math>20</math> per cent. Consequently, the ABC bank will review and try to improve the credit approval procedures.
=== Power ===
Not having rejected the [[Glossary/en#N|null hypothesis]], we are vulnerable to a type II error, which occurs when the is a true statement: <math>'\text{H}_{0}^{' }|\text{H}
_{1}</math>.
Let’s calculate the type II error probability for a true parameter value <math>
\pi =0.15</math>: What is the probability of not rejecting the null hypothesis in a left-sided test with <math>\pi _{0}=0.2</math>, <math>n=30</math>, <math>\alpha =0.05</math> and <math>c=3</math>, given the true population proportion is <math>\pi =0.15</math> and hence the null hypothesis actually wrong? <math>\beta \left( \pi =0.15\right) =P\left( '\text{H}_{0}^{' }|\text{H}
_{1}\right) =P\left( V=X\in \,\text{non-rejection region for H}
_{0}\,|\,\pi =0.15\right) =P\left( V\geq 3\,|\,\pi =0.15\right) .</math>
We compute <math>P\left( V\geq 3\,|\,\pi=0.15\right)=1-P\left(
V<3\,|\,\pi=0.15\right)=1-P\left( V\leq 2
\,|\,\pi=0.15\right)=1-0.1514=0.8486,</math> where <math>P\left( V\leq 2\,|\,\pi=0.15\right)</math> is taken from the table of the cumulative [[Glossary/en#D|distribution function]] <math>B\left( 30; \,
0.15\right)</math> for <math>c=2</math>, that is <math>F_{B}\left( 2\right)</math>.
Interpretation: Given the true proportion is <math>\pi =0.15</math>, <math>84.86\%</math> of all samples of size <math>n=30</math> will not be able to discriminate between the true parameter and the hypothetical <math>\pi _{0}=.20</math>, inducing the bank to undertake suboptimal improvements of the credit assessment process with probability <math>0.8486</math>. In deciding to control the maximum error I probability, the bank is accepting type II error probabilities of such magnitude, statisticians can provide management with power function graphs for any desired true parameter value <math>\pi </math>.
Of course, not rejecting the null hypothesis can also be the right decision: <math>'\text{H}_{0}^{' }|\text{H}_{1}</math>. Suppose, for example, that the true proportion of unreliable debtors is <math>\pi =0.25</math>. The probability of not rejecting the null hypothesis and hence (unknowingly) making the right decision given our current test setting (left sided with <math>\pi _{0}=0.20</math>, <math>
n=30</math>, <math>\alpha =0l05</math> and thus <math>c=3</math>) is <math>P\left( V=X\in \,\text{non-rejection region for H}_{0}\,|\,\pi
=0.25\right) =P\left( V\geq 3\,|\,\pi =0.25\right) =P\left( '\text{H}
_{0}^{' }|\text{H}_{1}\right) =1-\alpha .</math>
We have <math>P\left( V\geq 3\,|\,\pi=0.25\right)=1-P\left(
V<3\,|\,\pi=0.25\right)=1-P\left( V\leq 2
\,|\,\pi=0.25\right)=1-0.0106=0.9894,</math> where <math>P\left( V\leq 2\,|\,\pi=0.25\right)</math> can be looked up in a numerical table of <math>B\left( 30; \, 0.25\right)</math> as the cumulative probability for values less than or equal to <math>c=2</math>, i.e. <math>F_{B}\left(
2\right)</math>.
These calculations can be carried out for any desired parameter value within the overall parameter space (here: <math>\pi \in \left( 0,1\right) </math>). Depending on which hypothesis the individual parameter adheres to, the power curve <math>
P\left( \pi \right) </math> or <math>1-P\left( \pi \right) </math> returns probabilities for making a right decision or a type I or type II error.
{|class="wikitable"
!align="center"| <math>\pi</math>
!align="center"| True hypothesis
!align="center"| <math>P\left( \pi\right)</math>
!align="center"| <math>1-P\left( \pi\right)</math>
|-
|align="center"| <math>0</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>1=1-\beta</math>
|align="center"| <math>0=\beta</math>
|-
|align="center"| <math>0.05</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.8122=1-\beta</math>
|align="center"| <math>0.1878=\beta</math>
|-
|align="center"| <math>0.10</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.4114=1-\beta</math>
|align="center"| <math>0.5886=\beta</math>
|-
|align="center"| <math>0.15</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.1514=1-\beta</math>
|align="center"| <math>0.8486=\beta</math>
|-
|align="center"| <math>0.20</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0442=\alpha_{a}</math>
|align="center"| <math>0.9558=1-\alpha_{a}</math>
|-
|align="center"| <math>0.25</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0106=\alpha</math>
|align="center"| <math>0.9894=1-\alpha</math>
|-
|align="center"| <math>0.30</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0021=\alpha</math>
|align="center"| <math>0.9979=1-\alpha</math>
|-
|align="center"| <math>0.35</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0003=\alpha</math>
|align="center"| <math>0.9997=1-\alpha</math>
|-
|align="center"| <math>0.40</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0=\alpha</math>
|align="center"| <math>1=1-\alpha</math>
|}
The following display shows the graph of the power curve in the left-sided test with parameters <math>\pi _{0}=0.20</math>, <math>n=30</math>, <math>\alpha =0.05</math> and <math>c=3</math>.

[[File:nl_s2_52_e_4.gif]]

=== 2nd alternative ===
Now the statistician tries to both satisfy the parameter <math>\alpha=0.05</math> set by the management to contain the probability of the crucial type I error ''and'' keep the type II error as low as possible. She is aware of the trade-off relationship between <math>\alpha</math> and <math>\beta</math> error and focuses on possibilities of reducing the associated probabilities simultaneously by increasing the sample size <math>n</math> and thus making the decision an economic one. Cost projections in conjunction with a valuation of the benefit of higher reliability lead to a choice of <math>n=350</math>, still small enough to satisfy <math>
n/N\leq 0.05</math> as basis for simple random sampling without replacement.
=== Test statistic and its distribution; decision regions ===
The standardized test statistic <math>V=\frac{\widehat{\pi }-\pi _{0}}{\sigma _{0}\left( \widehat{\pi }\right) }=
\frac{\widehat{\pi }-\pi _{0}}{\sqrt{\frac{\pi _{0}\,\left( 1-\pi
_{0}\right) }{n}}}</math> is used. Under <math>\text{H}_{0}</math>, it is approximately with parameters <math>\mu =0</math> and <math>\sigma =1</math>. Large sample theory suggests that the approximation is sufficiently accurate for a sample size of <math>n=350</math>. From the cumulative standard normal distribution table we can take <math>c=z_{0.95}=1.645</math> to satisfy <math>P\left( V\leq c\right) =1-\alpha
=0.95</math>. From symmetry it follows that <math>-c=-1.645</math>, and we have <math>\left\{
v\,|\,v<-1.645\right\} </math> as the approximated for H<math>_{0}</math> and <math>\left\{ v\,|\,v\geq -1.645\right\} </math> as the approximated non-rejection region for H<math>_{0}</math>.
=== Sampling and computing the test statistic ===
From the universe of <math>10,000</math> debtors, <math>350</math> are selected and random, of which <math>63</math> turn out to have displayed problems in debt servicing at least once in their repayment history. Their proportion within the sample is thus <math>
0.18</math>. Plugging this into the test statistic yields <math>v=\frac{0.18-0.2}{\sqrt{\frac{0.2\,\cdot (\,0.8)}{350}}}=-0.935.</math>
=== Test decision and interpretation ===
As <math>v=-.0935</math> falls into the non-rejection region for H<math>_{0}</math>, the null hypothesis is not rejected. On the basis of this particular sample of size <math>
n=350</math>, it can not be statistically claimed, that the proportion of problematic debtors is less than <math>20</math> per cent. The ABC bank management will thus initiate a review of their credit procedures.
=== Type II error probability ===
As the bank management has been induced to not-reject the statement in the [[Glossary/en#N|null hypothesis]], it may have made a type II error, which occurs if the true proportion amongst the <math>10,000</math> is actually smaller than <math>
0.2</math>: <math>'\text{H}_{0}^{' }|\text{H}_{1}</math>. Let’s examine the probability of this happening for a ‘hypothetical’ true population proportion of <math>\pi
=0.15</math>, i.e. <math>P\left( '\text{H}_{0}^{' }|\text{H}
_{1}\right) =\beta \left( \pi =0.15\right) </math>.
First we must determine the critical proportion <math>p_{c}</math> corresponding to the [[Glossary/en#C|critical value]] calculated using the normal approximation. From <math>-c=\left( p_{c}-\pi _{0}\right) /\sigma \left( \hat{\pi}\right)</math> follows <math>p_{c}=\pi _{0}-c\cdot \sigma \left( \hat{\pi}\right) =0.2-1.645\,\left(
0.2\cdot 0.8/350\right) =0.1648.</math>
<math>\beta \left( \pi =0.15\right) </math> is the probability of the sample function <math>
\widehat{\pi }</math> assuming a value from the non-rejection region of the null hypothesis, given the true parameter <math>\pi </math> belongs to the [[Glossary/en#A|alternative hypothesis]]: <math>\beta \left( \pi =0.15\right) =P\left( \widehat{\pi }\geq p_{c}\,|\,\pi
=0.15\right) =P\left( \widehat{\pi }\geq 0.1648\,|\,\pi =0.15\right) .</math>
In order to determine this probability on the basis of a numerical table for the ''standard'' normal distribution, we must standardize using <math>E\left(
\widehat{\pi }\right) =\pi =0.15</math> and <math>Var\left( \widehat{\pi }\right) =\pi
\left( 1-\pi \right) /n=0.15\cdot (0.85)/350</math>: <math>\begin{align}
\beta \left( \pi =0.15\right) & =P\left( \widehat{\pi }\geq
p_{c}\,|\,\pi =0.15\right) =P\left( \frac{\widehat{\pi }-\pi _{0}}{\sqrt{
\frac{\pi \,\left( 1-\pi \right) }{n}}}\geq \frac{p_{c}-\pi _{0}}{\sqrt{
\frac{\pi \,\left( 1-\pi \right) }{n}}}\,|\,\pi =0.15\right) \\
& =P\left( \frac{0.1648-0.15}{\sqrt{\frac{0.15\cdot (0.85)}{350}}}
\,|\,\pi =0.15\right) =P\left( V\geq 0.775\,|\,\pi =0.15\right) .\end{align}</math>
In the standard normal distribution table we find <math>P\left( V\leq 0.775
\right)=0.7808</math> and thus have <math>\beta\left( \pi=0.15\right)=1-P\left( V\leq 0.775
\right)=1-0.7808=0.2192.</math>
Thus, compared to <math>\beta\left( \pi=0.15\right)</math> from the 1st alternative, the increase in the sample size has resulted in a sizeable reduction in the error type II probability for a true population proportion of <math>\pi=0.15</math>.

[[File:nl_s2_52_f_2.gif]]

A statistics professor has the impression that in the last year the university library has bought proportionally less new statistics books than in the past. Over the last couple of years the relative amount of statistics books amongst new purchases has consistently been more than <math>10</math> per cent. He asks one of his assistants to investigate whether this has changed in favour of other departments. Acting on behalf of his students whom he wants to secure as many new books as possible, he asks his assistant to minimize the risk of not complaining to the head of the library when the proportion of statistics books ''has'' decreased.
The assistant decides to have a sample of <math>25</math> books taken from the file containing the new purchases over the last <math>12</math> months. He wants to know how many of these are statistics books. He is thus dichotomizing the random variable ‘subject matter’ into the outcomes ‘statistics’ and ‘not statistics’. Of course, if you regard the purchases as an outcome of a decision-making process conducted by the librarians, this is anything but a random variable. But for the statisticians who rely on a sample because they don’t have access to all relevant information, it appears to be one. From the proportion of statistics books the assistant wants to infer to the population of all newly purchased books, using a statistical test to allow for deviations of the proportion in the sample from those in the population. In particular, he wants to verify whether the proportion has indeed dropped below the past average of <math>10</math> per cent. He will thus test the population proportion <math>\pi </math> and chooses a ‘standard’ of <math>0.05</math>.
=== Hypothesis ===
As the assistant wants to verify whether the proportion has dropped below <math>
0.1</math>, he has to employ a one-sided test. He recalls that the professor wants him to minimize the probability of not disclosing that the proportion has decreased below <math>\pi_{0}=0.1</math> when in reality it has. He thus opts for a right-sided test, i.e. puts the professors’ claim as null hypothesis in the hope of not rejecting it: <math>\text{H}_{0}: \pi \leq \pi_{0}=0.1 \quad \text{ versus } \quad\text{H}_{1}:
\pi > \pi_{0}=0.1.</math>
The assistant undertakes an investigation into the properties of this test with respect to the professors’ intention of minimizing the probability of not detecting a relative decrease in the statistics book supply. A real-world decrease can only not have been detected if the has been rejected even though it is really true. This situation is called type I error: <math>'\text{H}_{1}^{' }|\text{H}_{0}=\text{'conclude proportion of statistics books has not decreased'}|\text{in reality, the proportion has decreased}.</math> The maximum probability of this situation, <math>P\left( '\text{H}
_{1}^{' }|\text{H}_{0}\right) </math>, is given by the <math>\alpha </math>, which has been set to <math>0.05</math>. Thus, the risk the professor wanted to ‘minimize’ is under control.
If the null hypothesis is not-rejected, then a type II error can arise: <math>'\text{H}_{0}^{' }|\text{H}_{1}=\text{'conclude proportion of statistics books has decreased'}|\text{in reality, the proportion has not decreased}.</math> The probability of this happening (conditional on the null hypothesis not having been rejected), <math>P\left( '\text{H}_{1}^{' }|\text{H}
_{0}\right) =\beta </math>, is unknown, because the true proportion <math>\pi </math> (which is element of the parameter set specified by the ), is unknown. As we have already seen in other examples, it can be substantial, but the professors’ priorities lie on trading off type II error for type I error which is under control.

=== Test statistic and its distribution; decision regions ===
The estimator <math>X:</math> ‘number of statistics books in a sample of <math>25</math> books’ can serve as [[Glossary/en#T|test statistic]] <math>V</math>. Under <math>\text{H}_{0}</math>, <math>
V=X </math> has Binomial distribution with parameter <math>n=25</math> and <math>\pi =0.1</math>: <math>
V\thicksim B\left( 25;\,0.1\right) </math>. A relatively high number of statistics books in the sample supports the , that the proportion of statistics books has not decreased. The [[Glossary/en#C|critical value]] <math>c</math> is the realization of <math>X</math> , for which <math>F_{B}\left( c\right) </math> equals or exceeds <math>1-\alpha =0.05</math>, that is, we require <math>F_{B}\left( c-1\right) <1-\alpha =0.95</math> and <math>F_{B}\left(
c\right) \geq 1-\alpha =0.95</math>.
In the table of the cumulative of <math>B\left( 25;\,0.1\right) </math> you will find <math>c=5</math>.
The ''rejection region'' for H<math>_{0}</math> is thus<math>\left\{ v\,|\,v>5\right\} =\left\{ 6,7,\ldots ,25\right\} </math>, such that <math>P\left( V>5|0.1\right) =0.0334=\alpha _{a}<\alpha </math>.
As <math>V=X</math> is a discrete random variable, the given significance level isn’t fully utilized:<math>\alpha _{a}=0.0334<\alpha =0.05.</math>
The ''non-rejection region'' for H<math>_{0}</math> is given by<math>\left\{ v\,|\,v\leq 5\right\} =\left\{ 0,1,2,3,4,5\right\} </math>, such that <math>P\left( V\leq 5|0.01\right) =0.9666</math>.
=== Sampling and computing the test statistic ===
A subset of <math>25</math> books is selected at random from the list of last years’ new purchases and categorized in statistics and non-statistics books. As the total amount of new books is sufficiently large from a sample-theoretical point of view, a simple random sample is drawn, i.e. the sampling is carried out without replacement. The amount of statistics books in the sample is counted to be <math>x=3</math>, which will serve as the realized test statistic value <math>v</math>.
=== Test decision and interpretation ===
As <math>v=3</math> falls into the non-rejection region for H<math>_{0}</math>, the cannot be rejected. On the basis of a random sample of size <math>n=25</math> and a [[Glossary/en#S|significance level]] of <math>\alpha =0.05</math>, the assistant couldn’t verify statistically that the proportion of statistics books is still above <math>10</math> per cent. This test result means that a complaint to the library seems to be merited.
=== Power ===
Given our test parameters (<math>\pi _{0}=0.1</math>, <math>n=25</math>, <math>\alpha =0.05</math> and <math>c=5</math> ), what is the probability of not rejecting the null hypothesis if the true proportion of statistics books is <math>\pi =0.2</math>? That is, we want to calculate the probability of the type II error given a specific element of the parameter set associated with the [[Glossary/en#A|alternative hypothesis]], <math>
\pi =0.2</math>: <math>\beta \left( 0.2\right) =P\left( '\text{H}_{0}^{' }|\text{H}
_{1}\right) =P\left( V=X\in \,\text{non-rejection region for H}
_{0}\,|\,\pi =0.2\right) =P\left( V\leq 5\,|\,\pi =0.2\right) .</math>
In the table of the cumulative Binomial distribution <math>B\left(
25;\,0.2\right) </math> we find this probability to be <math>0.6167</math>. Alas, if the true proportion has increased to <math>20</math> per cent, there is still a <math>61.67</math> per cent chance of not discovering a significant deviation from the hypothetical boundary proportion of <math>10</math> per cent. This is the probability of an unjustified complaint issued by the professor given the proportion has risen to <math>0.2</math>—a substantial relative increase.
The probability of making a type II error contingent on alternative true proportions <math>\pi </math> can be computed via the power curve. Levels of <math>P\left(
\pi \right) </math> and <math>1-P\left( \pi \right) </math> for several values of <math>\pi </math> are listed in the following table.
{|class="wikitable"
!align="center"| <math>\pi</math>
!align="center"| True hypothesis
!align="center"| <math>P\left( \pi\right)</math>
!align="center"| <math>1-P\left( \pi\right)</math>
|-
|align="center"| <math>0</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0=\alpha</math>
|align="center"| <math>1=1-\alpha</math>
|-
|align="center"| <math>0.05</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0012=\alpha</math>
|align="center"| <math>0.9988=1-\alpha</math>
|-
|align="center"| <math>0.1</math>
|align="center"| <math>\text{H}_{0}</math>
|align="center"| <math>0.0334=\alpha_{a}</math>
|align="center"| <math>0.9666=1-\alpha_{a}</math>
|-
|align="center"| <math>0.15</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.1615=1-\beta</math>
|align="center"| <math>0.8385=\beta</math>
|-
|align="center"| <math>0.20</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.3833=1-\beta</math>
|align="center"| <math>0.6167=\beta</math>
|-
|align="center"| <math>0.25</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.6217=1-\beta</math>
|align="center"| <math>0.3783=\beta</math>
|-
|align="center"| <math>0.30</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.8065=1-\beta</math>
|align="center"| <math>0.1935=\beta</math>
|-
|align="center"| <math>0.35</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.9174=1-\beta</math>
|align="center"| <math>0.0826=\beta</math>
|-
|align="center"| <math>0.40</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.9706=1-\beta</math>
|align="center"| <math>0.0294=\beta</math>
|-
|align="center"| <math>0.45</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.9914=1-\beta</math>
|align="center"| <math>0.0086=\beta</math>
|-
|align="center"| <math>0.50</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.9980=1-\beta</math>
|align="center"| <math>0.0020=\beta</math>
|-
|align="center"| <math>0.60</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>0.9999=1-\beta</math>
|align="center"| <math>0.0001=\beta</math>
|-
|align="center"| <math>0.70</math>
|align="center"| <math>\text{H}_{1}</math>
|align="center"| <math>1=1-\beta</math>
|align="center"| <math>0=\beta</math>
|}
For example, if the true proportion (and therefore absolute amount) of statistics books is <math>\pi =0</math>, the sample cannot contain any statistics books and we will expect <math>x=0</math> and won’t reject the null hypothesis. The rejection of the null hypothesis (<math>'\text{H}_{1}^{' }</math>) is an impossible event with associated probability of zero. The [[Glossary/en#P|power]]is the conditional probability of rejecting the null hypothesis given the relative amount is zero: <math>P\left( 0\right) =P\left( V=X\in \,\text{rejection region for H}
_{0}\,|\,\pi =0\right) =P\left( '\text{H}_{1}^{' }\,|\,0\right) =0.</math>
If, on the other hand, the true proportion of statistics books is <math>\pi=0.35</math> , the power is calculated as <math>P\left( 0.35\right)=P\left( V>5\,|\,\pi=0.35\right)=1-P\left(
V\leq5\,|\,\pi=0.35\right)=1-0.0826=0.9174,</math> where <math>P\left( V\leq5\,|\,\pi=0.35\right)</math> can be looked up in the table of the cumulative [[Glossary/en#D|distribution function]] as the value of <math>
B\left( 25; \, 0.2\right)</math> for <math>c=5</math>.
<math>P\left( 0.35\right) </math> is the probability of correctly rejecting the null hypothesis, <math>P\left( '\text{H}_{1}^{' }|\text{H}_{1}\right) </math>. The probabilities of rejecting the null hypothesis and not-rejecting it must always sum up to one for any given true parameter value within the range specified by the [[Glossary/en#A|alternative hypothesis]]: <math>P\left( '\text{H}_{0}^{' }|\text{H}_{1}\right) +P\left( '\text{H}_{1}^{' }|\text{H}_{1}\right) =1.</math> For a true proportion of <math>\pi =0.35</math>, the former sampling result amounts to making a type II error, the probability of which is denoted by <math>\beta \left(
0.35\right) </math>. Thus, we can write <math>\beta \left( 0.35\right) +P\left( '\text{H}_{1}^{' }|\text{H}
_{1}\right) =1</math> or <math>P\left( '\text{H}_{1}^{' }|\text{H}_{1}\right) =1-\beta \left(
0.35\right) .</math> As <math>P\left( '\text{H}_{1}^{' }|\text{H}_{1}\right) </math> is the value of the power at point <math>\pi =0.35</math>, we can calculate the probability of making a type II error as <math>\beta \left( 0.35\right) =1-P\left( 0.35\right) =0.0826.</math> If the true proportion of statistics books is <math>35</math> per cent, <math>8.26</math> per cent of all samples of size <math>n=25</math> will lead to a non-rejection of the null hypothesis, i.e. won’t detect the significant difference between <math>
\pi =0.35</math> and <math>\pi _{0}=0.10</math>.
The following display depicts the graph of the power curve for the right-sided test we have just discussed: <math>\pi _{0}=0.10</math>, <math>n=25</math>, <math>\alpha
=0.05</math> and <math>c=5</math>.

[[File:nl_s2_52_f_1.gif]]