A few Notes on Chi-Square Test.

General vs Specific Case.

The difference between the specific case (1 degree of  freedom) and the general case (2 or more degrees of freedom) is a technical one.  Using the specific case for problems involving 1 degree of freedom (two phenotypic classes) is the most conservative method. (formulas)

Level of significance.

The meaning of the outcome of any statistical test is evaluated according to the criterion set up by the experimenter.  This may reflect variables peculier to the experiment itself.  Very often the outcome is evaluated according to what is common practice in the scientific community.

The level of significance or p value reflects the experimenter's willingness to reject an experimental result that is actually correct.

Example: I carry out the cross Aa x Aa 100 times.  That is, I do the same experiment each time and I test the Null hypothesis that I will get a 3:1 ratio in each cross.  Some c2 values will be quite small and others will be quite large.  If I set my level of significant at .05, on average I will reject the results of 5 out of 100 of my replicate experiments because the c2 value will exceed my critical value of 3.84 (1 df). If I set my level of significant at .01, on average I will reject 1 out of 100 of my replicate experiments because the c2 value will exceed my critical value of 5.99 (1 df).  These two values are generally accepted by the academic community.

If I set my level of significance too low (some type of scientific zero tolerance), for example, p = .90 I would, on average,  90 out of 100 of my replicate experiments because the c2 value will exceed my critical value of .02 (1 df). If on the other hand, I set my level of significance really high (for example at the .0001 level ), I would almost never reject any results.  On the other hand I might accidentally accept results which are actually wrong.

 

A Chi-Square Table

Probability
  Accept         Reject 
Degrees of
Freedom
0.9 0.5 0.1 0.05 0.01
1 0.02 0.46 2.71 3.84 6.64
2 0.21 1.39 4.61 5.99 9.21
3 0.58 2.37 6.25 7.82 11.35
4 1.06 3.36 7.78 9.49 13.28
5 1.61 4.35 9.24 11.07 15.09