The Q-Cochran analysis of variance, based on the Q-Cochran test, is described by Cochran (1950)1). This test is an extended McNemar test for dependent groups. It is used in hypothesis verification about symmetry between several measurements for the feature. The analysed feature can have only 2 values - for the analysis, there are ascribed to them the numbers: 1 and 0.
„incompatible” observed frequencies – the observed frequencies calculated when the value of the analysed feature is different in several measurements.
The test statistic is defined by:
– the value of -th measurement for -th object (so 0 or 1).
This statistic asymptotically (for large sample size) has the Chi-square distribution with a number of degrees of freedom calculated using the formula: .
The POST-HOC tests
Introduction to the contrasts and the POST-HOC tests was performed in the unit, which relates to the one-way analysis of variance.
For simple comparisons (frequency in particular measurements is always the same).
Example - simple comparisons (for the difference in proportion in a one chosen pair of measurements):
The settings window with the
Cochran Q ANOVA can be opened in
Cochran Q ANOVA or in ''Wizard''.
This test can be calculated only on the basis of raw data.
We want to compare the difficulty of 3 test questions. To do this, we select a sample of 20 people from the analysed population. Every person from the sample answers 3 test questions. Next, we check the correctness of answers (an answer can be correct or wrong). In the table, there are following scores:
Comparing the p value p=0.0077 with the significance level we conclude that individual test questions have different difficulty levels. We resume the analysis to perform POST-HOC test by clicking , and in the test option window, we select POST-HOC
The carried out POST-HOC analysis indicates that there are differences between the 2-nd and 1-st question and between questions 2-nd and 3-th. The difference is because the second question is easier than the first and the third ones (the number of correct answers the first question is higher).