Table 1 Variability to each error sources

Source of Variation df Mean Square Variance Component Standard Error % of Variability
Persons (p) 171 22.321 0.152 0.010 21.47
Item (i) 4 202.238 0.061 0.043 8.62
Rater (r) 3 57.554 0.010 0.011 1.41
Criteria (c) 3 201.284 0.048 0.045 6.78
Person by Item (pi) 684 3.008 0.141 0.010 19.92
Person by Rater (pr) 513 0.571 0.008 0.001 1.13
Person by Criteria (pc) 513 0.686 0.011 0.002 1.55
Item by Rater (ir) 12 12.615 0.016 0.007 2.26
Item by Criteria (ic) 12 20.776 0.028 0.011 3.95
Rater by Criteria (rc) 9 13.604 0.014 0.007 1.98
Person by Item by Rater (pir) 2,052 0.286 0.043 0.002 6.07
Rater by Item by Criteria (pic) 2,052 0.320 0.052 0.003 7.34
Rater by Rater by Criteria (prc) 1,539 0.134 0.004 0.001 0.56
Item by Rater by Criteria (irc) 36 1.518 0.008 0.002 1.13
(pir)+Residual 6,156 0.112 0.112 0.002 15.82
Total 13,759 10,821.660* 0.708 100.00
indicates the total value for sum of squares for score effect.