... tags used in this work include certainty ratings, ranging from 0, for least certain, to 3, for most certain. As dis- cussed below in section 3.2, the certainty ratings allow us to investigate ... portion of the training data. 10-fold cross validation is performed. The data is partitioned randomly into 10 different SFor the analysis in Table 3, certainty ratings 0 and 1, and 2 and 3 ... Four-Category Contingency Table ration, in which certainty ratings 0 and 1 are combined and ratings 2 and 3 are combined. Note that the analyses described in this section cannot be performed on the...