Efficient semi-automated assessment of annotations trustworthiness

Journal of Trust Management

Table 6 Results of the evaluation of Algorithm 2 over the Steve.Museum dataset

Annotations	Accuracy	% of Dataset	Precision	Recall	F-measure
in each reputation		Covered by the Training set
5	0.84	0.25%	0.84	0.99	0.90
10	0.84	0.45%	0.84	0.99	0.90
15	0.84	0.66%	0.84	0.99	0.90
20	0.84	0.86%	0.84	0.99	0.90
25	0.84	1.04 %	0.84	0.99	0.90
30	0.84	1.22 %	0.84	0.99	0.90

Results of the evaluation of Algorithm 2 over the Steve.Museum dataset for training sets formed by aggregating 5, 10, 15, 20, 25 and 30 reputations per user. We report the percentage of dataset actually covered by the training set, the accuracy, the precision, the recall and the F-measure of our prediction.