Early Evaluation Phase
Keith May | Douglas Tudhope | Ceri Binding | Andreas Vlachidis |
Annotation Samples
Summary Corpus | |
First Attempt | |
OPTIMA |
Early Evaluation Results
Keith May | Thomas Brughmans | Douglas Tudhope | Ceri Binding | Andreas Vlachidis | |
First Attempt (ISKO) Trial Annotation Types |
Precision: 0.68 Recall: 0.70 fMeasure : 0.56 ...Details |
- | Precision: 0.72 Recall: 0.61 fMeasure : 0.56 ...Details |
Precision: 0.68 Recall: 0.68 fMeasure : 0.56 ...Details |
Precision: 0.85 Recall: 0.85 fMeasure : 0.76 ...Details |
First Attempt CRM Annotation Types |
Precision: 0.52 Recall: 0.40 fMeasure : 0.39 ...Details |
Precision: 0.33 Recall: 0.27 fMeasure : 0.27 ...Details |
Precision: 0.55 Recall: 0.48 fMeasure : 0.44 ...Details |
Precision: 0.54 Recall: 0.50 fMeasure : 0.45 ...Details |
Precision: 0.70 Recall: 0.81 fMeasure : 0.69 ...Details |
OPTIMA CRM Annotation Types |
Precision: 0.60 Recall: 0.49 fMeasure : 0.45 ...Details |
Precision: 0.32 Recall: 0.40 fMeasure : 0.33 ...Details |
Precision: 0.54 Recall: 0.48 fMeasure : 0.41 ...Details |
Precision: 0.50 Recall: 0.45 fMeasure : 0.36 ...Details |
Precision: 0.42 Recall: 0.47 fMeasure : 0.30 ...Details |