Early Evaluation Phase

Keith May Douglas Tudhope Ceri Binding Andreas Vlachidis

Annotation Samples

Summary Corpus
First Attempt
OPTIMA

Early Evaluation Results

Keith May Thomas Brughmans Douglas Tudhope Ceri Binding Andreas Vlachidis
First Attempt (ISKO)
Trial Annotation Types
Precision: 0.68
Recall: 0.70
fMeasure : 0.56
...Details
- Precision: 0.72
Recall: 0.61
fMeasure : 0.56
...Details
Precision: 0.68
Recall: 0.68
fMeasure : 0.56
...Details
Precision: 0.85
Recall: 0.85
fMeasure : 0.76
...Details
First Attempt
CRM Annotation Types
Precision: 0.52
Recall: 0.40
fMeasure : 0.39
...Details
Precision: 0.33
Recall: 0.27
fMeasure : 0.27
...Details
Precision: 0.55
Recall: 0.48
fMeasure : 0.44
...Details
Precision: 0.54
Recall: 0.50
fMeasure : 0.45
...Details
Precision: 0.70
Recall: 0.81
fMeasure : 0.69
...Details
OPTIMA
CRM Annotation Types
Precision: 0.60
Recall: 0.49
fMeasure : 0.45
...Details
Precision: 0.32
Recall: 0.40
fMeasure : 0.33
...Details
Precision: 0.54
Recall: 0.48
fMeasure : 0.41
...Details
Precision: 0.50
Recall: 0.45
fMeasure : 0.36
...Details
Precision: 0.42
Recall: 0.47
fMeasure : 0.30
...Details