Evaluation Results

The evaluation pages present the evaluation results of the semantic annoation process of the OASIS corpus

 

The Early Evaluation results page presents the results and annotation examples of the an early evaluation phase which involved manual annotation of ten summary extracts by three annotators

 

The Pilot Evaluation results page presents the results and annotation examples of the pilot evaluation phase which involved manual annotation of ten summary extracts by three annotators

 

The Main Evaluation results page presents the results and annotation examples of the main evaluation phase which involved manual annotation of sixty summary extracts by twelve archaeology experts divided into groups of two

 

The Gold Standard page makes available the Gold Standard corpus and the manual annotation instructions of the main evaluation phase