CS 8995 Corpus Based Natural Language Processing

Final Project: Empirical Methods for Multilingual Text

Stage 2 - Evaluation Program, as submitted by each team 4/16

Run your baseline algorithm and the gale-church algorithm with all 7 gold standard data sets. Evaluate these results with all 7 evaluation criteria. Follow the procedure from stage 1, where sentence alignment information is stripped from the gold standard data prior to running your alignment program. Compare the results of your alignment program with the gold standard alignment using the evaluation criteria. Report your results in the following format. This example is for team MORELIA using the CRUZAZUL evaluation criteria with both the baseline (-B) and Gale-Church (-CG) alignment programs. Your results should include 7*14=98 such entries.
MORELIA-B  CRUZAZUL CRUZAZUL precision recall accuracy
MORELIA-B  MORELIA CRUZAZUL precision recall accuracy
MORELIA-B  TOLUCA CRUZAZUL precision recall accuracy
MORELIA-B  UNAM CRUZAZUL precision recall accuracy
MORELIA-B  PACHUCA CRUZAZUL precision recall accuracy
MORELIA-B  TIGRES CRUZAZUL precision recall accuracy
MORELIA-B  PUEBLA CRUZAZUL precision recall accuracy        
MORELIA-GC CRUZAZUL CRUZAZUL precision recall accuracy
MORELIA-GC MORELIA CRUZAZUL precision recall accuracy
MORELIA-GC TOLUCA CRUZAZUL precision recall accuracy
MORELIA-GC UNAM CRUZAZUL precision recall accuracy
MORELIA-GC PACHUCA CRUZAZUL precision recall accuracy
MORELIA-GC TIGRES CRUZAZUL precision recall accuracy
MORELIA-GC PUEBLA CRUZAZUL precision recall accuracy   

by: Ted Pedersen - tpederse@d.umn.edu