Hello.
I guess it's really too late, but if somebody has a few minutes to spare, I would appreciate some guidance as how the following things work and what results do they actually produce:
trec_eval (ok run by itself)
plotRunDifference.pl (run as perl plotRunDifference.pl)
ProcessPR.pl (run as perl ProcessPR.pl)
Thank you.
PS. Yes, it's for the resit assignment, due tonight :)
Sent you a mail with an example.
ReplyDeleteSo... If I remember right, trec_eval compares the results of a query with a ground truth (the qrel file given with the project). So you run (in the terminal, or command prompt) something like:
ReplyDelete./trec_eval ground_truth results
where "ground_truth" is the file containing the ground truth, and "results" is a file where you saved the output of "IndriRunQuery"
This gives you a text output.
If you save such an output you can use the perl script to "visualize" it as a graph. plotRunDifference compares two trec_eval outputs, while ProcessPR produce the precision/recall graph for one trec_eval output.
Running the scripts without parameters make them output the usage istructions
Good luck :-)