Sunday, December 18, 2011

Hello.
I guess it's really too late, but if somebody has a few minutes to spare, I would appreciate some guidance as how the following things work and what results do they actually produce:

trec_eval (ok run by itself)
plotRunDifference.pl (run as perl plotRunDifference.pl)
ProcessPR.pl (run as perl ProcessPR.pl)

Thank you.
PS. Yes, it's for the resit assignment, due tonight :)

2 comments:

  1. Sent you a mail with an example.

    ReplyDelete
  2. So... If I remember right, trec_eval compares the results of a query with a ground truth (the qrel file given with the project). So you run (in the terminal, or command prompt) something like:

    ./trec_eval ground_truth results

    where "ground_truth" is the file containing the ground truth, and "results" is a file where you saved the output of "IndriRunQuery"

    This gives you a text output.

    If you save such an output you can use the perl script to "visualize" it as a graph. plotRunDifference compares two trec_eval outputs, while ProcessPR produce the precision/recall graph for one trec_eval output.

    Running the scripts without parameters make them output the usage istructions

    Good luck :-)

    ReplyDelete