| dief | Tools for Computing Diefficiency Metrics |
| diefk | Compute metric dief@k |
| diefk2 | Compute dief@k at a portion of the answer |
| dieft | Compute metric dief@t |
| experiment1 | Compares dief@t with other benchmark metrics as in <doi:10.1007/978-3-319-68204-4_1> |
| experiment2 | Compares dief@k at different answer portions as in <doi:10.1007/978-3-319-68204-4_1> |
| metrics | Example of benchmarking performance with other metrics |
| plotAnswerTrace | Plot the answer trace of approaches |
| plotExperiment1 | Generate radar plots that compare dief@t with other benchmark metrics in all tests as in <doi:10.1007/978-3-319-68204-4_1> |
| plotExperiment1Test | Generate radar plots that compare dief@t with other benchmark metrics in a specific test as in <doi:10.1007/978-3-319-68204-4_1> |
| plotExperiment2 | Generate radar plots that compare dief@k at different answer completeness in all tests as in <doi:10.1007/978-3-319-68204-4_1> |
| plotExperiment2Test | Generate radar plots that compare dief@k at different answer completeness in a specific test as in <doi:10.1007/978-3-319-68204-4_1> |
| traces | Example of answer traces |