Submission agreement versus average article rank. The relation of submission agreement among different runs to the average rank of the articles is presented for both relevant and nonrelevant articles. The overall agreement between systems was lower for nonrelevant articles (R2relevant = 0.7 versus R2nonrelevant = 0.59). In general, the higher the average rank of the article, the more systems agreed on the correct classification.
Krallinger et al. Genome Biology 2008 9(Suppl 2):S4 doi:10.1186/gb-2008-9-s2-s4