Show simple item record

dc.contributor.authorPowers, David Martin
dc.date.accessioned2013-11-08T00:30:46Z
dc.date.available2013-11-08T00:30:46Z
dc.date.issued2011-12-15
dc.identifier.citationPowers, D.M.W., 2011. Evaluation: from Precision, Recall and F-measure to ROC, Informedness, Markedness and Correlation. Journal of Machine Learning Technologies, 2(1), 37-63.en
dc.identifier.issn2229-3981
dc.identifier.urihttp://hdl.handle.net/2328/27165
dc.description.abstractCommonly used evaluation measures including Recall, Precision, F-Measure and Rand Accuracy are biased and should not be used without clear understanding of the biases, and corresponding identification of chance or base case levels of the statistic. Using these measures a system that performs worse in the objective sense of Informedness, can appear to perform better under any of these commonly used measures. We discuss several concepts and measures that reflect the probability that prediction is informed versus chance. Informedness and introduce Markedness as a dual measure for the probability that prediction is marked versus chance. Finally we demonstrate elegant connections between the concepts of Informedness, Markedness, Correlation and Significance as well as their intuitive relationships with Recall and Precision, and outline the extension from the dichotomous case to the general multi-class case.en
dc.language.isoen
dc.publisherBioinfo Publicationsen
dc.relationhttp://purl.org/au-research/grants/ARC/DP0988686en
dc.rightsAuthor retains copyright of this version.en
dc.subjectComputational linguisticsen
dc.subjectComputer scienceen
dc.subjectArtificial intelligenceen
dc.titleEvaluation: from Precision, Recall and F-measure to ROC, Informedness, Markedness and Correlationen
dc.typeArticleen
dc.relation.grantnumberARC/DP0988686
dc.rights.holderCopyright Bioinfo Publicationsen
dc.rights.licenseIn Copyright
local.contributor.authorOrcidLookupPowers, David Martin: https://orcid.org/0000-0001-5998-2262en_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record