Binary classification is one of the most frequent studies in applied machine learning problems in various domains, from medicine to biology to meteorology to malware analysis. Many researchers use some performance metrics in their classification studies to report their success. However, the literature has shown a widespread confusion about the terminology and ignorance of the fundamental aspects behind metrics.
In our paper tittled "Binary Classification Performance Measures/Metrics: A Comprehensive Visualized Roadmap to Gain New Insights" clarifies the confusing terminology, suggests formal rules to distinguish between measures and metrics for the first time, and proposes a new comprehensive visualized roadmap in a leveled structure for 22 measures and 22 metrics for exploring binary classification performance.
Additionally, we introduced novel concepts such as canonical notation, duality, and complementation for measures/metrics, and suggested two new canonical base measures (TC and FC) simplifying equations.
It is expected that the study will guide other studies to have standardized approach to performance metrics for machine learning based solutions.
The roadmap can be considered as the "Periodic Table of Chemical Elements" in Machine Learning Binary Classification Performance Evaluation.
Figure: A glimpse of the binary classification performance measures/metrics
Canbek, G., Sagiroglu, S., Temizel, T. T., & Baykal, N. (2017). Binary Classification Performance Measures/Metrics: A Comprehensive Visualized Roadmap to Gain New Insights. In 2017 International Conference on Computer Science and Engineering (UBMK) (pp. 821–826). Antalya, Turkey: IEEE. http://doi.org/10.1109/UBMK.2017.8093539
IEEE Xplore: http://bit.ly/perfroadmap
Full-text at: http://phd.canbek.com/ArticlePerformanceMetricsRoadMap.pdf
Views: 6051
Tags: Accuracy, Binary, Classification, Confusion, Contingency, Learning, Machine, Matrix, Measures, Metrics, More…Ontology, Performance, Roadmap, Table, Visualization
Comment
Full text is now available.
Can the original document be made available here? IEEE has secured the document.
© 2021 TechTarget, Inc.
Powered by
Badges | Report an Issue | Privacy Policy | Terms of Service
Most Popular Content on DSC
To not miss this type of content in the future, subscribe to our newsletter.
Other popular resources
Archives: 2008-2014 | 2015-2016 | 2017-2019 | Book 1 | Book 2 | More
Most popular articles
You need to be a member of Data Science Central to add comments!
Join Data Science Central