Comparing sets of patterns with the Jaccard index

Sam Fletcher, Md Zahidul Islam

Abstract


The ability to extract knowledge from data has been the driving force of Data Mining since its inception, and of statistical modeling long before even that. Actionable knowledge often takes the form of patterns, where a set of antecedents can be used to infer a consequent. In this paper we offer a solution to the problem of comparing different sets of patterns. Our solution allows comparisons between sets of patterns that were derived from different techniques (such as different classification algorithms), or made from different samples of data (such as temporal data or data perturbed for privacy reasons). We propose using the Jaccard index to measure the similarity between sets of patterns by converting each pattern into a single element within the set. Our measure focuses on providing conceptual simplicity, computational simplicity, interpretability, and wide applicability. The results of this measure are compared to prediction accuracy in the context of a real-world data mining scenario.

Keywords


Machine Learning; Metrics; Data Mining; Patterns; Rules; Utility Measures; Quality Evaluation

Full Text:

PDF


DOI: http://dx.doi.org/10.3127/ajis.v22i0.1538

License URL: https://creativecommons.org/licenses/by-nc/3.0/au/

Creative Commons License
ISSN: Online: 1326-2238 Hard copy: 1449-8618
This work is licensed under a Creative Commons Attribution-NonCommercial Licence. Uses the Open Journal Systems. Web design by TomW.