Skip to main content

Introducing an Evaluation Method for Taxonomies

Abstract

Background: Taxonomies are crucial for the development of a research field, as they play a major role in structuring a complex body of knowledge and help to classify processes, approaches, and solutions. While there is an increasing interest in taxonomies in the software engineering (SE) research field, we observe that SE taxonomies are rarely evaluated. Aim: To raise awareness and provide operational guidance on how to evaluate a taxonomy, this paper presents a three step evaluation method evaluating its structure, applicability, and purpose. Method: To show the feasibility and applicability of our approach, we provide a running example and additionally illustrate our approach to a practical case study in SE research. Results and Conclusion: Our method with operational guidance enables SE researchers to systematically evaluate and improve the quality of their taxonomies and support reviewers to systematically assess a taxonomy’s quality.

Download Preprint

BibTeX

@inproceedings{kaplan_introducing_2022,
author = {Kaplan, Angelika and K\"{u}hn, Thomas and Hahner, Sebastian and Benkler, Niko and Keim, Jan and Fuch\ss{}, Dominik and Corallo, Sophie and Heinrich, Robert},
title = {Introducing an Evaluation Method for Taxonomies},
year = {2022},
isbn = {9781450396134},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3530019.3535305},
doi = {10.1145/3530019.3535305},
booktitle = {The International Conference on Evaluation and Assessment in Software Engineering 2022},
pages = {311–316},
numpages = {6},
keywords = {meta-research in software engineering, taxonomies, evaluation},
location = {Gothenburg, Sweden},
series = {EASE 2022}
}