A Conceptual Model for Ontology Quality Assessment

Tracking #: 3393-4607

Shyama Wilson
J. S. Goonetillake
Athula Ginige
W.A. Indika

Responsible editor: 
Aldo Gangemi

Submission type: 
Survey Article
With the continuous advancement of methods, tools, and techniques in ontology development, ontologies have emerged in various fields such as machine learning, robotics, biomedical informatics, agricultural informatics, crowdsourcing, database management, and the Internet of Things. Nevertheless, the nonexistence of a universally agreed methodology for specifying and evaluating the quality of an ontology hinders the success of ontology-based systems in such fields as the quality of each component is required for the overall quality of a system and in turn impacts the usability in use. Moreover, a number of anomalies in definitions of ontology quality concepts are visible, and in addition to that, the ontology quality assessment is limited only to a certain set of characteristics in practice even though some other significant characteristics have to be considered for the specified use-case. Thus, in this research, a comprehensive analysis was performed to uncover the existing contributions specifically on ontology quality models, characteristics, and the associated measures of these characteristics. Consequently, the characteristics identified through this review were classified with the associated aspects of the ontology evaluation space. Furthermore, the formalized definitions for each quality characteristic are provided through this study from the ontological perspective based on the accepted theories and standards. Additionally, a thorough analysis on the extent to which the existing works have covered the quality evaluation aspects is presented and the areas further to be investigated are outlined.
Full PDF Version: 


Solicited Reviews:
Click to Expand/Collapse
Review #1
Anonymous submitted on 08/Apr/2023
Review Comment:

The authors have addressed all my previous comments, in particular, they have now included a section that discusses the evaluation of ontological/conceptual modeling choices.
The topic of ontology evaluation remains challenging but I think that this survey is a very interesting contribution for the ontology engineering community.

Review #2
By Stefano De Giorgis submitted on 11/May/2023
Review Comment:

The authors reviewed the paper properly, I thank them for their patience and the dedicated work.
A final minor note: page 3, second column: "Instead of, the term ontology..." please rephrase, I don't think this sentece is correct.
The paper meets technical and content quality standards and is therefore ready for publication.
Thank you again for responding to corrections and improving the paper.