Review Comment:
This well-written paper considers the problem of low ontology re-use on the web and suggests that convergence to a single ontology would increase re-use. It then evaluates two candidate ontologies against specific evaluation criteria and concludes the Wikidata ontology holds more promise for overall re-use than the schema.org ontology, primarily because of the limited scope of the latter. This is a timely discussion, given the popularity of lightweight ontologies amongst a certain cadre of users, mainly typical web developers, and is well worthy of publication. However, the paper would benefit from more exploration of the following:
- By advocating for the Wikidata ontology, or something like it, the authors effectively promote the development of another upper level ontology with domain extensions. But, in what sense is this better than adopting an existing upper-level ontology and extending it? The knock cited against importing upper-level ontologies is complexity and unintended inferences, but it is not evident that Wikidata is a better alternative: a casual perusal of the top of the Wikidata ontology reveals many similarities to other upper level ontologies, while its internal consistency is not discussed (see next point), so its logical implications are unclear. A similar question exists for the domain elements – how can a single ontology meet specialized needs? As it is unlikely to satisfy users of specialized ontologies, such as in the biosciences and others, does this mean the target audience consists of unspecialized users outside of narrow domains? If so, is this sufficient to increase overall re-use?
- Another issue is the downplay of the ontology quality criteria in the evaluation. While some quality criteria are considered, e.g. completeness and adaptability, other recognized criteria such as internal consistency and semantic accuracy (to intended meaning) are largely ignored. These ignored criteria are significant, because they represent challenges especially to bottom-up driven ontologies, which arguably have greater potential for contradiction and imprecision due to the lack of a top-down semantic backbone and reliance on variable input data. Greater consideration of these criteria in the evaluations would be more informative and effective.
Smaller issues:
- p1, l28, right - please reword: “we have discovered that the two main open-source upper ontologies other than BFO, DOLCE and SUMO, are not used in any of 430 Linked Open Datasets that were investigated for the study.”
- p1, l35, right - please elaborate: “unintended inferences that result from importing the upper ontology in a mid-level or domain ontology.” Is it that the upper-level ontologies are inconsistent, that the import reveals inconsistencies in the local ontology, or that there is a misalignment between ontologies?
- p2, l38, left - suggest: “raising doubts [about] its sustainability”
- p5, l20, left - please elaborate: “This means, for the ontology part, it reuses existing ontologies where possible, but mints URIs for terms in the Wikidata namespace.”
|