Serving FAIR Semantic Artefacts: A Review of Semantic Artefact Catalogues

Tracking #: 4074-5288

Authors: 
Clement Jonquet
Nina Grau
Guillaume Alviset
Baptiste Cecconi
Daniel Garijo
Maria Poveda
Martina Pulieri
Ilaria Rosati

Responsible editor: 
Sanju Tiwari

Submission type: 
Survey Article
Abstract: 
The growing number of ontologies and other semantic artefacts in data-intensive research has made their discovery, evaluation, and reuse a critical challenge. Semantic Artefact Catalogues (SACs) have emerged as key infrastructures to address these needs, yet their landscape seems fragmented and poorly characterised. Questions persist regarding which types of SACs exist (ontology repositories/libraries, vocabulary/terminology services, etc.), which are actively maintained, the domains they serve, and the technologies on which they are based. This paper presents a comprehensive current and historical review of SACs. The study focuses on their technologies, disciplinary scope, and capacity to enable FAIR principles for semantic artefacts. 190 SACs were identified and analysed, across 17 disciplines and relying on 12 “generic” technologies. To assess their FAIR-enabling potential, we defined ten dimensions derived from existing ontology FAIRness assessment frameworks and tools and assessed a subset of 60 SACs accordingly. The findings underscore both the diversity and fragmentation of SACs, while identifying opportunities for greater harmonisation and interoperability through shared, reusable technologies or APIs. A living version of the SAC review dataset is openly available (DOI: 10.5281/zenodo.12799861) and can be continuously updated or extended by the community to reflect new catalogues and developments.
Full PDF Version: 
Tags: 
Reviewed

Decision/Status: 
Reject

Solicited Reviews:
Click to Expand/Collapse
Review #1
Anonymous submitted on 06/Jun/2026
Suggestion:
Major Revision
Review Comment:

This manuscript addresses a relevant topic for the Semantic Web community, namely Semantic Artefact Catalogues (SACs), their technologies, disciplinary coverage, and their possible role in supporting FAIR semantic artefacts. I appreciate the effort involved in collecting a large number of SACs and in making an associated dataset available. However, I do not think the manuscript currently meets the expectations for a publishable survey article.

My main concern is that the manuscript is primarily an inventory of resources rather than a survey that offers substantial synthesis, critical analysis, or clear scientific insight. The work is extensive, but the contribution remains largely descriptive. After reading the manuscript, it is not sufficiently clear what new understanding the Semantic Web community gains beyond the observation that the SAC landscape is broad, fragmented, heterogeneous, and unevenly mature. These are useful observations, but they are not developed into strong, actionable, or conceptually significant conclusions.

1. Suitability as introductory text

As an introductory text for researchers, PhD students, or practitioners, the manuscript is only partially successful. It provides useful background and many examples, but it is too long, too descriptive, and not sufficiently structured around the needs of newcomers to the topic. A reader looking for an entry point into SACs may find the manuscript difficult to navigate because the core concepts, main system families, and practical implications are not sufficiently distilled.

A survey article should help readers understand the field, its conceptual structure, key debates, open problems, and decision points. In its current form, the manuscript mostly documents what exists. It does not sufficiently explain what lessons should be drawn from the inventory, what choices practitioners should make, or how the field should move forward.

2. Comprehensiveness and balance

The manuscript is comprehensive in the sense that it collects and classifies a large number of SACs. This is a strength. However, comprehensiveness alone is not enough for a survey article. The paper would need a more balanced and critical treatment of the material.

The review does not appear to follow a sufficiently systematic and reproducible protocol. The collection process relies substantially on author expertise, known sources, project networks, technology providers, and manual judgement. While this may be acceptable for an exploratory mapping exercise, it weakens the claim of a comprehensive scientific survey. The manuscript should not overstate the generality of its findings when the data collection and assessment procedures are partly informal and expert-driven.

This issue is particularly important for the FAIR-enabling assessment. The assessment is conducted only on a subset of active SACs, selected because the authors had direct expertise as providers, maintainers, or long-term users. This makes the results useful as informed observations, but not as a balanced or representative assessment of the whole landscape. The coarse-grained nature of the evaluation also limits the depth of the conclusions that can be drawn.

3. Readability and clarity

The manuscript is too long for the level of insight it provides. Several sections read like a project deliverable or technical report rather than a focused survey article. The historical background, technology descriptions, methodological details, and descriptive results could be substantially shortened or moved to supplementary material.

The main text does not sufficiently distinguish between essential findings and supporting details. The result is that the paper provides a large amount of information, but the argument remains diffuse. The conclusions mostly restate broad and expected points: fragmentation, heterogeneity, need for interoperability, and need for better FAIR support. These conclusions are valid, but not sufficiently novel or specific to justify the length and level of detail of the manuscript.

4. Importance to the broader Semantic Web community

The topic is important, but the manuscript does not yet demonstrate a sufficiently strong contribution to the broader Semantic Web community. The most valuable output appears to be the dataset, not the paper itself. The article should provide interpretation, conceptual framing, and actionable recommendations that go beyond the dataset. At present, the manuscript does not sufficiently answer the “so what?” question.

For example, the paper could have provided clearer answers to questions such as: Which SAC technologies are most sustainable and why? Which communities should consolidate rather than create new catalogues? What minimum FAIR-enabling capabilities should all SACs provide? Which forms of interoperability should be prioritised? Which types of duplication are harmful, and which are acceptable? Without stronger answers to such questions, the paper remains mainly descriptive.

Assessment of the data file provided under “Long-term stable URL for resources”

The authors provide a dataset through Zenodo, which is an appropriate repository for long-term preservation and discoverability. However, the data package appears insufficiently documented. I could not identify a separate README file explaining the structure of the spreadsheet, the meaning of the fields, the coding decisions, the assessment procedure, or the limitations of the data.

The spreadsheet is useful as an inventory, but it is not sufficient for replication. To reproduce the study, one would need a clearer protocol for identifying SACs, deduplicating entries, assigning status/type/discipline/technology labels, and performing the FAIR-enabling assessment. The FAIR-enabling evaluation especially depends on expert judgement, and the dataset should provide more provenance and justification for the assigned levels.

The data artifacts therefore appear incomplete. At minimum, the authors should provide a README, a data dictionary, a frozen version of the dataset used for the manuscript, scripts or notebooks used to generate the reported figures and statistics, and documentation of the assessment process.

Review #2
Anonymous submitted on 27/Jul/2026
Suggestion:
Reject
Review Comment:

This paper reviews and analyses various Semantic Artefact Catalogues (such as ontology repositories and vocabulary portals) to understand how they host, manage, and serve resources like ontologies. Furthermore, it evaluates how well these platforms adhere to and support the FAIR data principles within open science infrastructures. Although this paper holds valuable potential for publication, its overall presentation requires substantial revision to effectively communicate the research.

The manuscript fails to clearly articulate its primary research contribution early on. Furthermore, the specific scope regarding domain and discipline selection remains ambiguous throughout the text.

The methodology lacks formal specification and would benefit significantly from an explicit step-by-step guide or a workflow diagram. The evaluation approach for FAIR-enabling is particularly opaque regarding roles and decision-making processes, and the diverse sources utilised in the study are not properly disclosed.

The related work section lacks a concluding summary with a breakdown of past achievements, existing gaps, and what remains necessary to motivate the authors' current work.

There are many incorrect or missing citations such as referencing evaluation tools or libraries long after their initial mention instead of providing citations upfront. Additionally, critical terminology lacks formal definitions upon first appearance, and reference lists are incomplete or non-actionable due to missing hyperlinks.

There are strong markers of unedited AI text generation, including excessive use of semicolons, awkward hyphenation, and overly casual transitional phrasing (such as starting sentences with "Plus"). At times, the text can be seen as a commentary/report rather than a scientific academic survey and analysis.

Beyond content, the paper fails to adhere to the official journal template, and stylistic formatting errors such as table and figure captions being misaligned with their respective tables need correction. There are no section numbers or any hierarchical structure in the paper, no page numbers as well. This makes navigating the paper a challenge for the reader.