Review Comment:
This manuscript was submitted as 'full paper' and should be reviewed along the usual dimensions for research contributions which include (1) originality, (2) significance of the results, and (3) quality of writing. Please also assess the data file provided by the authors under “Long-term stable URL for resources”. In particular, assess (A) whether the data file is well organized and in particular contains a README file which makes it easy for you to assess the data, (B) whether the provided resources appear to be complete for replication of experiments, and if not, why, (C) whether the chosen repository, if it is not GitHub, Figshare or Zenodo, is appropriate for long-term repository discoverability, and (4) whether the provided data artifacts are complete. Please refer to the reviewer instructions and the FAQ for further information.
Summary:
The paper proposes a novel two-stage Semantic-Based Image Retrieval (SBIR) system supported by Ontology, aiming to address the Semantic Gap in traditional Image Retrieval approaches. In the first stage, Object Detection and a Bi-directional Recurrent Neural Network (Bi-RNN) model are employed to determine relationships between objects. The second stage involves converting these relationships into Ontologies for more effective semantic similarity searches. The study introduces a method for measuring Semantic Gap using entropy.
Contributions:
Novel Ontology-Supported Approach: The paper introduces a unique two-stage SBIR approach that utilizes Ontologies for improved semantic representation and retrieval.
Effective Use of Visual Genome Dataset: The study employs the Visual Genome dataset for training the model and generating ontologies, contributing to the credibility of the research.
Innovative Semantic Gap Measurement: The use of entropy, specifically the Joint Entropy method, for measuring the Semantic Gap between images adds a novel quantitative dimension to the evaluation.
Strengths:
Originality:
The paper demonstrates a high level of originality by combining Object Detection, Bi-RNN models, and Ontology in a novel two-stage SBIR approach. The introduction of entropy for Semantic Gap measurement further contributes to the originality of the study.
Significance of Results:
The proposed approach, especially the second stage utilizing Ontologies, is shown to yield more effective results in semantic similarity searches compared to existing methods. The introduction of a quantitative measure for Semantic Gap provides a valuable contribution to the field.
Quality of Writing:
The writing is generally clear and concise, with well-organized sections. The technical details, such as the Word Embedding process, Bi-RNN model description, and Ontology creation, are presented in a detailed manner.
Comments-
Weak points have been addressed in the revised version, manuscript can be considered for acceptance.
|