Mind the gap: another look at the problem of the semantic gap in image retrieval

J.S. Hare, P.H. Lewis, P.G.B. Enser, C.J. Sandom

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBN

Abstract

This paper attempts to review and characterise the problem of the semantic gap in image retrieval and the attempts being made to bridge it. In particular, we draw from our own experience in user queries, automatic annotation and ontological techniques. The first section of the paper describes a characterisation of the semantic gap as a hierarchy between the raw media and full semantic understanding of the media’s content. The second section discusses real users’ queries with respect to the semantic gap. The final sections of the paper describe our own experience in attempting to bridge the semantic gap. In particular we discuss our work on auto-annotation and semantic-space models of image retrieval in order to bridge the gap from the bottom up, and the use of ontologies, which capture more semantics than keyword ob ject labels alone, as a technique for bridging the gap from the top down.
Original languageEnglish
Title of host publicationProceedings of multimedia content analysis, management and retrieval 2006
EditorsE.Y. Chang, A. Hanjalic, N. Sebe
PublisherSPIE
Volume6073
ISBN (Print)081946113X
Publication statusPublished - 2006
EventProceedings of multimedia content analysis, management and retrieval 2006 -
Duration: 1 Jan 2006 → …

Conference

ConferenceProceedings of multimedia content analysis, management and retrieval 2006
Period1/01/06 → …

Keywords

  • Semantic Gap
  • Image Retrieval
  • Automatic Annotation
  • Ontologies
  • Cross Language Latent Semantic Indexing

Fingerprint Dive into the research topics of 'Mind the gap: another look at the problem of the semantic gap in image retrieval'. Together they form a unique fingerprint.

Cite this