Indexing multimedia content for textual querying: A multimodal approach

Amrane, Abdesalam; Mellah, Hakima; Amghar, Youssef; Aliradi, Rachid

Indexing multimedia content for textual querying: A multimodal approach

Date

2013-07

Authors

Abstract

Multimedia retrieval approaches are classified into three categories: those using textual information, and those using low-level information and those that combine different information extracted from multimedia. Each approach has its advantages and disadvantages as well to improving multimedia retrieval systems. The recent works are oriented towards multimodal approaches. It is in this context that we propose an approach that combines the surrounding text with the information extracted from the visual content of multimedia and represented in the same repository in order to allow querying multimedia content based on keywords or concepts. Each word contained in queries or in description of multimedia is disambiguated by using the WordNet in order to define its semantic concept.

Keywords

Images classification, Automatic annotation, Multimedia retrieval, Query languages, Images classification, SVM classifier, SIFT descriptors, Semantic representation, Multimodal retrieval, Semantic similarity, Textual indexing.