A rank aggregation framework for video multimodal geocoding
Nenhuma Miniatura disponível
Data
2013-08-01
Autores
Li, Lin Tzy
Pedronette, Daniel Carlos Guimarães [UNESP]
Almeida, Jurandy
Penatti, Otávio A.B.
Calumby, Rodrigo Tripodi
Torres, Ricardo da Silva
Título da Revista
ISSN da Revista
Título de Volume
Editor
Resumo
This paper proposes a rank aggregation framework for video multimodal geocoding. Textual and visual descriptions associated with videos are used to define ranked lists. These ranked lists are later combined, and the resulting ranked list is used to define appropriate locations for videos. An architecture that implements the proposed framework is designed. In this architecture, there are specific modules for each modality (e.g, textual and visual) that can be developed and evolved independently. Another component is a data fusion module responsible for combining seamlessly the ranked lists defined for each modality. We have validated the proposed framework in the context of the MediaEval 2012 Placing Task, whose objective is to automatically assign geographical coordinates to videos. Obtained results show how our multimodal approach improves the geocoding results when compared to methods that rely on a single modality (either textual or visual descriptors). We also show that the proposed multimodal approach yields comparable results to the best submissions to the Placing Task in 2012 using no extra information besides the available development/training data. Another contribution of this work is related to the proposal of a new effectiveness evaluation measure. The proposed measure is based on distance scores that summarize how effective a designed/tested approach is, considering its overall result for a test dataset. © 2013 Springer Science+Business Media New York.
Descrição
Palavras-chave
Effectiveness measure, Multimodal retrieval, Rank aggregation, Video geotagging
Como citar
Multimedia Tools and Applications, p. 1-37.