CERTH participated in the ImageCLEF 2012 Flickr photo annotation task

CERTH participated in ImageCLEF Photo Annotation and Retrieval 2012, and more specifically in the first subtask, namely Visual and Concept detection, annotation using Flickr photos. 

The objective of taking part in the competition was to evaluate two multimedia indexing approaches developed within SocialSensor and to compare the performance of methods using different sets of image features.

The first of the tested approaches constructs a similarity graph that includes both train and test images and trains concepts detectors using the graph Laplacian Eigenmaps (LE) as features. The second approach utilizes the concept of a “same class” model which takes as input the set of distances between the image to be annotated and a reference item representing a target concept, and predicts if the image belongs to the target concept.

Five runs were submitted. Run 1 ranked 5th out of 17 text-based methods (MiAP) and 7th (GMiAP, F-ex). The performance of the visual-based run (#2) was close to the median performance, ranking 13th out of 28 visual-based ones (MiAP, GMiAP) and 10th (F-ex). Finally, the multimodal runs ranked above average compared to competition. For instance, Run 3 ranked 15th out of the 35 multimodal runs (MiAP, GMiAP) and 18th (F-ex). Detailed results are accessible at the official task page.