Image Label Wikification Collection (ILWC)

Image Label Wikification Collection (ILWC) is a test collection for evaluating systems that link descriptional labels of images to Wikipedia pages as the labels' entities. ILWC  consists of 450 images and a total of 2,280 user-assigned labels with manual correct annotations. 

This collection contains following files:

• image_URL.txt
• topics.txt
• rels.txt
• ImageCLEF_concepts.txt

image_URL.txt is a list of image files and Flickr URLs from which the files were downloaded.

topics.txt is a topic file. First two letters of topic ID in the topic file correspond to the collection category of animal names. The correspondence is as follows: 

1. Albatross
2. Bee
3. Bison
4. Boar
5. Coyote
6. Cricket
7. Jaguar
8. Kite
9. Llama
10. Mouse,
11. Panther
12. Quail,
13. Stingray
14. Tiger shark
15. Whippet

rels.txt is a list of correct Wikipedia pages for user-assigned image labels of the topics.

ImageCLEF_concepts.txt is a list of the used concepts in ImageCLEF2014 Scalable Concept Image Annotation task test collection for Image Label Wikification task.