Material Detail

Using TREC for cross-comparison between classic IR and ontology-based search models at a Web scale

Using TREC for cross-comparison between classic IR and ontology-based search models at a Web scale

This video was recorded at Semantic Search (SemSearch) Workshop, Madrid 2009. The construction of standard datasets and benchmarks to evaluate ontology-based search approaches and to compare then against baseline IR models is a major open problem in the semantic technologies community. In this paper we propose a novel evaluation benchmark for ontology-based IR models based on an adaptation of the well-known Cranfield paradigm (Cleverdon, 1967) traditionally used by the IR community. The proposed benchmark comprises: 1) a text document collection, 2) a set of queries and their corresponding document relevance judgments and 3) a set of ontologies and Knowledge Bases covering the query topics. The document collection and the set of queries and judgments are taken from one of the most widely... Show More

Quality

  • User Rating
  • Comments
  • Learning Exercises
  • Bookmark Collections
  • Course ePortfolios
  • Accessibility Info

More about this material

Browse...

Disciplines with similar materials as Using TREC for cross-comparison between classic IR and ontology-based search models at a Web scale

Comments

Log in to participate in the discussions or sign up if you are not already a MERLOT member.
hidden