Gabriella Kazai

INEX REPORT (2010)

Gianluca Demartini, Ludovic Denoyer, Antoine Doucet, Khairun Nisa Fachry, Patrick Gallinari, Shlomo Geva, ...

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their...

Model for Voter Scoring and Best Answer Selection in Community Q&A Services (2009)

Chong Tong Lee, Eduarda Mendes Rodrigues, Gabriella Kazai, Nataša Milić-frayling, Ar Ignjatović

Abstract—Community Question Answering (cQA) services, such as Yahoo! Answers and MSN QnA, facilitate knowledge sharing through question answering by an online community of users. These services...

G.: Overview of the INitiative for the Evaluation of XML retrieval (INEX) 2002 (2009)

Norbert Gövert, Gabriella Kazai

The INitiative for the Evaluation of XML retrieval (INEX) aims at providing an infrastructure for evaluating the effectiveness of content-oriented XML retrieval. In the first round of INEX, in 2002,...

Reliability Tests for the XCG and inex-2002 Metrics (2009)

Gabriella Kazai, Mounia Lalmas, Arjen De Vries

Abstract. In this paper we compare the effectiveness scores and system rankings obtained with the inex-2002 metric, the official measure of INEX 2004, and the XCG metrics proposed in [4] and further...

General Terms (2008)

Gabriella Kazai

This paper looks at a number of issues regarding the evaluation of XML retrieval. It aims to identify what the requirements on a measure of XML retrieval effectiveness are and how the actual...

INEX 2007 Evaluation Measures (Draft) (2008)

Jovan Pehcevski, Jaap Kamps, Gabriella Kazai, Mounia Lalmas, Benjamin Piwowarski, Stephen Robertson

Abstract. This paper describes the official measures of retrieval effectiveness that are planned to be employed for the ad hoc track of INEX 2007. 1

Broadcast Internet (2008)

Gabriella Kazai, Alan Pearmain, Marie-luce Bourguet, Mounia Lalmas

which brings together key broadcasters, researchers, academics and industrialists across Europe, to advance the convergence of broadcasting and the Internet. SAVANT is developing integrated broadcast...

SEARCHING ANNOTATED BROADCAST CONTENT ON MOBILE AND STATIONARY DEVICES (2007)

Gabriella Kazai, Mounia Lalmas, Alan Pearmain, Marie-luce Bourguet

This paper describes, within the framework of the European IST SAVANT project, the development of a search engine that supports transparent access to annotated broadcast content from different types...

Preface (2007)

Schloss Dagstuhl, Norbert Fuhr, Norbert Gövert, Gabriella Kazai, Mounia Lalmas

The widespread use of XML in digital libraries, product catalogues, scientific data repositories and across the Web prompted the development of appropriate retrieval (searching and browsing) methods...

Aggregated Representation for the Focussed Retrieval of Structured Documents (2007)

Gabriella Kazai, Mounia Lalmas, Thomas Rölleke

Effective retrieval of structured documents should exploit the content and structural knowledge associated with the documents. This knowledge can be used to focus retrieval to the best entry points:...

INEX 2007 Evaluation Measures (2007)

Pehcevski, Jovan, Kamps, Jaap, Kazai, Gabriella, Lalmas, Mounia, Ogilvie, Paul, Piwowarski, Benjamin, ...

This paper describes the official measures of retrieval effectiveness that are planned to be employed for the ad hoc track of INEX 2007.

INEX 2006 Evaluation Measures (2007)

Lalmas, Mounia, Kazai, Gabriella, Kamps, Jaap, Pehcevski, Jovan, Piwowarski, Benjamin, Robertson, Stephen

This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006.

INEX 2007 Evaluation Measures (2007)

Pehcevski, Jovan, Kamps, Jaap, Kazai, Gabriella, Lalmas, Mounia, Ogilvie, Paul, Piwowarski, Benjamin, ...

This paper describes the official measures of retrieval effectiveness that are planned to be employed for the ad hoc track of INEX 2007.

INEX 2006 Evaluation Measures (2007)

Lalmas, Mounia, Kazai, Gabriella, Kamps, Jaap, Pehcevski, Jovan, Piwowarski, Benjamin, Robertson, Stephen

This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006.

Users’ perspectives on the usefulness of structure for XML information retrieval (2007)

Gabriella Kazai, Andrew Trotman

Abstract: The widespread use of the eXtensible Markup Language (XML) on the Web and in digital libraries has led to a drastic increase in the number of XML Information Retrieval (IR) systems being...

INEX 2006 evaluation measures (2007)

Mounia Lalmas, Gabriella Kazai, Jaap Kamps, Jovan Pehcevski, Stephen Robertson

Abstract. This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006. 1

INEX 2007 evaluation measures (2007)

Jaap Kamps, Jovan Pehcevski, Gabriella Kazai, Mounia Lalmas, Stephen Robertson

Abstract. This paper describes the official measures of retrieval effectiveness that are employed for the Ad Hoc Track at INEX 2007. Whereas in earlier years all, but only, XML elements could be...

INEX 2007 Evaluation Measures (2007)

Pehcevski, Jovan, Kamps, Jaap, Kazai, Gabriella, Lalmas, Mounia, Ogilvie, Paul, Piwowarski, Benjamin, ...

This paper describes the official measures of retrieval effectiveness that are planned to be employed for the ad hoc track of INEX 2007.

INEX 2006 Evaluation Measures (2007)

Lalmas, Mounia, Kazai, Gabriella, Kamps, Jaap, Pehcevski, Jovan, Piwowarski, Benjamin, Robertson, Stephen

This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006.

INEX 2007 Evaluation Measures (2007)

Pehcevski, Jovan, Kamps, Jaap, Kazai, Gabriella, Lalmas, Mounia, Ogilvie, Paul, Piwowarski, Benjamin, ...

This paper describes the official measures of retrieval effectiveness that are planned to be employed for the ad hoc track of INEX 2007.

INEX 2006 Evaluation Measures (2007)

Lalmas, Mounia, Kazai, Gabriella, Kamps, Jaap, Pehcevski, Jovan, Piwowarski, Benjamin, Robertson, Stephen

This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006.

INEX 2007 evaluation measures (2007)

Jaap Kamps, Jovan Pehcevski, Gabriella Kazai, Mounia Lalmas, Stephen Robertson

Abstract. This paper describes the official measures of retrieval effectiveness that are employed for the Ad Hoc Track at INEX 2007. Whereas in earlier years all, but only, XML elements could be...

Overview of inex 2005 (2006)

Saadia Malik, Gabriella Kazai, Mounia Lalmas, Norbert Fuhr

Abstract. Since 2002, INEX has been working towards the goal of establishing an infrastructure, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of...

M.: INEX 2005 evaluation measures (2006)

Gabriella Kazai, Mounia Lalmas

Abstract. This paper describes the official measures of retrieval effectiveness employed in INEX 2005: the eXtended Cumulated Gain (XCG) measures. In addition, results of correlation analysis are...

What does Shakespeare have to do with INEX (2006)

Gabriella Kazai

Since 2002, the INitiative for the Evaluation of XML Retrieval (INEX) has been building an XML test collection for the evaluation of content-oriented XML search systems. In 2006, INEX extended its...

Relevance Feedback for Structural Query Expansion (2006)

Schenkel, Ralf, Theobald, Martin, Fuhr, Norbert, Lalmas, Mounia, Malik, Saadia, Kazai, Gabriella

Keyword-based queries are an important means to retrieve information from XML collections with unknown or complex schemas. Relevance Feedback integrates relevance information provided by a user to...

TopX & XXL at INEX 2005 (Ad-Hoc Track) (2006)

Theobald, Martin, Schenkel, Ralf, Weikum, Gerhard, Fuhr, Norbert, Lalmas, Mounia, Malik, Saadia, ...

We participated with two different and independent search engines in this year's INEX round: The XXL Search Engine and the TopX engine. As this is the first participation for TopX, this paper focuses...

A metadata model supporting scalable interactive TV services (2005)

Gwenael Durand, Gabriella Kazai, Mounia Lalmas, Uwe Rauschenbach, Patrick Wolf

In this paper, we introduce a novel metadata model for describing scalable and interactive TV services that can be enriched with supplemental multimedia information. The model allows users to access...

TopX & XXL at INEX 2005 (2005)

Theobald, Martin, Schenkel, Ralf, Weikum, Gerhard, Fuhr, Norbert, Lalmas, Mounia, Malik, Saadia, ...

We participated with two different and independent search engines in this year's INEX round: The XXL Search Engine and the TopX engine. As this is the first participation for TopX, this paper focuses...

Relevance Feedback for Structural Query Expansion (2005)

Schenkel, Ralf, Theobald, Martin, Fuhr, Norbert, Lalmas, Mounia, Malik, Saadia, Kazai, Gabriella

eyword-based queries are an important means to retrieve information from XML collections with unknown or complex schemas. Relevance Feedback integrates relevance information provided by a user to...

A metadata model supporting scalable interactive TV services (2005)

Gwenaël Durand, Uwe Rauschenbach, Gabriella Kazai, Mounia Lalmas, Patrick Wolf

In this paper, we introduce a novel metadata model for describing scalable and interactive TV services that can be enriched with supplemental multimedia information. The model allows users to access...

Scalable and Personalised broadcast service (2004)

James Bywater, Marie-luce Bourguet, Gabriella Kazai, Mounia Lalmas, Alan Pearmain

An aspect of the European IST SAVANT (Synchronised and Scalable Audio Visual content Across NeTworks) project is the personalisation of interactive TV systems combining broadcast programmes with...

European Research Letter (2004)

Report On The, Gabriella Kazai, Mounia Lalmas, Norbert Fuhr, Norbert Gövert

this article, we provide an overview of the first round of the INEX initiative

A study of the assessment of relevance for the INEX'02 test collection (2004)

Gabriella Kazai, Sherezad Masood, Mounia Lalmas

We investigate possible assessment trends and inconsistencies within the collected relevance assessments of the INEX'02 test collection in order to provide a critical analysis of the employed...

A General Matrix Framework for Modelling Information Retrieval (2004)

Thomas Rölleke, Theodora Tsikrika, Gabriella Kazai

In this paper, we present a well-defined general matrix framework for modelling Information Retrieval (IR). In this framework, collections, documents and queries correspond to matrix spaces....

The Overlap Problem in Content-Oriented XML Retrieval Evaluation (2004)

Gabriella Kazai, Mounia Lalmas, Arjen P. De Vries

Within the INitiative for the Evaluation of XML Retrieval (INEX) a number of metrics to evaluate the effectiveness of content-oriented XML retrieval approaches were developed. Although these metrics...

Tolerance to Irrelevance: A User-effort Oriented Evaluation of Retrieval Systems without Predefined Retrieval Unit (2004)

Arjen P. De Vries, Gabriella Kazai, Mounia Lalmas

Video and XML retrieval test collections call for evaluation metrics that do not require a predefined retrieval unit. The use of traditional recall and precision metrics is problematic due to issues...

Searching Annotated Broadcast Content on Mobile and Stationary Devices (2004)

Gabriella Kazai, Mounia Lalmas, Alan Pearmain, Marie-luce Bourguet

This paper describes, within the framework of the European IST SAVANT project, the development of a search engine that supports transparent access to annotated broadcast content from different types...

Tolerance to Irrelevance: A User-effort Oriented Evaluation of Retrieval Systems without Predefined Retrieval Unit (2004)

Arjen P. De Vries, Gabriella Kazai, Mounia Lalmas

Video and XML retrieval test collections call for evaluation metrics that do not require a predefined retrieval unit. The use of traditional recall and precision metrics is problematic due to issues...

Scalable and Personalised broadcast service (2004)

James Bywater, Marie-luce Bourguet, Gabriella Kazai, Mounia Lalmas, Alan Pearmain

An aspect of the European IST SAVANT (Synchronised and Scalable Audio Visual content Across NeTworks) project is the personalisation of interactive TV systems combining broadcast programmes with...

The overlap problem in content-oriented XML retrieval evaluation (2004)

Gabriella Kazai, Mounia Lalmas, Arjen P. De Vries

Within the INitiative for the Evaluation of XML Retrieval (INEX) a number of metrics to evaluate the effectiveness of content-oriented XML retrieval approaches were developed. Although these metrics...

Scalable and Personalised broadcast service (2004)

James Bywater, Marie-luce Bourguet, Gabriella Kazai, Mounia Lalmas, Alan Pearmain

An aspect of the European IST SAVANT (Synchronised and Scalable Audio Visual content Across NeTworks) project is the personalisation of interactive TV systems combining broadcast programmes with...

The INEX Evaluation Initiative (2003)

Gabriella Kazai, Norbert Gövert, Mounia Lalmas, Norbert Fuhr

The widespread use of the extensible Markup Language (XML) on the Web and in Digital Libraries brought about an explosion in the development of XML tools, including systems to store and access XML...

Overview of the Initiative for the Evaluation of XML retrieval (INEX) 2002 (2003)

Norbert Gövert, Gabriella Kazai

The INitiative for the Evaluation of XML retrieval (INEX) aims at providing an infrastructure for evaluating the effectiveness of content-oriented XML retrieval. In the first round of INEX, in 2002,...

A General Matrix Framework for Modelling Information Retrieval (2003)

Thomas Rölleke, Theodora Tsikrika, Gabriella Kazai

Content-oriented retrieval models are based on a document-term matrix, whereas link-oriented retrieval models are based on an adjacent (parentchild) matrix. Term frequency and inverse document...

Using Metadata To Provide Scalable Broadcast And (2003)

Internet Content And, Gabriella Kazai, Mounia Lalmas, Marie-luce Bourguet, Alan Pearmain

This paper deals with the use of metadata standards such as MPEG-7 and MPEG-21 to drive the automatic adaptation and personalisation of scalable broadcast and Internet content and services

Using Metadata to Provide Synchronised and Scalable Broadcast and Internet Content and Services (2003)

Gabriella Kazai, Mounia Lalmas, Marie-luce Bourguet, Alan Pearmain

This paper describes two scenarios demonstrating the application of the scalable content and services, and provides an overview of the SAVANT system, in particular, the terminal where users access...

Report of the INEX 2003 Metrics working group (2003)

Gabriella Kazai

This paper summarises the discussions of the metrics working group at the INEX 2003 Workshop, Dagstuhl, Dec 15-17 2003. Members of the group were Djoerd Hiemstra (U. of Twente), Jaap Kamps (ILLC, U....

Evaluating the Effectiveness of Content-Oriented XML Retrieval (2003)

Norbert Gövert, Norbert Fuhr, Gabriella Kazai, Mounia Lalmas

this paper, we show that evaluation methods developed for standard test collection must be modified in order to deal with retrieval of structured documents. Specifically, size and overlap of document...

Architecture for the Retrieval of Annotated Broadcast Content on a Range of Mobile and Stationary User Devices (2003)

Gabriella Kazai, Mounia Lalmas, Alan Pearmain, Marie-luce Bourguet

this paper we focus on the content access system and within it the search and retrieval engine. We define an architecture that supports the use of different user terminals and builds on established...

Using Metadata to Provide Scalable Broadcast and Internet Content and Services (2003)

Gabriella Kazai, Mounia Lalmas, Marie-luce Bourguet, Alan Pearmain

This paper deals with the use of metadata standards such as MPEG-7 and MPEG-21 to drive the automatic adaptation and personalisation of scalable broadcast and Internet content and services

Construction of a Test Collection for the Focussed (2003)

Retrieval Of Structured, Gabriella Kazai, Mounia Lalmas, Jane Reid

In this paper, we examine the methodological issues involved in constructing test collections of structured documents and obtaining best entry points for the evaluation of the focussed retrieval of...

Construction of a test collection for the focussed retrieval of structured documents (2003)

Gabriella Kazai, Mounia Lalmas, Jane Reid

Abstract. In this paper, we examine the methodological issues involved in constructing test collections of structured documents and obtaining best entry points for the evaluation of the focussed...

The accessibility dimension for structured document retrieval (2002)

Thomas Roelleke, Mounia Lalmas, Gabriella Kazai, Ian Ruthven

Abstract. Structured document retrieval aims at retrieving document components that best satisfy a query, instead of merely retrieving predefined document units. This paper reports on an...

Focussed Structured Document Retrieval (2002)

Gabriella Kazai, Mounia Lalmas, Thomas Roelleke

Focussed structured document retrieval aims at retrieving best entry points from where users can browse to access relevant document components in the document structure. In this paper, we report on...

A Model for the Representation and Focussed Retrieval of Structured Documents based on Fuzzy Aggregation (2001)

Gabriella Kazai, Mounia Lalmas, Thomas Rölleke

Effective retrieval of structured documents should exploit the content and structural knowledge associated with the documents. This knowledge can be used to focus retrieval to the best entry points:...

The HySpirit Retrieval Platform (2001)

Thomas Rölleke, Ralf Lübeck, Gabriella Kazai

ere various information needs occur in a highly heterogeneous and complex information environment. The HySpirit system consists of a number of modules including the core retrieval engine, knowledge...