Papers for Relevance Assessment by Enrique Amigó

Research Question: Defining a measure to estimate the reliability of the set of evaluated summaries which have been used to meta-evaluate metrics. That is, are the automatic summaries in the corpus representative from the possible automatic solutions?

Paper ID
(Link to PDF)

Title

Author(s)

W00-0408

A Comparison of Rankings Produced by Summarization Evaluation Measures

Robert L. Donaway ; Kevin W. Drummey ; Laura A. Mather

W97-0706

A Proposal for Task-based Evaluation of Text Summarization Systems

Therese Firmin Hand

Lin

ROUGE: A Package for Automatic Evaluation of Summaries

Chin-Yew Lin

Copeck

Vocabulary Usage in Newswire Summaries

Terry Copeck and Stan Szpakowicz

ward

Acknowledgment Use with Synthesized and Recorded Prompts

Karen Ward, Tasha Hollingsed and Javier A. Aldaz Salmon

W02-0406

Manual and automatic evaluation of summaries

Chin-Yew Lin; Eduard Hovy

79-215

Generating Overview Summaries of Ongoing Email Thread Discussions

Stephen Wan and Kathy McKeown

W05-0907

Evaluating DUC 2004 Tasks with the QARLA Framework

Enrique Amigo; Julio Gonzalo; Anselmo Penas; Felisa Verdejo

J03-3001

Introduction to the Special Issue on the Web as Corpus

Adam Kilgarriff; Gregory Grefenstette

P05-1018

Modeling Local Coherence: An Entity-Based Approach

Regina Barzilay; Mirella Lapata

W03-w7_eacl03pastra.local

Colouring Summaries BLEU

Katerina Pastra

P94-1002

MULTI-PARAGRAPH SEGMENTATION EXPOSITORY TEXT

Marti A. Hearst

Hori

Evaluation Measures Considering Sentence Concatenation for Automatic Summarization by Sentence or Word Extraction

Chiori Hori, Tsutomu Hirao and Hideki Isozaki

M91-1025

ITP:DESCRIPTION OF THE INTERPRETEXT SYSTEMAS USED FOR MUC-3

Kathleen Dahlgren; Carol Lord; Hajime Wada; Joyce McDowell; Edward P. Stabler, Jr.

X98-1028

A Text-Extraction Based Summarizer

Tomek Strzalkowski; Gees C. Stein; G. Bowden Wise