Technical Program

Paper Detail

Paper:SP-P4.1
Session:Topics in Speech Understanding Systems
Time:Tuesday, May 18, 15:30 - 17:30
Presentation: Poster
Topic: Speech Processing: Spoken Language Systems and Dialog
Title: BOOTSTRAP ESTIMATES FOR CONFIDENCE INTERVALS IN ASR PERFORMANCE EVALUATION
Authors: Maximilian Bisani; RWTH Aachen 
 Hermann Ney; RWTH Aachen 
Abstract: The field of speech recognition has clearly benefited from precisely defined testing conditions and objective performance measures such as word error rate. In the development and evaluations of new methods, the question arises whether the empirically observed difference in performance is due to a genuine advantage of one system over the other, or just an effect of chance. However still many publications do not concern themselves with the statistical significance of the results reported. In this paper we present a bootstrap method for significance analysis which is at the same time intuitive, precise and and easy to use. Unlike other previously proposed methods, we make no (possibly ill-founded) approximations and the results are immediately interpretable in terms of word error rate.
 
           Back


Home -||- Organizing Committee -||- Technical Committee -||- Technical Program -||- Plenaries
Paper Submission -||- Special Sessions -||- ITT -||- Paper Review -||- Exhibits -||- Tutorials
Information -||- Registration -||- Travel Insurance -||- Housing -||- Workshops

©2015 Conference Management Services, Inc. -||- email: webmaster@icassp2004.org -||- Last updated Wednesday, April 07, 2004