Analysis of Observational Data in Speech and Language Research Using Generalizability Theory

Most research in speech-language pathology relies on observational data collected by human observers or judges. The reliability and generalizability of such measurements are always important considerations. This article reviews classical methods of estimating reliability and proposes that a more powerful approach capable of estimating the dependability of behavioral measurements is available. This approach, based on generalizability theory, provides a practical framework for estimating multiple sources of measurement error in the collection of observational data. Concepts central to generalizability theory are discussed, and a hypothetical data set illustrates the usefulness of generalizability measurements in speech and language research.

KEY WORDS: generalizability theory, observational data, generalizability analysis, statistical interactions

Submitted on June 25, 1997
Accepted on February 18, 1998

This article has been cited by other articles:

				E. W. Healy and A. A. Montgomery Consistency of Sentence Intelligibility Across Difficult Listening Situations. J Speech Lang Hear Res, August 1, 2006; 49(4): 823 - 834. [Abstract] [Full Text] [PDF]

				C. T. Bruckner, P. J. Yoder, and R.A. McWilliam Generalizability and Decision Studies: An Example Using Conversational Language Samples Journal of Early Intervention, January 1, 2006; 28(2): 139 - 153. [Abstract] [PDF]