HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal My Folders Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Olswang, L. B. Articles by Donaldson, A. L. Search for Related Content PubMed PubMed Citation Articles by Olswang, L. B. Articles by Donaldson, A. L. Social Bookmarking                         What's this?

Reliability Issues and Solutions for Coding Social Communication Performance in Classroom Settings

Contact author: Lesley B. Olswang, Department of Speech and Hearing Sciences, University of Washington, 1417 Northeast 42nd Street, Seattle, WA 98105-6246l. E-mail: lolswang{at}u.washington.edu

PURPOSE: To explore the utility of time-interval analysis for documenting the reliability of coding social communication performance of children in classroom settings. Of particular interest was finding a method for determining whether independent observers could reliably judge both occurrence and duration of ongoing behavioral dimensions for describing social communication performance.

METHOD: Four coders participated in this study. They observed and independently coded 6 social communication behavioral dimensions using handheld computers. The dimensions were mutually exclusive and accounted for all verbal and nonverbal productions during a specified time frame. The technology allowed for coding frequency and duration for each entered code. Data were collected from 20 different 2-min video segments of children in kindergarten through 3rd-grade classrooms. Data were analyzed for interobserver and intraobserver agreements using time-interval sorting and Cohen's kappa. Further, interval size and total observation length were manipulated to determine their influence on reliability.

RESULTS: The data revealed interval sorting and kappa to be a suitable method for examining reliability of occurrence and duration of ongoing social communication behavioral dimensions. Nearly all comparisons yielded medium to large kappa values; interval size and length of observation minimally affected results.

IMPLICATIONS: The analysis procedure described in this research solves a challenge in reliability: comparing coding by independent observers of both occurrence and duration of behaviors. Results indicate the utility of a new coding taxonomy and technology for application in online observations of social communication in a classroom setting.

KEY WORDS: research design, observation, behavioral assessment

CiteULike    Connotea    Del.icio.us    Digg    Facebook    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				T. E. Coggins, G. R. Timler, and L. B. Olswang A State of Double Jeopardy: Impact of Prenatal Alcohol Exposure and Adverse Environments on the Social Communicative Abilities of School-Age Children With Fetal Alcohol Spectrum Disorder Lang Speech Hear Serv Sch, April 1, 2007; 38(2): 117 - 127. [Abstract] [Full Text] [PDF]