Please use this identifier to cite or link to this item: http://hdl.handle.net/10125/56004

Using corpus linguistics to examine the extrapolation inference in the validity argument for a high-stakes speaking assessment

File Description SizeFormat 
LaFlair_Staples(2017)_post-print-ss.pdfPostprint468.86 kBAdobe PDFView/Open

Full Item Record

DC FieldValueLanguage
dc.contributor.authorLaFlair, Geoffrey T.-
dc.contributor.authorStaples, Shelley-
dc.date.accessioned2018-05-09T01:18:06Z-
dc.date.available2018-05-09T01:18:06Z-
dc.date.issued2017-09-19-
dc.identifier.citationLaFlair, G. T., & Staples, S. (2017). Using corpus linguistics to examine the extrapolation inference in the validity argument for a high-stakes speaking assessment. Language Testing. 34(4), 451-475en_US
dc.identifier.urihttp://hdl.handle.net/10125/56004-
dc.description.abstractInvestigations of the validity of a number of high-stakes language assessments are conducted using an argument-based approach, which requires evidence for inferences that are critical to score interpretation (Chapelle, Enright, & Jamieson, 2008b; Kane, 2013). The current study investigates the extrapolation inference for a high-stakes test of spoken English, the Michigan English Language Assessment Battery (MELAB) speaking task. This inference requires evidence that supports the inferential step from observations of what test takers can do on an assessment to what they can do in the target domain (Chapelle et al., 2008b; Kane, 2013). Typically, the extrapolation inference has been supported by evidence from a criterion measure of language ability. This study proposes an additional empirical method, namely corpus-based register analysis (Biber & Conrad, 2009), which provides a quantitative framework for examining the linguistic relationship between performance assessments and the domains to which their scores are extrapolated. This approach extends Bachman and Palmer’s (2010) focus on the target language use (TLU) domain analysis in their study of assessment use arguments by providing a quantitative approach for the study of language. We first explain the connections between corpus-based register analysis and TLU analysis. Second, an investigation of the MELAB speaking task compares the language of test-taker responses to the language of academic, professional, and conversational spoken registers, or TLU domains. Additionally, the language features at different performance levels within the MELAB speaking task are investigated to determine the relationship between test takers’ scores and their language use in the task. Following previous studies using corpus-based register analysis, we conduct a multi-dimensional (MD) analysis for our investigation. The comparison of the language features from the MELAB with the language of TLU domains revealed that support for the extrapolation inference varies across dimensions of language use.en_US
dc.description.sponsorshipCaMLA Spaan Research Grant Programen_US
dc.format.extent43en_US
dc.language.isoen-USen_US
dc.publisherSage Journalsen_US
dc.rightsThis manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/en_US
dc.subjectcorpus linguisticsen_US
dc.subjectdomain analysisen_US
dc.subjectmulti-dimensional analysisen_US
dc.subjectperformance assessmenten_US
dc.subjectregister analysisen_US
dc.subjectvalidity argumenten_US
dc.titleUsing corpus linguistics to examine the extrapolation inference in the validity argument for a high-stakes speaking assessmenten_US
dc.typeArticleen_US
dc.type.dcmiTexten_US
dc.identifier.doihttp://journals.sagepub.com/doi/full/10.1177/0265532217713951-
Appears in Collections:SLS Faculty & Researcher Works


Please contact sspace@hawaii.edu if you need this content in an ADA compliant alternative format.

Items in ScholarSpace are protected by copyright, with all rights reserved, unless otherwise indicated.