{"id":12368,"date":"2023-05-04T15:09:48","date_gmt":"2023-05-05T01:09:48","guid":{"rendered":"https:\/\/www.hawaii.edu\/sls\/?p=12368"},"modified":"2023-05-04T15:11:17","modified_gmt":"2023-05-05T01:11:17","slug":"speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university","status":"publish","type":"post","link":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/","title":{"rendered":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university"},"content":{"rendered":"<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-12372\" src=\"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/HIDOE-Multilingualism-Policy-Advisory-Committee-1-1-872x872.png\" alt=\"\" width=\"872\" height=\"872\" srcset=\"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/HIDOE-Multilingualism-Policy-Advisory-Committee-1-1-872x872.png 872w, https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/HIDOE-Multilingualism-Policy-Advisory-Committee-1-1-768x768.png 768w, https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/HIDOE-Multilingualism-Policy-Advisory-Committee-1-1-448x448.png 448w, https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/HIDOE-Multilingualism-Policy-Advisory-Committee-1-1.png 1080w\" sizes=\"(max-width: 872px) 100vw, 872px\" \/><\/p>\n<h4>Journal: Language Testing<\/h4>\n<h4>Authors: Daniel Isbell, Dustin Crowther, Hitoshi Nishizawa<\/h4>\n<h4>Article: Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university<\/h4>\n<p>Abstract:<\/p>\n<p>The extrapolation of test scores to a target domain\u2014that is, association between test performances and relevant real-world outcomes\u2014is critical to valid score interpretation and use. This study examined the relationship between Duolingo English Test (DET) speaking scores and university stakeholders\u2019 evaluation of DET speaking performances. A total of 190 university stakeholders (45 faculty members, 39 administrative staff, 53 graduate students, 53 undergraduate students) evaluated the comprehensibility (ease of understanding) and academic acceptability of 100 DET test-takers\u2019 speaking performances. Academic acceptability was judged based on speakers\u2019 suitability for communicative roles in the university context including undergraduate study, group work in courses, graduate study, and teaching. Analyses indicated a large correlation between aggregate measures of comprehensibility and acceptability (<i>r<\/i>\u2009=\u2009.98). Acceptability ratings varied according to role: acceptability for teaching was held to a notably higher standard than acceptability for undergraduate study. Stakeholder groups also differed in their ratings, with faculty tending to be more lenient in their ratings of comprehensibility and acceptability than undergraduate students and staff. Finally, both comprehensibility and acceptability measures correlated strongly with speakers\u2019 official DET scores and subscores (<i>r<\/i>\u2009\u2a7e\u2009.74\u2013.89), providing some support for the extrapolation of DET scores to academic contexts.<\/p>\n<p>&nbsp;<\/p>\n<p>Link to Journal website:<\/p>\n<p>https:\/\/journals.sagepub.com\/doi\/10.1177\/02655322231165984<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"entry-summary\">\n<div class=\"entry-summary\">\nJournal: Language Testing Authors: Daniel Isbell, Dustin Crowther, Hitoshi Nishizawa Article: Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university Abstract: The extrapolation of test scores to a target domain\u2014that is, association between&hellip;\n<\/div>\n<div class=\"link-more\"><a href=\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &ldquo;Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university&rdquo;<\/span>&hellip;<\/a><\/div>\n<\/div>\n<div class=\"link-more\"><a href=\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &ldquo;Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university&rdquo;<\/span>&hellip;<\/a><\/div>\n","protected":false},"author":18,"featured_media":12371,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[4],"tags":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies\" \/>\n<meta property=\"og:description\" content=\"Journal: Language Testing Authors: Daniel Isbell, Dustin Crowther, Hitoshi Nishizawa Article: Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university Abstract: The extrapolation of test scores to a target domain\u2014that is, association between&hellip; Continue reading &ldquo;Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university&rdquo;&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\" \/>\n<meta property=\"og:site_name\" content=\"Department of Second Language Studies\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/slshawaii\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-05T01:09:48+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-05T01:11:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/151.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"dsls\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@slshawaii\" \/>\n<meta name=\"twitter:site\" content=\"@slshawaii\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"dsls\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\"},\"author\":{\"name\":\"dsls\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#\/schema\/person\/121af179ce465b1b4133b168319d7c35\"},\"headline\":\"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university\",\"datePublished\":\"2023-05-05T01:09:48+00:00\",\"dateModified\":\"2023-05-05T01:11:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\"},\"wordCount\":242,\"publisher\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#organization\"},\"articleSection\":[\"News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\",\"url\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\",\"name\":\"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies\",\"isPartOf\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#website\"},\"datePublished\":\"2023-05-05T01:09:48+00:00\",\"dateModified\":\"2023-05-05T01:11:17+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.hawaii.edu\/sls\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#website\",\"url\":\"https:\/\/www.hawaii.edu\/sls\/\",\"name\":\"Department of Second Language Studies\",\"description\":\"University of Hawaii at Manoa\",\"publisher\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.hawaii.edu\/sls\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#organization\",\"name\":\"University of Hawai\u02bbi at M\u0101noa Department of Second Language Studies\",\"url\":\"https:\/\/www.hawaii.edu\/sls\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/sls-main-logo2.svg\",\"contentUrl\":\"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/sls-main-logo2.svg\",\"caption\":\"University of Hawai\u02bbi at M\u0101noa Department of Second Language Studies\"},\"image\":{\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/slshawaii\",\"https:\/\/twitter.com\/slshawaii\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.hawaii.edu\/sls\/#\/schema\/person\/121af179ce465b1b4133b168319d7c35\",\"name\":\"dsls\",\"url\":\"https:\/\/www.hawaii.edu\/sls\/author\/dsls\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/","og_locale":"en_US","og_type":"article","og_title":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies","og_description":"Journal: Language Testing Authors: Daniel Isbell, Dustin Crowther, Hitoshi Nishizawa Article: Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university Abstract: The extrapolation of test scores to a target domain\u2014that is, association between&hellip; Continue reading &ldquo;Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university&rdquo;&hellip;","og_url":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/","og_site_name":"Department of Second Language Studies","article_publisher":"https:\/\/www.facebook.com\/slshawaii","article_published_time":"2023-05-05T01:09:48+00:00","article_modified_time":"2023-05-05T01:11:17+00:00","og_image":[{"width":1080,"height":1080,"url":"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/151.png","type":"image\/png"}],"author":"dsls","twitter_card":"summary_large_image","twitter_creator":"@slshawaii","twitter_site":"@slshawaii","twitter_misc":{"Written by":"dsls","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#article","isPartOf":{"@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/"},"author":{"name":"dsls","@id":"https:\/\/www.hawaii.edu\/sls\/#\/schema\/person\/121af179ce465b1b4133b168319d7c35"},"headline":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university","datePublished":"2023-05-05T01:09:48+00:00","dateModified":"2023-05-05T01:11:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/"},"wordCount":242,"publisher":{"@id":"https:\/\/www.hawaii.edu\/sls\/#organization"},"articleSection":["News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/","url":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/","name":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university - Department of Second Language Studies","isPartOf":{"@id":"https:\/\/www.hawaii.edu\/sls\/#website"},"datePublished":"2023-05-05T01:09:48+00:00","dateModified":"2023-05-05T01:11:17+00:00","breadcrumb":{"@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.hawaii.edu\/sls\/speaking-performances-stakeholder-perceptions-and-test-scores-extrapolating-from-the-duolingo-english-test-to-the-university\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hawaii.edu\/sls\/"},{"@type":"ListItem","position":2,"name":"Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university"}]},{"@type":"WebSite","@id":"https:\/\/www.hawaii.edu\/sls\/#website","url":"https:\/\/www.hawaii.edu\/sls\/","name":"Department of Second Language Studies","description":"University of Hawaii at Manoa","publisher":{"@id":"https:\/\/www.hawaii.edu\/sls\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hawaii.edu\/sls\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.hawaii.edu\/sls\/#organization","name":"University of Hawai\u02bbi at M\u0101noa Department of Second Language Studies","url":"https:\/\/www.hawaii.edu\/sls\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hawaii.edu\/sls\/#\/schema\/logo\/image\/","url":"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/sls-main-logo2.svg","contentUrl":"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/sls-main-logo2.svg","caption":"University of Hawai\u02bbi at M\u0101noa Department of Second Language Studies"},"image":{"@id":"https:\/\/www.hawaii.edu\/sls\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/slshawaii","https:\/\/twitter.com\/slshawaii"]},{"@type":"Person","@id":"https:\/\/www.hawaii.edu\/sls\/#\/schema\/person\/121af179ce465b1b4133b168319d7c35","name":"dsls","url":"https:\/\/www.hawaii.edu\/sls\/author\/dsls\/"}]}},"jetpack_featured_media_url":"https:\/\/www.hawaii.edu\/sls\/wp-content\/uploads\/151.png","wps_subtitle":"Daniel Isbell, Dustin Crowther, Hitoshi Nishizawa","_links":{"self":[{"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/posts\/12368"}],"collection":[{"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/comments?post=12368"}],"version-history":[{"count":3,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/posts\/12368\/revisions"}],"predecessor-version":[{"id":12392,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/posts\/12368\/revisions\/12392"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/media\/12371"}],"wp:attachment":[{"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/media?parent=12368"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/categories?post=12368"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hawaii.edu\/sls\/wp-json\/wp\/v2\/tags?post=12368"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}