TY - JOUR
T1 - Testing textbook theories and tests
T2 - The case of suprasegmentals in a pronunciation textbook
AU - Gorsuch, Greta J.
PY - 2001/3
Y1 - 2001/3
N2 - This report deals with dual challenges teachers often face: (1) testing the theoretical assumptions made by the authors of the textbooks; and (2) evaluating achievement tests that have been developed for use with those textbooks. The purpose of this report is to address these issues in the context of the use of an English as a Foreign Language (EFL)/Second Language pronunciation textbook and achievement test, 'Clear Speech' (Gilbert, 1993, Clear speech student's book, 2nd Edition. Cambridge University Press, New York), with a group of 24 second-year Japanese EFL students attending a private four-year college near Tokyo. After 32 h of production-focused instruction, students' perception of suprasegmentals seemed to improve, while their production did not. However, a content validity and generalizability analysis of the textbook-based speaking test used to estimate students' achievement revealed that the results of the test could not be trusted. Thus the test may have not allowed students adequate opportunity to demonstrate their abilities in producing suprasegmentals. This raises the question of whether tests and tasks used in classroom and research settings are allowing students to demonstrate their learning achievement.
AB - This report deals with dual challenges teachers often face: (1) testing the theoretical assumptions made by the authors of the textbooks; and (2) evaluating achievement tests that have been developed for use with those textbooks. The purpose of this report is to address these issues in the context of the use of an English as a Foreign Language (EFL)/Second Language pronunciation textbook and achievement test, 'Clear Speech' (Gilbert, 1993, Clear speech student's book, 2nd Edition. Cambridge University Press, New York), with a group of 24 second-year Japanese EFL students attending a private four-year college near Tokyo. After 32 h of production-focused instruction, students' perception of suprasegmentals seemed to improve, while their production did not. However, a content validity and generalizability analysis of the textbook-based speaking test used to estimate students' achievement revealed that the results of the test could not be trusted. Thus the test may have not allowed students adequate opportunity to demonstrate their abilities in producing suprasegmentals. This raises the question of whether tests and tasks used in classroom and research settings are allowing students to demonstrate their learning achievement.
KW - Pronunciation acquisition
KW - Pronunciation assessment
KW - Pronunciation training
KW - Task generalizability
KW - Test validity
UR - http://www.scopus.com/inward/record.url?scp=0035285504&partnerID=8YFLogxK
U2 - 10.1016/S0346-251X(00)00049-X
DO - 10.1016/S0346-251X(00)00049-X
M3 - Article
AN - SCOPUS:0035285504
SN - 0346-251X
VL - 29
SP - 119
EP - 136
JO - System
JF - System
IS - 1
ER -