大学英语教改口语考试课件课堂PPT

1大学英语大学英语教改口语考试教改口语考试中国科学技术大学中国科学技术大学 李萌涛李萌涛2大学英语教改口语考试大学英语教改口语考试一、大学英语教改和口语考试一、大学英语教改和口语考试二、口语考试数据及分析二、口语考试数据及分析三、口语试题库三、口语试题库四、口语试题库的信度和效度研究四、口语试题库的信度和效度研究五、口语评分标准五、口语评分标准3一、一、大学英语教改和口语考试n大学英语改革大学英语改革改革的目标是要全面提高大学生的英语综合实改革的目标是要全面提高大学生的英语综合实用能力，特别是强化听说能力。用能力，特别是强化听说能力。利用英语口语考试的反驳效应利用英语口语考试的反驳效应 ，促进口语教学。，促进口语教学。学生基数太大，采用口语考试系统实施大规模学生基数太大，采用口语考试系统实施大规模的口语测试成为可能。的口语测试成为可能。45二、口语考试数据及分析二、口语考试数据及分析n20042004年年1010月，中国科学技术大学月，中国科学技术大学20042004级英语教级英语教学改革试点班学生英语口语摸底考试，实考学改革试点班学生英语口语摸底考试，实考517517人。人。p20052005年年1 1月，中国科学技术大学月，中国科学技术大学20042004级全体本科级全体本科生英语口语期末考试，实考生英语口语期末考试，实考18151815人。人。p20052005年年6 6月，中国科学技术大学月，中国科学技术大学20042004级全体本级全体本科生英语口语期末考试，实考科生英语口语期末考试，实考17981798人。人。p20052005年年1212月月 18131813人人p20062006年年6 6月月 17981798人人p20072007年年1 1月月 37073707人（二个年级）人（二个年级） 61. 对对05、06级学生进行问卷调查级学生进行问卷调查n0505级级9090名学生，名学生，0606级级8989名学生名学生 n各有各有51.151.1、77.577.5的学生选择重视口语的学生选择重视口语机考机考n各有各有53.353.3、49.249.2的学生支持采用机考的学生支持采用机考n0606级学生有级学生有67.267.2的学生认为，机考能体的学生认为，机考能体现其口语水平的现其口语水平的60-8060-80 72. 对教师的问卷调查数据分析对教师的问卷调查数据分析 n收回收回1414份老师问卷份老师问卷n1313位老师支持机考，认为能反映出学生口位老师支持机考，认为能反映出学生口语水平语水平n92.9%92.9%的老师认为，用机考成绩来解释学的老师认为，用机考成绩来解释学生口语能力的可信赖程度达到生口语能力的可信赖程度达到7090%7090%n对照机考口语成绩与期末笔试成绩，有对照机考口语成绩与期末笔试成绩，有70-70-8080的相关度的相关度8四所院校共同编写：四所院校共同编写：n中国科技大学n复旦大学n苏州大学n西南交通大学9n多种题型、与教材配套、内容丰富的英语口多种题型、与教材配套、内容丰富的英语口语试题库语试题库n系统支持文本、图形、语音和视频等多种媒系统支持文本、图形、语音和视频等多种媒体，具有主题和级别等试题指标。体，具有主题和级别等试题指标。n试题由多所高校优秀英语教师和测试专家开试题由多所高校优秀英语教师和测试专家开发。发。10口语试题库的定位口语试题库的定位n学业考试学业考试(Performance Test),(Performance Test), 所测即所学。所测即所学。n主题式主题式(topic-based)(topic-based)，有近似主题，难度、，有近似主题，难度、要求不同。要求不同。n综合听说教材里所涉及的主题。综合听说教材里所涉及的主题。n涵盖全新版和修订版所有主题。涵盖全新版和修订版所有主题。n部分题型模拟四、六级口语考试形式。部分题型模拟四、六级口语考试形式。11口语考试题型口语考试题型n目前有目前有7个题型，个题型，Reading aloud用于用于Band 1-2。每套题至少要包括以下每套题至少要包括以下45个题型。个题型。nReading aloudnListening and speakingnQuestions and answersnComment on English sayings and quotationsnDescribing picturesnTalking about moviesnGroup discussion12Group DiscussionnPart 4 Discussion 5 minutes, 20 points Each group is composed of three students Student A, Student B and Student C. Topic: UFOs are alien spacecraft from outer space13nThe UFO phenomenon may have existed for over a half-century and UFO sightings are becoming more and more frequent around the world. Some people think these objects are alien spacecraft, although there is no conclusive evidence yet. There is no doubt that unidentified flying objects in the sky do exist. But the question is what are they? Are UFOs alien spacecraft from other planets? 14nYou will have about 5 minutes to discuss on this topic. Each person can only talk for one minute at a time. During the discussion, you may voice your opinion, argue with each other, or ask somebody to clarify his or her points. Your performance will be judged according to your contribution to the discussion.15nHints: Numerous UFO photos in the world can show UFOs are alien spacecraft. Many planets outside the solar system are similar to the Earth. So there is a possibility that aliens do exist.Nearly all photographs are blurry and many have been proved to be forgeries.There is no evidence of intelligent aliens living anywhere in our solar system or in outer space.准备时间：准备时间：20 seconds答题时间：答题时间：60 seconds16n2006.2.完成第一批完成第一批48套试卷，即每一级配套试卷，即每一级配12套试卷，每年淘汰套试卷，每年淘汰2套，并可升级更新。套，并可升级更新。n2007.2.完成第二批完成第二批48套试卷，即每一级配套试卷，即每一级配12套试卷，每年淘汰套试卷，每年淘汰2套，并可升级更新。套，并可升级更新。n可以自由组建试题可以自由组建试题n可以增减考试内容可以增减考试内容17n为什么要口语考试？为什么要口语考试？Assign gradesImprove instructionMotivate students to workProvide feedback to students18n如何进行口语考试？如何进行口语考试？ TestingObjectiveSubjectivenFormativenSummative19Formative TestingnUsing measurement tools to conduct evaluation for the purpose of improving student performancenStudent receives feedback of resultsnTeacher considers results in planning subsequent instructionnGrades are not recorded!20Summative TestingnUsing measurement tools to conduct evaluation for the purpose of assigning student gradesnStudent receives feedback of resultsnTeacher considers results in planning subsequent instructionnGrades are recorded21口语试题库分级口语试题库分级n分为四级，对应教学内容分为四级，对应教学内容n难度控制难度控制参照课本难度参照课本难度参照国内外口语考试难度参照国内外口语考试难度确定难度上限，略高于四、六级口语考试难度确定难度上限，略高于四、六级口语考试难度依据教学实践、课堂口语活动依据教学实践、课堂口语活动22合作研究口语试题库和考试系统合作研究口语试题库和考试系统n与国内大学和机构合作（出版社、讯飞）与国内大学和机构合作（出版社、讯飞）n与国外大学合作与国外大学合作Bath University (UK)n对比研究，机考对比研究，机考vs面试面试n试题库科学分级、信度、效度等研究试题库科学分级、信度、效度等研究n人机交互研究，智能（半智能）阅卷人机交互研究，智能（半智能）阅卷n学生在机考时的心理变化研究学生在机考时的心理变化研究23n准则参考性口试（准则参考性口试（criterion-referenced oral test)n常模参考性口试（常模参考性口试（norm-referenced oral test)24Criterion-Referenced TestnMeasures student performance against predetermined standardsnStudent meets or does not meet the standardnCompetition is between the student and the skill, knowledge, or abilitynGrade is based on accomplishmentnEverybody can earn a passing grade if they meet the standard 25Norm Referenced TestnMake test intentionally difficultnAverage score should be about 50%nStrong students should tend to score high and weak students should tend to score lownAward As for highest scores, Fs for lowest scores, Cs for average scores26Characteristics of a TestnValiditynReliabilitynObjectivitynDiscrimination (applies to norm-referenced test only)nComprehensivenessnScore-Ability27ValiditynA valid test measures:what it is intended to measurenwhat the teacher intended for the students to learnnwhat the teacher actually taughtnA valid test is FAIR28Questions about ValiditynDoes the test actually measure what you intend it to measure?nDid you teach the content and skills that are being tested?nDoes the test require the student to know or do something other than what you intended and/or taught?nDoes some aspect of the test prevent the student who may know the material from responding correctly?29ReliabilitynA reliable test provides accurate and consistent results nTest reliability can be viewed from two perspectives:Student reliabilityScorer reliability30Student ReliabilitynTest items are readable and clearnInstructions are simple and unambiguousnResponses test only knowledge of the subject matter and not test wiseness, reading ability, or other unrelated trait31Scorer ReliabilitynItems can be scored consistentlynSame scorer would produce similar results on repeated evaluationsnDifferent scorers would produce similar results if working independently32ObjectivitynObjectively writtenitems are reliableitems are validnObjectively administerednObjectively Scored33DiscriminationnImportant ONLY for norm-referenced testingnTest separates more knowledgeable students from less knowledgeable studentsnDiscriminating test is intended to reward best students and punish weakest studentsnIdeal for using normal curve to interpret score34Normal distributionnOn most measures of human behavior, graphing individual results will result in a “bell-shaped,” or normal distribution curvenMost individual scores will fall toward the middle (mean)nFewer scores will fall toward the upper and lower ends35Bell-shaped CurveLowest ScoresAverageScoresHighest Scores36口语考试评分口语考试评分n测量出某个考生在整个群体中的相对位置测量出某个考生在整个群体中的相对位置n相对公平，不受相貌、肢体语言的干扰相对公平，不受相貌、肢体语言的干扰n可重复阅卷可重复阅卷n等级的确立等级的确立 （1 15 5）n综合评分（综合评分（Holistic markingHolistic marking）n分析评分（分析评分（analytic marking)analytic marking)37教师培训教师培训n参照标准参照标准n确定样本确定样本n教师分工教师分工n分数调整分数调整381. 参照标准参照标准n评分采用准则参考性和常模参考性相结合评分采用准则参考性和常模参考性相结合的评分方法，从内容、语音和流利程度三的评分方法，从内容、语音和流利程度三个方面分析评价考生的英语口语水平。个方面分析评价考生的英语口语水平。39n评分卡：评分卡：内容内容语音语音流利度流利度平均分：平均分：(1，2，3，4，5，可用小数点，总数相加，可用小数点，总数相加)40412.确定样本确定样本n从往年学生录音中选取有代表性的口语样从往年学生录音中选取有代表性的口语样本本n每个分数段取每个分数段取2个样本个样本n25分的样本分的样本n样本录音样本录音423.教师分工教师分工n由系统指派班级给阅卷老师由系统指派班级给阅卷老师n人工调整，分散班级人工调整，分散班级n专门指派有经验的老师抽查阅卷专门指派有经验的老师抽查阅卷434.分数调整分数调整（正态分布） 优秀优秀良好良好中等中等及格及格不及格不及格5分分4分分3分分2分分1分分8.723.236.324.67.24445Thank you!