INSTITUTE OF EDUCATIONAL SCIENCES
MASTER PROGRAM IN ENGLISH LANGUAGE EDUCATION
Master Thesis Defense
ABSTRACT
AN EVALUATION OF THE PERFORMANCE ASSESSMENT COMPONENT OF
AN EFL PREPARATORY-SCHOOL PROGRAM
by
Nihan ÖZUSLU
Date & Time: Thursday, June 13th 2018, 11.00
Place: Faculty of Education, Room 530
All interested are cordially invited.
ABSTRACT
The purpose of the present study is to evaluate the use of Performance-based Assessment Tasks (PTs) as the supplementary assessment component of the English language program carried out in a preparatory school of a state university from the perspective of the English language students’, instructors’ and administrators’ expectations before the implementation and their opinions after the implementation on the planning, implementation, scoring and learning outcomes phases and also its consistency with the current English language program in 2017-2018 academic year. The formative evaluation is based on the Decision/Accountability-Oriented evaluation approach introduced by Stufflebeam (2001). To conduct this mixed-methods study, an open-ended questionnaire is designed and applied to 126 students, 60 instructors and two administrators to collect qualitative data. For the quantitative data, a Likert-scale is designed and applied to the same participants. Opinions and suggestions of the stakeholders for possible future PT practices are gathered via three open-ended questions. The qualitative data is analyzed by means of content and thematic analysis while the data gathered through the scales are analyzed by means of a statistical program. In addition to frequency and percentage analysis of the items, the relation among the independent variables is analyzed by means of T-test and ANOVA (One-Way Analysis of Variance). Results for the qualitative data collected before the PT implementation indicate that all stakeholders agree on the linguistic benefits of PTs and its contribution to learning. Students’ worries focus on the time, effort and difficulty of PT practices whereas instructors embody mainly assessment-related concerns. Administrators expect the PT practices to affect learner autonomy and motivation positively while they are aware of the workload for the instructors. The results of the scale conducted after the implementation, revealed that when the tasks are not favored, it is mostly due to its number, content and collecting procedures. The planning, implementation, scoring, learning outcomes and program consistency phases are evaluated in a moderately positive way by the students while evaluated more positively by the instructors and the administrators. Even though most stakeholders urge some revisions on PTs, a large number of instructors, a great majority of students and the administrators agree on its continuity in the following years. The suggestions made by the stakeholders are taken into consideration to enhance this assessment component in accordance with the current language program. In the research the overall evaluation is discussed with respect to the decision/accountability-oriented evaluation principles. In conclusion, this study provides valuable findings for the field of education particularly for program evaluators, practitioners, researchers in terms of not only assessment but also evaluation.
Key Words: alternative assessment, performance-based assessment tasks, program evaluation