۱.
کلیدواژه‌ها:
MSRT reading Test reliability Topic effect Item Type Test Bias
As a national high-stakes test of English proficiency, MSRT needs further scrutiny of reliability. Thus, the present study aimed to investigate different sources of variation that may impact the MSRT test-takers’ reading comprehension. Accordingly, some factors including the reading topics, item types, and participants’ general proficiency were delved into based on the scores obtained from 60 MSRT prospective candidates. Upon administering a sample of the reading subtest taken from a recent version of MSRT, the collected data was dichotomously scored and then analyzed in terms of internal consistency, inter-correlations, and causal patterns. The yielded results showed an overall reliability of 0.86 for the reading module, while a moderate interrelationship was obtained amongst the passages (r = 0.47) as well as the item types (r = 0.44). Furthermore, the Mixed ANOVA results demonstrated that topic and item type significantly affected the reading performance, whereas the proficiency factor did not play a conspicuous role in distinguishing the participants’ reading accomplishment. Both theoretically and operationally, the results reported through this study may stress the need for reconsidering the influence of such test-method facets as topic and item type in the MSRT reading subtest to upgrade the test’s unidimensionality and fairness.
۲.
کلیدواژه‌ها:
Formative assessment Summative Assessment listening comprehension Reading Comprehension
This study investigates the effects of summative, formative, and combined assessments on the development of listening and reading comprehension skills on advanced Iranian EFL learners. Data were collected from 40 advanced EFL learners, aged 19 to 35, from intact classes at a higher education institute, divided into three experimental groups, each receiving one of the assessment types (summative, formative, or a combination of both), along with a control group. Learners’ progress in listening and reading comprehension was measured over a four-month period using pre- and post-tests administered at the end of the term. Data analysis involved ANOVA, ANCOVA, and post hoc LSD tests. The findings of this longitudinal study revealed that while the combined application of formative and summative assessments had a significant positive impact on listening comprehension, neither assessment type alone contributed to improvement in this area. In contrast, the results showed that all forms of assessment—whether summative, formative, or combined—led to notable improvements in reading comprehension. These results highlight the differential effects of assessment types on listening and reading skills, suggesting implications for assessment practices in EFL contexts.
۳.
کلیدواژه‌ها:
AI-driven feedback writing complexity Direct Feedback Indirect Feedback Syntactic measures
This study examined the impact of AI-driven feedback on the writing complexity of Iranian intermediate EFL learners using a quasi-experimental design. Through convenience sampling, 100 participants (male and female, aged 18-25) from two language institutes in Tehran were divided into four groups: two experimental groups receiving direct and indirect feedback from AI ChatGPT, and two control groups receiving the same feedback types from their teacher. Participants completed a pre-test, ten writing tasks over 14 weeks, and a post-test. Results, analyzed via descriptive statistics and one-way ANOVA, indicated notable improvements in writing complexity across all groups. The AI direct feedback group showed the highest improvement, with a mean difference of 5.24 (p < 0.05), followed by the teacher direct feedback group, which also demonstrated significant gains. The AI indirect feedback group exhibited moderate progress, while the teacher indirect feedback group showed the least improvement. Analysis of syntactic measures revealed that AI feedback, particularly direct feedback, effectively enhanced sentence structures and encouraged the use of more sophisticated vocabulary. These findings highlight AI-driven feedback’s potential to enhance EFL learners’ writing complexity, with direct feedback yielding the greatest benefits.
۴.
کلیدواژه‌ها:
Grammarly Software Writing skills EFL Learners Free Version Of Grammarly
In light of ongoing challenges in writing education and the needs of digital-native learners, this study explored the effectiveness of using the free version of Grammarly in the writing development of EFL learners. Thirty-three TEFL students at Shahid Rajaee University were randomly selected and participated in the study. Using a quantitative one-group design, their writing performance was assessed through six tasks and analyzed via one-way Repeated Measures MANOVA. The results indicated a consistent improvement in overall writing performance through the regular use of Grammarly as an automatic corrective feedback tool. To identify which writing components improved, an RM-MANOVA was conducted on grammar, spelling, punctuation, and clarity. The analysis showed significant improvement only in grammatical accuracy, with other aspects remaining unchanged. These findings highlight Grammarly’s potential in enhancing grammatical skills. The study contributes to ELT by encouraging the integration of ICT-related content into the EFL curriculum and teacher training programs, emphasizing the role of AI tools in language learning. These findings highlight the increasing impact of AI-powered tools in improving writing skills for language learners. Educators should balance automated feedback with personalized instruction. As research on effectiveness of Grammarly is still limited, further studies are necessary to fully understand its educational potential.
۵.
کلیدواژه‌ها:
English as a Foreign Language Blended Learning Attitudes university students
The increasing advancement of technology in the field of teaching English as a foreign language (EFL) has turned blended learning—a combination of online and in-person learning—into an innovative educational approach. Given the significance of investigating students' attitudes toward learning environments in different EFL contexts, this mixed-methods study was set to examine Iraqi university EFL students' attitudes toward blended EFL courses and investigate gender differences in this regard. Thus, 250 EFL students were selected from five public Iraqi universities via convenience sampling method and completed the questionnaire of the study. Of these participants, a random sample of 25 students was also selected for interview sessions. The questionnaire results suggested that due to serious technological and instructional drawbacks, such as lack of appropriate infrastructure and insufficient technology knowledge, Iraqi EFL students had generally negative attitudes toward EFL blended courses. Gender also played no significant role in students' attitudes. In interviews, they emphasized the importance of technology training programs to pave the way for effective blended EFL courses, mentioning some important benefits for this hybrid approach. The pedagogical implications of the findings are also discussed.
۶.
کلیدواژه‌ها:
dynamic assessment Language learning Mediated Learning Zone of Proximal Development
This meta-analysis provides a comprehensive evaluation of research studies on computerized dynamic assessment (C-DA) in English language teaching and learning, addressing the need for a systematic overview in light of recent technological advancements. A systematic search across three databases (ERIC, Web of Science, and Scopus) initially identified 2807 articles, with 22 C-DA studies meeting the inclusion criteria after screening. Findings reveal that C-DA significantly enhances language learning outcomes, particularly in reading and listening and writing skills, with large effect sizes reported across multiple studies. Interventionist approaches and quasi-experimental designs were most commonly used, reinforcing the strong impact of mediation on bridging learners' actual and potential performance. While C-DA demonstrated substantial improvements in skill-based outcomes, its effects on affective factors like anxiety and intrinsic motivation were more modest. These findings highlight C-DA’s potential as a transformative tool in language assessment and instruction, particularly when mediation is tailored to learners' needs. However, integrating C-DA with complementary strategies may be necessary to address psychological and motivational factors.
۷.
کلیدواژه‌ها:
EFL Teachers Instructional Design and Delivery Online Classroom Observation Teacher’s Conceptions technology integration
To identify the effectiveness of online observation for teaching, this study explored teachers’ conceptions of online classroom observation, focusing on the key components, instructional design considerations, and delivery strategies in virtual teaching environments. More particularly, in this multi-method qualitative research design study, the researchers did document analysis of a number of available classroom observation sheets to derive some themes and sub-themes regarding the components of online classroom observation. Subsequently, based on the derived themes, semi-structured interview items were composed. Through purposive sampling, eight Iranian experienced online classroom observers were selected to be interviewed. Using MAXQDA to do content and thematic analysis, the researchers found the eight components of instructional design and delivery, technology integration, student engagement and interaction, professional development and support, feedback provision, assessment of students’ learning and achievement, inclusive practices, and instructor presence and support in the data. Moreover, it was found that the integration of technology was highlighted to optimize observation experiences, student engagement, and instructional support. These findings have implications for professional development programs, re-evaluation of assessment practices, instructor presence, and technology integration in online learning contexts, all of which are crucial for equipping EFL instructors with the skills and knowledge necessary for effective online teaching.
۸.
کلیدواژه‌ها:
Language learning EFL Multiple Intelligences learner perceptions instructional approaches
Language learning is a multifaceted process influenced by various factors, including learners’ individual preferences and cognitive strengths. This mixed-methods study investigates how dominant intelligences influence the instructional preferences and perceptions of 30 male Turkish-speaking EFL learners, aged 13-17, using a structured questionnaire and semi-structured interviews. The research explores the relationship between learners’ intelligences and specific teaching approaches, with data analyzed through both quantitative and qualitative methods. Participants were categorized into two groups based on their dominant intelligences: Group A (interpersonal and intrapersonal) and Group B (linguistic and visual/spatial). Analysis of the data reveals that learners gravitate towards learning styles that align with their dominant intelligences, with Group A favoring interactive and self-directed approaches, while Group B leans towards visual and experiential methods. Despite a limited awareness of MI theory, the participants express satisfaction with MI-based instruction, viewing it as more engaging and effective compared to traditional methods. This study underscores the significance of incorporating learner preferences into language instruction and highlights the potential of MI-based approaches to enhance learner engagement and motivation.
۹.
کلیدواژه‌ها:
pragmatics Speech Acts Metaplocutionary Acts Interlocutionary Acts Negotiation Acts
Speech act theory is a significant issue in comprehending the intricate dynamics of human communication, acting as a guiding light in understanding how language is used to perform actions beyond the literal meanings of words. While traditional frameworks have presented valuable perceptions in classifying speech acts, the evolving nature of communication requires reconsidering and expanding these conventional approaches. The researchers of the current study proposed an innovative framework for speech act classifications, one that exceeds traditional boundaries and embraces the nuanced complexities of modern discourse. Based on seminal works by Austin (1962) and Searle (1969), and also by considering important research by Grice (1975), Levinson (1983), and emerging perspectives represented by Verschueren (1999) and Sbisa (2002), the researchers of this study critically assess current classifications, identifying essential challenges and opportunities in speech act analysis. The proposed framework introduces other categories such as Metaplocutionary Acts, Interlocutionary Acts, and Negotiation Acts, offering a more comprehensive and context-sensitive approach to understanding speech acts. Through interdisciplinary collaboration and empirical validation, the researchers of this study aim to refine and apply this framework across diverse linguistic and cultural contexts, thereby paving the way for a more nuanced and dynamic comprehension of human communication.
۱۰.
کلیدواژه‌ها:
regulatory focus L2 Grit Writing Enjoyment
Objective: Despite the renewed interest in individual differences in second language acquisition (SLA), there is still limited research on the interconnections among regulatory focus (promotion and prevention), L2 grit (Consisting of perseverance of effort and consistency of interests), and emotions.
Methods: A total of 85 undergraduate English majors (54 women, mean age = 20 years) from two comprehensive universities in Iran took part in the research. In order to assess the participants' promotion and prevention focuses, L2 grit, and English writing enjoyment, three questionnaires were used. The data collected was analyzed using IBM SPSS (26.0) software.
Results: The correlational analysis revealed that regulatory focus, L2 grit, and L2 writing enjoyment are interconnected. Specifically, promotion focus positively correlated with L2 writing enjoyment and L2 grit. Additionally, L2 grit (Perseverance of Effort) showed a meaningful connection with L2 writing enjoyment. On the other hand, prevention focus demonstrated significant negative correlations with L2 writing enjoyment and L2 grit. Lastly, there was no significant relationship found between L2 Grit (consistency of interest) and L2 Writing Enjoyment.
Conclusions: The study's results demonstrate the crucial findings regarding the interplay between different dimensions of grit, emotion and personal best goals.
۱۱.
کلیدواژه‌ها:
Active Learning English for Specific Purposes (ESP) Flipped Classroom Reading Comprehension students’ attitudes
The flipped classroom model has gained traction in language education; however, its application within English for Specific Purposes (ESP) remains underexplored. The present study investigates the impact of flipped classroom instruction on ESP students’ reading comprehension with a focus on their attitudes toward the model. Adopting a quasi-experimental methodology, the study utilized pretest and posttest assessments alongside a 15-item Likert-scale questionnaire to gather data. The research sample comprised 21 second-semester ESP students from Guilan University majoring in Cellular and Molecular Biology, who engaged in a 10-week intervention. Pre-class preparation included instructional videos and reading materials, while classroom activities centered on group discussions and practical problem-solving tasks. Findings demonstrated a substantial enhancement in posttest scores, validating the approach as effective for improving reading comprehension. The survey results revealed highly positive student attitudes, particularly in terms of engagement, autonomy, and collaborative learning. These findings highlight the potential of the flipped classroom model to address the unique academic requirements of ESP students by blending discipline-specific resources with interactive learning strategies.
۱۲.
کلیدواژه‌ها:
Tendencies Gender Problem-Solving Skills teaching experience University EFL teachers
Critical thinking is one of the main functions of education and it is considered as learners’ use of prior knowledge to make judgments and solve problems. This study aimed, firstly, to examine the relationship between university EFL teachers’ critical thinking tendencies and their problem-solving skills, and secondly, to explore the prediction of university EFL teachers’ critical thinking tendencies by problem-solving skills, gender, and teaching experience. The study was designed in a correlational survey method. In total, 70 university EFL teachers (35 males and 35 females), from Azad and Payame Noor universities located in Isfahan and Ilam provinces teaching undergraduate students majoring in English, participated in this research. Data were collected via the California Critical Thinking Disposition Inventory and the Problem-Solving Inventory. The collected data were analyzed using descriptive statistics, the Pearson Product-Moment Correlation Coefficient, and stepwise regression analysis. The relationship between critical thinking tendencies and problem-solving skills was investigated through the Pearson Product Moments Correlation Coefficient, and stepwise regression analysis was run to determine whether university EFL teachers' problem-solving skills, gender, and teaching experience can significantly predict their critical thinking tendencies. The findings indicated that there was a positive, moderate, and significant relationship between university EFL teachers' problem-solving skills and their critical thinking tendencies, while there was no significant difference according to gender. In terms of teaching experience, the correlation coefficient for novice teachers showed a weak, positive, and non-significant relationship, yet the correlation coefficient for experienced teachers indicated a moderate, positive, and significant relationship. This study has both theoretical and practical implications for EFL teachers, practitioners, learners, and policymakers.
۱۳.
کلیدواژه‌ها:
AI Artificial Intelligence Emotioncy English language learning Language Achievement
Artificial intelligence (AI) is changing language education through personalized and interactive practice. However, its impact on language achievement and emotional aspects of learning is unclear. Therefore, this mixed-methods study investigated the effects of Chatbot-Assisted Language Learning (CHALL) on learners’ English language achievement and sense of metavolvement—the deepest level of metacognitive engagement. In phase 1, the Sense of Metavolvement Scale (SOMS) was developed and validated. In phase 2, following a quasi-experimental design, 44 intermediate Iranian EFL learners were divided into an experimental group (n=22, using the AI chatbot Pi) and a control group (n=22, receiving conventional classroom instruction). Both groups had pre- and post-tests for language achievement and metavolvement, and the experimental group sat for semi-structured interviews post-intervention. There were significant gains in the experimental group’s in-class metavolvement and language achievement. There were also significant differences between the two groups in post-test metavolvement, while there was no significant difference in their post-test language achievement. Furthermore, interview data illustrated CHALL as a low-anxiety practice context with cultural and pragmatic limitations. Therefore, CHALL can complement but not replace conventional instruction.
۱۴.
کلیدواژه‌ها:
Iranian EFL learners interlanguage pragmatics corrective feedback Invitation Acceptance Invitation Declination
This study investigates the effect of corrective feedback on Iranian English as a Foreign Language (EFL) learners’ interlanguage pragmatic (ILP) development in the context of invitation acceptance and declination. Three intact experimental groups were selected via convenience sampling from an English institute in Tehran: a recast group (N = 13), a metalinguistic group (N = 17), and a clarification request group (N = 12). Prior to the treatment, the groups participated in a dialogic extended discourse pretest. The dialogues for invitation acceptance and declination were drawn from Top Notch, American English File, English Result, and Four Corners. Learners’ performance was assessed using two checklists—one for pragmalinguistic and the other for sociopragmatic knowledge—based on a five-item Likert scale ranging from inappropriate to most appropriate. Treatment sessions were conducted three times per week, each lasting 60 minutes, over a period of one month. The findings reveal that corrective feedback significantly enhanced ILP development. Notably, the metalinguistic group outperformed the recast and clarification request groups. Consequently, metalinguistic corrective feedback proved more effective than recast and clarification feedback in fostering Iranian EFL learners’ ILP development concerning invitation acceptance and declination.
۱۵.
کلیدواژه‌ها:
Assessment scale EFL teacher agency Scale development Scale validation
Foreign language (FL) teacher agency, as a significant part of teachers’ professional development, encompasses self-organized efforts to augment professional growth. This study aimed to develop an ecological FL teacher agency model through a sequential exploratory mixed methods design based on which an assessment scale measuring FL teachers' agency value was developed. In the qualitative phase, developing and validating the FL teacher agency model, firstly, an interview guide was developed and piloted in a group of 10 TEFL teacher educators from Farhangian Teacher Education University in Tehran. Then, 30 in-service EFL teachers were interviewed. The data were analyzed through MAXQDA to find the components of the tentative conceptual model of teacher agency. Based on the interview analysis, the preliminary draft of the EFL teacher agency scale was developed. The refined EFL teacher agency questionnaire encompassing the three components of Autonomy, Freedom, and Choice was administered to 354 randomly selected EFL teachers. The scale's reliability was gained through Cronbach's alpha, and its construct validity through Exploratory Factor Analysis (EFA). The study findings could be used by foreign language teachers, teacher educators, and TEFL teacher agency researchers.
۱۶.
کلیدواژه‌ها:
Computer-assisted language learning Intended Curriculum syllabus Assessment
The emergence of technological advances dramatically changed the status of foreign language teaching forever, making computer-assisted language learning (CALL) into a key area in foreign language teaching and later a distinct academic discipline at higher education level. The present study describes the intended curriculum of a two-year post-graduate technology-enhanced language teaching program launched at Al-Zahra University, a women’s university in Tehran, Iran, as well as the national context within which the program was developed. It begins with a background on the significance of technology in education followed by a brief history of education in Iran. The main part of the paper describes the intended curriculum of the program from different perspectives including the aims and rationales, significance of the program, student profile (who takes it) and sources of the M.A. admission examination, abilities intended for graduates, courses of the program, syllabus and recommended readings, and assessment of the course outcomes. The paper finally concludes by discussing what is not included in the curriculum as well as the implications for teacher educators and suggestions for further research.
۱۷.
کلیدواژه‌ها:
Funds of identity Output-Based Podcasts Teacher CF willingness to communicate
This study examines the influence of output-based podcasts (OBPs), the mediating effect of funds of identity (FoI), and teacher corrective feedback (CF) on L2 speaking of Iranian pre-intermediate learners and their willingness to communicate (WTC). The study also surveys the attitudes of the experimental groups toward OBPs and CF, as well as their probable attitude and WTC changes over time. To these ends, 60 participants were randomly divided into two experimental groups (the OBPs + CF and theOBPs – CF group) and a control group. Podcasts were created based on themes congruent and incongruent with students' FoI. The data was collected through pretest, immediate and delayed posttests, (attitude, WTC, and FoI) questionnaires, reflective journals, as well as an interview. Results demonstrated that OBPs improved the experimental groups’ speaking ability. Moreover, CF pushed learners to perform better. FoI also proved to be pivotal in triggering learners’ WTC. Learners had positive attitudes toward OBPs and FoI in improving their speaking skill. Furthermore, learners’ WTC changed positively over time as a result of creating podcasts. Integrating FoI into creating podcasts improved learners' performance, increased their WTC, and brought them more satisfaction. As such, OBPs based on students' FoI are suggested to serve as an alternative teaching method to traditional lecturing.
۱۸.
کلیدواژه‌ها:
dynamic assessment IMLE LPMA TLA Writing Apprehension Writing Self-efficacy
Dynamic assessment (DA) is an innovative way of assessing students’ knowledge. Given the importance of knowing how to reduce writing apprehension and improve writing self-efficacy in language learning, this study investigated the effects of models of DA including Buddoff’s Learning Potential Measurement Approach (LPMA), Carlson and Wiedl’s Testing-the-Limits Approach (TLA), and Intensive Mediated Learning Experience (IMLE) on L2 writing apprehension and self-efficacy. The participants were 302 students in four groups. All groups were given the writing apprehension and writing self-efficacy questionnaires as pretests, followed by 20 sessions of treatment. The same questionnaires were given in the last session as posttests. The collected data were analyzed using one-way Analysis of Covariance. The results showed a significant difference among the four groups’ writing apprehension and writing self-efficacy mean scores on the posttests. The findings also revealed that the IMLE group outperformed the other two groups. Based on the results, it was concluded that employing DA models can be conducive to reducing writing apprehension and improving writing self-efficacy among EFL learners. The findings of the present study can have useful implications for teachers, students, material designers, and language assessors.
۱۹.
کلیدواژه‌ها:
ELT Practicum PSTs cooperating teachers Perception TEFL
Despite its recognized importance in preparing prospective teachers for the realities of the classroom, the practicum in Iranian TEFL programs faces several challenges that can significantly impact its effectiveness and hinder the development of competent and confident TEFL teachers in the country. This study, characterized as a comprehensive nationwide triangulated project, aimed at exploring and comparing the perception of the Iranian TEFL Preservice Teachers (PSTs) and the corresponding stakeholders on major issues, problems and challenges of the practicum program at Farhangian University. To these ends, a researcher-made practicum evaluation questionnaire was distributed among the participants (including 230 PSTs and 215 stakeholders) whose answers were analyzed through factor analysis. Based on factor loadings, nine major extracted factors in the two participant groups were compared through Independent Samples t-tests. The results showed that PSTs and stakeholders shared common perceptions on six factors while they held different perceptions only on three other factors. A semi-structured interview was additionally designed and conducted with 15 PSTs and 15 stakeholders. Finally, 10 practicum courses were observed to obtain an accurate understanding of the current situation of ELT PSTs’ internship education in Iran. The findings uncovered major issues and challenges with regard to ELT practicum including (a) limited adaptability and innovation in instructional approaches, resources, and materials utilized by the cooperating teachers who served as a role model for PSTs, (b) insufficient collaboration between educational institutions and universities, (c) lack of proper supervision by university advisors, d) insufficiency of time allotted to PSTs for teaching, and e) huge gap between theoretical concepts related to the practicum principles studied in university courses with the practical realities faced by PSTs in the school environment, to name a few. The findings of the study might firstly give some insight to universities and schools in developing and implementing high-quality practicum programs that might contribute to the advancement of ELT teacher education programs. Moreover, the study can contribute to our understanding of the extent to which PSTs can integrate theoretical knowledge into their teaching practices.
۲۰.
کلیدواژه‌ها:
Curriculum planning Curriculum practice ELT teachers ELT policies
The present study aimed to explore how the ELT curriculum is perceived, adopted, and implemented by EFL high school teachers. This study also shed some light on several effective factors in curriculum planning and practicing. Data for this study came from a survey and follow-up interviews with EFL teachers. The Findings revealed some critical systemic gaps between policy and practice: (1) a disconnect between policymaking processes and established ELT pedagogical theories; (2) insufficient incorporation of stakeholder voices, particularly teachers, during policy formulation; (3) neglect of teacher agency, professional needs, and motivational factors in curriculum design; and (4) an absence of foundational needs analysis research to inform policy decisions. The study underscores the imperative of prioritizing teacher autonomy, participatory policymaking, and evidence-based frameworks in curriculum development. To mitigate disparities between policy objectives and classroom practices, recommendations include decentralizing decision-making to empower educators, integrating teacher feedback into policy cycles, leveraging academic expertise, and fostering context-sensitive adaptations of global ELT methodologies. These insights contribute to broader regional discussions on educational equity, teacher professionalization, and sustainable language policy reforms in institutional settings.
۲۱.
کلیدواژه‌ها:
Engagement Mini White-boards Formative assessment Student Response Systems Feedback Collaborative Interaction Personalized Participation
Higher levels of student engagement are positively linked to higher learning achievement. However, enhancing student engagement in underprivileged and crowded educational contexts, specifically where high-tech tools are not available can cause a major challenge for teachers. The current study attempts to enhance students’ engagement in their learning by incorporating mini white-boards (MWs) as low-tech response systems. To this end, in a time-series design, an instruction-feedback cycle via mini white-boards was manipulated over a semester. Ten 10th-grade students, all from similar low socio-economic backgrounds and living in rural areas, participated in this study. Data were collected through observing students’ behaviors using engagement checklists. An attitude questionnaire was also administered to assess students' perceptions of using mini white-boards in their learning context. Descriptive statistics were used to summarize individuals’ engagement patterns across the study period. Additionally, a mixed-effects model was employed to account for individual variability and to assess the effects of the intervention on students’ engagement over time. The results indicated that using mini white-boards caused significant improvements in students’ overall engagement and attitude. The findings suggest that using low-tech solutions in low socio-economic settings can foster student engagement by allowing real-time feedback, collaborative interaction, and personalized participation.
۲۲.
کلیدواژه‌ها:
ChatGPT Human raters Correlation corrective feedback Automated Essay Scoring
The study, which has been derived from a larger project, examined how effective ChatGPT, compared to human raters, is for scoring writing tasks when tasks were arranged from simple to complex or vice versa. In so doing, a correlational design was employed. The participants were 113 EFL learners. Two sets of writing tasks were customized based on the SSARC (simplify, stabilize, automatize, reconstruct, complexify) model. The participants were divided into two groups. They took a pre-test and did tasks in two different orders. The tasks were rectified by the researcher and returned to them later. The participants enhanced their text based on comments on tasks. After that, they took a posttest. Human raters and ChatGPT scored the pretests and posttests. A Pearson Correlation test was run to obtain the correlation between a human rater and ChatGPT. The results indicated a strong positive correlation between scores assessed by human raters and those by ChatGPT when tasks were arranged from simple to complex (r = 968, p > 05) or complex to simple (r = 860, p > 05). These findings suggest that ChatGPT can be an effective tool for writing assessments. Suggestions for further research are discussed.
