Rubric

The present study aimed to examine and validate a rubric for translation quality assessment using Rasch analysis. To this end, the researchers interviewed 20 expert translation instructors to identify the factors they consider important for assessing the quality of students’ translation. Based on the specific commonalities found throughout the interviews, a 23-item assessment rubric was constructed on a four-point Likert scale. More specifically, this study used the Rasch rating scale model for polytomous data to investigate the psychometric properties of the rating scale in terms of dimensionality, reliability, use of response category, and sample appropriateness. Then, a translation exam was administered to 60 translation students at the BA level in Iranian universities. Following this, the rubric was employed to assess the quality of students’ translation. The results revealed that the Rasch model fits the data well. Thus, the findings of the study indicated that the rubric is potentially valid and useful, and can be used as a measure of translation quality assessment in the Iranian context.

Recently translation researchers have endeavored to adopt new directions in the current translation quality assessment (TQA) approaches. To this end, they made them more congruent with the desired requirements of a translator’s competence, especially considering the latest paradigm shifts, including ideological skewing and localization (Tiselius & Hild, 2017). Thus, such frameworks as Angelelli’s (2009) definition of translation competence (TC), as the study’s theoretical framework, need to be improved. An attempt was made in this study to design a rubric based on the proposed TQA model representing the TC construct with its comprehensive sub-components and finally, to test its applicability to the Persian translation of The Catcher in the Rye . The assessment procedure through which the obtained results were textually analyzed based on the proposed rubric specifically for each sub-component, revealed the inadequacy of the translation quality on the whole and the underlying implications of the rubric’s applicability to other translation products.                                                                                                                                                                   

Reviewing the literature, there is an evident lack of appropriate research on the potential difficulties of assessing speaking skill and the urgent need of more rigorous assessment of speaking skill and its intricacies. Therefore, this study aimed to develop a collaborative local rubric for assessing Iranian high school students’ speaking skill constructed through the school-university members' collaboration. The participants of this study were 3 high school English teachers and 3 university instructors. They had at least 5 years of experience in English teaching and familiarity with rubrics and how to use and develop them.To gather data, a semi-structured interview was conducted with the participants. After coding and analyzing the data, it was revealed that the participants mentioned some similar criteria such as the importance of pronunciation, grammar, vocabulary, fluency and the use of a 0-4 assessment scale. However, some contradictions arose between the participants about the scores and the strictness/flexibility of those levels. The currently-developed speaking rubric, which is a simulation of the IELTS and TOEFL speaking rubrics, intended to help high school teachers undertake a more thorough assessment resulting in students’ enhanced learning of speaking. This study proposed practical implications for teachers and instructors in particular test constructors and examiners.

Given the increasing prevalence of online learning and the absence of a validated instrument for assessing the critical writing skills of Iranian EFL learners in Computer-Mediated Communication (CMC) contexts, this study aimed to develop and validate an analytic rubric to enhance critical writing in CMC environments. The participants were 236 EFL students and 10 EFL/ESL teachers, representing a diverse range of demographics, experiences, and qualifications. The rubric development process was guided by a comprehensive literature review, the administration of a critical thinking questionnaire, expert feedback, thematic analysis of semi-structured interviews, integration of Paul and Elder’s (2019) Intellectual Standards, and the development and application of a Likert-scale critical writing questionnaire. Subsequent pilot testing facilitated refinements based on feedback. Accordingly, the finalized analytic rubric featured four principal components: (1) Clarity, Accuracy, and Precision (CAP); (2) Relevance and Logic (RL); (3) Depth and Significance (DS); and (4) Breadth and Fairness (BF). A rigorous validation process, including expert evaluation, factor analysis, and structural equation modeling (SEM), confirmed the rubric's reliability and validity. The findings demonstrated satisfactory internal consistency, as well as convergent and discriminant validity. This study offers valuable pedagogical implications for English as a Foreign Language (EFL) teachers, learners, researchers, and curriculum developers.