Construct validity

The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in the first part of the research, a qualitative data analysis according to the translation tasks done by eleven participants and their feedback through a semi-structured translation problems interview was done for finding the descriptors in designing the psycho-motor mechanism scale. Next, by designing the scale, two translation tasks were given to 90 M.A. students majoring in Translation Studies at four different branches of Islamic Azad University. Based on the rating done by two experienced raters, construct validity and reliability of the scale was revealed by the use of factor analysis and correlation statistics. The findings approved by the construct validity and reliability of the researcher-constructed scale could contribute to the field of Translation Studies since having a more objective scale for translation tasks in line with anchored theories of translation quality assessment like those of PACTE (2003) is a felt need.

The field of language assessment, commemorating its 40th anniversary since the launch of language testing, has evolved significantly over the years. This study aimed to investigate the key findings and insights from exploring the role of construct validity in shaping the design of English Language Assessment (ELA) tasks. Additionally, it delved into the challenges encountered in construct validity research studies and the strategies suggested by experts to enhance it. The research team utilized a mixed-method research design for the current study. A total sample size of 37 participants was deployed. Descriptive statistics was used to summarize survey responses using quantitative analysis software (e.g., SPSS). Qualitative data was coded and organized using qualitative analysis software (e.g., NVIVO). Based on the research findings, experts in the current study have proposed strategies, and recommendations for enhancing construct validity. These strategies encompassed the incorporation of contextual factors into assessment design, the promotion of continuous validation research, the diversification of task types, and the active involvement of test-takers in the assessment development process. The findings of this study may render implications for EFL teachers, teacher trainers, and assessment administrators.

The assessment of listening abilities is one of the least understood, least developed and, yet, one of the most important areas of language testing and assessment. It is particularly important because of its potential wash-back effects on classroom practices. Given the fact that listening tests play a great role in assessing the language proficiency of students, they are expected to enjoy a high level of construct validity. The present study was dedicated to investigating the construct validity of three different test formats, namely, multiple-choice, gap filling on summary (also called listening summary cloze), and fill-in-the-blank, used to evaluate the listening comprehension of EFL learners. In order to achieve the purpose of the study, three passages with relatively similar readability levels were used for the construction of 9 listening tests, that is, each appeared in three formats. Following a counter-balanced design, the tests were administered to 91homogeneous EFL learners divided into three groups. The statistical analysis of the results revealed that the multiple-choice test enjoyed the highest level of construct validity. Moreover, a repeated measure one-way ANOVA demonstrated that the fill-in-the-blank task was the most difficult with the MC test as the easiest for the participants.