PIRLS

Progress in International Reading Literacy Study (PIRLS) is an international comparative study of reading comprehension that is administered by the International Association for the Evaluation of Educational Achievement (IEA) to measure the reading competency of fourth grade students in the participating countries. The test is a very comprehensive measure of reading literacy which covers a wide variety of reading subskills and texts. The purpose of the current study is to evaluate the psychometric qualities of PIRLS 2021 using the national data of Kazakhstan. The 2-parameter item response theory was used to evaluate the test. Item difficulty, discrimination, infit, outfit, and the root mean square deviance (RMSD) fit statistics were examined. The multiple-group IRT was used to examine differential item functioning. Findings sowed that PIRLS 2021 is a robust measure of reading comprehension and does not exhibit differential item functioning (DIF). However, based on the 2PL discrimination and infit and outfit values, several items are problematic. The implications of this finding are discussed.

Progress in International Reading Literacy Study (PIRLS) is an international assessment that measures the reading literacy of fourth-grade students (aged 9-10 years old). PIRLS aims to evaluate and compare the reading abilities of students across different countries. It assesses how well students can understand and interpret written texts, which is fundamental to their overall educational development. In this study, psychometric analyses were run on a portion of the multiple-choice items of PIRLS 2016 taken by 4th graders in the USA. The 3PL item response theory model was utilized to examine the test. Discrimination, difficulty, and guessing parameters were estimated along with the fit values, reliability, item characteristic curves, and item-person map. M2, CFI, TLI, and RMSE statistics showed that the test is reliable and the model, overall, fits the data. Item fit statistics outfit and infit showed that most of the items fit the 3PL model. Findings showed that while all the items have acceptable discrimination values, two items have unacceptable guessing parameters. Examination of the ICCs showed that graphical displays are important, in addition to numerical values, for examining item quality. Item-person map showed that items do not target the whole ability scale.