Developing and Validating a MetalinguisticKnowledge Test of Grammar for UniversityUndergraduates in Pakistan

Abstract

The exploration of metalinguistic awareness has gained significant importance in the realm of second language acquisition. This research aimed to develop and validate a Metalinguistic Knowledge Test (MKT) of grammar for undergraduates in Pakistan, addressing the gap in such resources for Pakistani undergraduate learners. The theoretical framework of Bialystok and Ryan (1985) supported the test’s construct and content. A convenience sampling strategy was employed to administer the MKT to 440 participants from diverse academic and regional backgrounds. Experts assessed the test’s face, content, and construct validity. SPSS, a statistical software, facilitated the exploration of descriptive statistics and item analysis, including facility value, discrimination analysis, and distractor analysis. The internal consistency was high, with a Cronbach alpha of .967. From an initial pool of 150 items, 87 were retained in the final version. A two-way ANOVA revealed a significant gender effect but no interaction between gender and subject, supporting the MKT’s validity and reliability across different subjects. Limitations include the small sample size and a limited number of experts on the panel. This study has broad implications for ESL education and assessments at higher education levels.