4498 - ASSESSMENT CAPACITY BEYOND TECHNICAL QUALITY: THE ROLE OF SOCIOLINGUISTIC CONTEXT IN VALID ASSESSMENT SYSTEMS

Session: 4495 - MULTIPLE FACETS OF ASSESSMENT CAPACITY
AUTHORS:
Elosua Paula (Universidad del Pais Vasco ~ Gipuskoa ~ Spain)
Abstract text:
Assessment capacity is key to ensuring that educational assessments support valid interpretations and responsible uses of test results. It extends beyond the development of technically sound instruments to include the ability of education systems to sustain coherent assessment infrastructures and to use assessment information effectively for educational decision-making and policy.


Within this broader perspective, contemporary validity frameworks emphasize the socially situated nature of assessment. Building on the sociocognitive assessment model proposed, this paper argues that assessment capacity should be conceptualized as an integrated system linking cognitive processes, task features, interpretive arguments, and contextual conditions. While the sociocognitive model provides a robust foundation for connecting evidence and inference, its treatment of language-related context remains relatively implicit.


We propose that sociolinguistic context constitutes a core component of assessment capacity and should be explicitly incorporated into sociocognitive assessment arguments. Sociolinguistic factors—such as language status, patterns of language use, and linguistic distance—shape how students access assessment tasks, how evidence is generated, and how results are interpreted. When these factors are overlooked, even assessments that meet
psychometric standards of equivalence may produce interpretations that lack cultural or consequential validity.


The paper illustrates these conceptual claims with evidence from a large-scale mathematics assessment conducted in the Basque Autonomous Community in Spain, a bilingual context in which assessments are administered in different languages. The empirical results are not the primary focus of the contribution, but rather serve to illustrate how psychometric equivalence alone may be insufficient when sociolinguistic conditions are not explicitly modelled.


Overall, this paper contributes to the discussion on assessment capacity by extending the sociocognitive framework to foreground sociolinguistic context as a necessary condition for valid assessment systems. This extension strengthens cultural and consequential validity and enhances the capacity of education systems to interpret and use assessment results responsibly in linguistically diverse settings.