Involving marginalized stakeholders in assessment design & development
In the ever-evolving landscape of assessment, an equity-minded assessment has emerged recently that would help educators identify learners’ performance gaps. Dr. Maria Oliveri, Research Associate Professor at Purdue University, shed light on this critical topic in an interview conducted in October 2023.
From higher education admission and standardized tests to competency assessment, Dr. Oliveri suggested reflecting on the diverse backgrounds of test-takers and being mindful of the cultural background of the individuals taking the test. One interesting example she shared in the interview regarding item development is, “When you develop an assessment for use internationally, and you use the name Mississippi in a question, Mississippi may mean something to somebody or everybody in the US. But it might not have any meaning internationally.” This example demonstrates one case that seems familiar to one group may be foreign to another.
To ensure fairness across student groups and avoid bias, representation from multiple groups would play an essential role in assessment design, as the insights from these groups would foster a more inclusive assessment process. “Who sits at the table?” as Dr. Oliveri reflected on her own practices, this question became a critical guiding question that would help pave the way for a more inclusive education environment.
While cultural representation differs based on various factors and project goals, Dr. Oliveri also emphasized the importance of introducing practical guidelines when collaborating with diverse stakeholders; using “practical ways to operationalize assessments rather than talk about it generically.” More research can be found in her relevant research, listed below.