Inclusive assessment

The primary purpose of (summative) assessment is to determine as accurately as possible whether students have mastered the learning objectives, without irrelevant or random factors skewing the results. As a lecturer, you must therefore always be critical: do differences in scores truly reflect the achievement of learning objectives, or are there irrelevant factors at play? These could include the quality and circumstances of the assessment, but also the background or personal characteristics of the student (Tai et al., 2023).

Assessment quality and inclusion

To guarantee assessment quality, assessments must be reliable, valid and transparent, without creating an unnecessarily high workload for either students or lecturers. Inclusion plays a role in all four quality standards for assessment. It is therefore not an additional requirement but inextricably linked to assessment quality. Inclusive assessment is emphatically not the same as relaxing standards. It is about removing unnecessary barriers so that all students have the opportunity to demonstrate what they have learned.

Do you want to make sure your assessment is as inclusive and accessible as possible? In this article, you will find key points to consider, organised according to the four quality standards for assessment.

Inclusive assessment … for all students

These recommendations are deliberately not aimed at specific groups but at all students. This allows you to make your assessment as inclusive and accessible as possible upfront, so that fewer individual adjustments are needed afterwards. Our premise is that university education should adapt to the increasing diversity among students, rather than students having to change to conform to existing structures; for vulnerable groups, this can lead to increased stress and a reduced sense of belonging at university (Koutsouris et al., 2021; Sanger, 2020; Tai et al. 2022). In doing so, we emphasise that inclusive assessment is not an extra requirement, but a matter of course in good teaching.

Special facilities

In addition, the student counsellor and study advisor can arrange additional facilities for students with disabilities or special circumstances, such as exams in a separate space or special assistive software. You can find more information here.

1. Validity

Valid assessments measure whether students have actually learned what they are supposed to have learned. In other words, the assessment must be aligned with the learning objectives and what has been taught.

Only assess the learning objectives – not more, not less

Students should only be assessed on what is necessary to demonstrate that they have met the learning objectives, regardless of their personal characteristics, background or incidental prior knowledge. For example, if presentation skills are not an explicit learning objective for an assignment, then they should not be taken into account in the assessment. Perhaps a different assessment method would be more appropriate if the grade is too strongly impacted by presentation skills.

Do not factor in language skills unnecessarily

Language can often cause confusion, for example for students with disabilities such as ASD or dyslexia, but also for students who are not studying in their native language. Therefore, keep assignment instructions and exam questions simple and concise so that you are not unintentionally assessing language or reading skills, which could cloud the measurement of the content-related objectives. When grading, do not hold students to unnecessarily high language proficiency standards if these are not relevant to the objectives of the course (of course, language proficiency should be taken into account in the assessment if this is relevant to the learning objectives and content of the course).

Use widely recognised examples

Use cases and examples that all students will recognize and that are relevant to the course content. Avoid examples that only some of the students will recognize, such as a commercial that only Dutch students would be familiar with. This will not allow you to assess the intended knowledge, but rather coincidental prior knowledge.

2. Reliability

In a reliable assessment, you take measures to ensure that the result is not based on chance (or cheating).

Set sufficient and varied assessments

Make sure the result does not depend on just one assessment or not enough questions (greater chance of random hits or misses) and that there is sufficient variety in assessment methods (for example, avoid using predominantly written assignments throughout the programme, as this may disadvantage or favour certain students).

Grade fairly and objectively

Make sure your grading is fair and reliable. Use clear rubrics and answer keys to ensure consistent and objective grading. Have assessors calibrate regularly when grading to prevent bias, or grade anonymously.

3. Transparency

Transparency in assessment ensures that both students and lecturers understand what is expected of them: how many questions are there, how much time is available, how will they be graded, what constitutes a good answer, how can they best prepare, and what is and isn’t allowed during the exam? In addition, questions and assignments must be worded as clearly and concisely as possible to avoid ambiguity. This reduces stress and ensures that the assessment is accessible to everyone.

Consider student neurodiversity

Use an accessible font (and let students know how they can set this themselves for digital assessments) and make sure your layout is clear and uncluttered.

Provide structure and support

Share examples of good work, rubrics, and assessment forms. Organise an (online) Q&A session about the assessment. Create a weekly planner with important dates and deadlines that you share not only via Canvas but also refer to during class.

Be mindful of the ‘hidden curriculum’

The ‘hidden curriculum’, that is to say the unwritten rules, expectations and norms at university, is familiar to some students because of their prior education or background (Koutsouris et al., 2021). However, for students who are unfamiliar with these implicit rules and expectations, such as first-generation students and students with a lower socio-economic status, not understanding the rules of the hidden curriculum can have a negative impact on their well-being and academic performance. The perceived barrier to asking for help is often high.

For experienced lecturers, it is not always obvious what students perceive as implicit or unclear. When assessing, consider questions such as the following:

  • When you ask for an essay or close reading, do students know what that is and what it should look like? Do they know what it means when you ask them to “analyse” or “evaluate” something?
  • Some students are better at giving presentations or writing papers than others, without having explicitly learned this in your course, because of their previous education or background. How can you ensure that you are assessing students without bias, based on what they have learned, and not what they already knew? How can you help students who lack essential prior knowledge? See also Validity.

4. Feasibility

In addition to the content-related quality standards, it is also important that your assessment is practically feasible, both for lecturers and students. For lecturers, assessment and grading must fit within the allocated hours. For students, the study programme must be realistically doable.

Provide flexibility and variety

More and more students have to plan their studies around a disability, caregiving responsibilities, parenting, financial or housing concerns, a part-time job, and so on. Although we can’t take every individual situation into account as lecturers, it’s good to offer flexibility and variety where possible, for example by building in choices (in terms of subject or format), offering multiple submission dates and providing location- and/or time-independent assessments.

Avoid unnecessary hurdles or restrictions

This often means that vulnerable students are the first to drop out. For example, allow compensation between partial results, avoid peak scheduling of deadlines and exams, and make resit arrangements flexible and accessible. Do make sure that this is balanced with lecturer workload.

Help or advice

Would you like advice about how to make your assessment inclusive and accessible? Make an online appointment with the Humanities Faculty assessment specialists.

References
  • Boston University, ‘Teaching the Hidden Curriculum’, Teaching the Hidden Curriculum | Teaching Writing
  • Clouder et al. (2020): Neurodiversity in higher education: a narrative synthesis.
    Higher Education 80, 757–778. DOI:10.1007/s10734-020-00513-6
  • Hamilton and Petty (2023): Compassionate pedagogy for neurodiversity in higher education: A conceptual analysis. Frontiers in Psychology 14:1093290. DOI:10.3389/fpsyg.2023.1093290
  • Hogeschool Rotterdam, Poster ‘Toetsing en Inclusiviteit’, https://www.hogeschoolrotterdam.nl/go/diversiteit-en-inclusiviteit/home/inclusieve-leeromgeving/toetsen/
  • Koutsouris, G., Mountford-Zimdars, A., & Dingwall, K. (2021). The ‘ideal’ higher education student: understanding the hidden curriculum to enable institutional change. Research in Post-Compulsory Education26(2), 131–147. DOI:10.1080/13596748.2021.1909921
  • Sanger (2020). Inclusive Pedagogy and Universal Design Approaches for Diverse Learning Environments. In: Sanger & Gleason (eds) Diversity and Inclusion in Global Higher Education. Palgrave Macmillan, Singapore. DOI:10.1007/978-981-15-1628-3_2
  • Tai et al. (2022): Designing assessment for inclusion: an exploration of diverse students’ assessment experiences. Assessment & Evaluation in Higher Education. DOI:10.1080/02602938.2022.2082373
  • Tai et al. (2023): Assessment for inclusion: rethinking contemporary strategies in assessment design. Higher Education Research & Development, 42:2, 483-497. DOI:10.1080/07294360.2022.2057451