The biggest risks for misuse of AI in assessment lie in unsupervised assignments, especially written assignments. It is, of course, not possible to completely avoid unsupervised written assignments, nor would we always want to do so. We need to reconsider whether they still fit the learning objectives at a time when many students are using genAI, such as ChatGPT, to help them.
The existing methods of detecting AI-generated texts are unreliable and should not be used. It is unclear if this situation will change, as AI is constantly learning and improving, leading to future versions with improved functionalities, making unauthorized use even more difficult to detect. In addition, there are privacy concerns about detection software that can recognize students’ writing styles.
Instead of using detection software, we recommend that lecturers take a closer look at their written assignments. It might be that alternative methods of assessment can be used or that the assessment for the course as a whole needs to be reconsidered. If so, have a look at our page on assessment at a course level.
As previously mentioned, it might not be possible to avoid using unsupervised written assignments, such as papers, take-home exams, or coding assignments, in your course at the present time. In that case, take a look at the steps below that help you evaluate the position of your written assignment. You will also find practical tips and examples on making your written assignment less vulnerable to the misuse of genAI.
Note that it is impossible to set up unsupervised assignments in such a way that misuse of genAI is prevented entirely. Students can be very adept at integrating genAI at different stages of the writing process in ways we can neither anticipate nor detect. It is better to focus on how you can motivate and stimulate students to engage in the learning process responsibly.
Take a closer look at the learning objectives of the course and consider whether assessment forms other than unsupervised written assignments can be used to determine whether students have achieved those learning objectives. Another consideration is whether you can reduce the weight of the unsupervised writing assignment(s) in the final grade in favour of other assessments less prone to the unauthorized use of AI.
Also consider the place of the course within the curriculum and consult with the rest of the teaching team. Many programmes include a writing assignment in every course, even though this is not always necessary or desirable from the perspective of the learning objectives and learning outcomes. In which courses are writing assignments really indispensable? Are there courses in which a different form of assessment can be used? See for more information our page on assessment at a course level.
Take a close look at the assignment requirements. We have identified four particular vulnerabilities in assignments that can often be resolved. Read more about these vulnerabilities, solutions, and detailed examples by clicking the links below.
If you have doubts about the unauthorized use of AI impacting your assessment, consider the following points:
Would you like advice on making your assessment safer? Please contact an assessment specialist through your faculty’s TLC. You can also always ask the TLC-Central’s assessment specialists for advice by contacting tlc@uva.nl.