Rethinking Assessment in The Mathematical Sciences in Times of Generative AI


This in-person workshop, held in the Department of Mathematics & Statistics at Glasgow on Wednesday 17 July 2024, was attended by 65 participants. The aim of this workshop was to bring together practitioners from HE institutions across the UK to discuss adapting assessments to be in line with recent advances in Generative AI (GenAI) and to share good practice in these areas.

The day began with an inspiring talk by Professor Michael Grove (University of Birmingham) who discussed his testing of GenAI trying to solve problems from first year mathematics to passing a dentistry degree! Great ideas were shared, such as having a traffic light system in place for when students should and shouldn’t use GenAI.

This was followed by our first discussion topic, with groups getting together to answer some prompts. The discussions sessions throughout the day included:

  • Innovative Assessments
  • Academic Integrity
  • Ethical & Pedagogical Implications

A recurring theme from these discussions was that it’s an exciting technological time with many opportunities to update our learning outcomes to match the future working world, but we must also be cautious of bias and limitations, and clear with guidance. It was evident that guidance for both staff and students around GenAI usage is often not well-defined. Many people thought a move to oral assessments and collaborative assessments may be the way forward, to ensuring we teach the basic understanding, but also the modern application of knowledge.

We also had main talks from Dr Cesare Giulio Ardito (University of Manchester), Dr Will Yeadon (University of Durham) and an introduction from Dr Jenn Gaskell (University of Glasgow), alongside a fantastic range of lightning talks from the workshop participants. Empowering students with Generative AI (insights and outcomes) and Evaluating the Impact of Generative AI in Physics Education were the main speaker topics.

Jennifer Gaskell
University of Glasgow

Published