Large Language Model AI tools work by predicting what the next word in sentence, this can mean they ‘make things up’ and also the language used will be very controlled. This does mean there are some clues and patterns that can be looked for to give an indication as to whether the writing is AI generated. These include:
- A lot of repetition, reframing, particularly of paraphrases.
- A lack of opinion or personal responses to something
- Something that lacks depth- on the surface it looks convincing but has less substance.
- Generic answers with little that is creative, innovative, or strange.
- Writing that reinforces dominant narratives, ideas, or systems, straying into bias on occasions.
- As they predict next word common words (It, is etc) are repeated.
- Lack of any typos which you would expect to see in human generated text.
- Use of American spellings
It is important to view the student work holistically. While the above clues and patterns can provide useful pointers these are also features that may be exhibited by international students or students who are yet to fully develop their writing.
Coventry University Group does not currently utilise any AI detection tools given concerns, shared across the sector, over the reliability of such tools and the possibility of false positives.
If there are concerns over a student submission the University Groups Academic Misconduct process must be followed. Staff must not upload student work to any AI tools.
Mitigating the use of poor academic use of AI is dependent upon good assessment design, educating of students and developing their AI literacies. For further information see: Assessment design to counter academic misconduct through the use of AI tools
Useful Links
QAA (2023) Maintaining quality and standards in the ChatGPT era: QAA advice on the opportunities and challenges posed by generative artificial intelligence, QAA https://www.qaa.ac.uk/en/membership/membership-areas-of-work/academic-integrity/chatgpt-and-artificial-intelligence
QAA (2023) The rise of artificial intelligence software and potential risks for academic integrity: briefing paper for higher education providers, QAA https://www.qaa.ac.uk/en/membership/membership-areas-of-work/academic-integrity/chatgpt-and-artificial-intelligence