AI-detektorers roll på universitet : En studie avsedd att undersöka AI-detektorers förmåga att särskilja på kortare texter från ChatGPT 4 och människor.

Sammanfattning

This study explores the reliability of various AI detectors and their potential role within universities. The method conducted involved collecting 20 texts from individuals with diverse academic backgrounds. These were then submitted to ChatGPT 4 with the prompt “Write an introduction to an academic text based on this title ‘...’. Write it as a university student, with sources and about 300-500 words!”, resulting in 20 AI-generated texts. All these texts were then evaluated by three different AI detectors to determine the likelihood of them being written by a human versus generated by an AI. For an assessment to be considered correct, the AI detector had to achieve a result of 95% or higher. The results were compiled by counting the correctly judged texts, spanning the various assessments percentage-wise, and averaging the results of the three AI detectors for both human-written and AI-generated texts. The average results for the three detectors were 40%, 55%, and 55% respectively. Therefore, the study concludes that AI detectors are too unreliable to play a role within universities. The study ends by discussing these results in more detail.