aiGrunn: testing chatgpt checkers - Arend Top & Rix Groenboom

Tags: aigrunn, ai

(One of my summaries of the 2023 Dutch aiGrunn AI conference in Groningen, NL).

The world of education was a bit shocked by chatgpt. The instance they work for advices to be a bit careful, but allows it. But you’re not allowed to let chatgpt write parts of your official thesis, just like you’re not allowed to let a family member write it. Chatgpt usage can be treated as fraud.

Well, which tools can be used to search for possible fraud?

  • GTP-2 output detector

  • Copyleaks

  • GPTZero

  • AI detector pro

  • Corrector app

  • Chatgpt (yes, you can ask it whether it looks like it wrote something).

They looked at 40 student reports from a variety of fields. Also both Dutch and English. And from between januari 2020 and june 2022, so before chatgpt could have been used. For every report, they made three summaries:

  • One by a human.

  • One by chagtgpt.

  • Chatgpt, but altered by QuillBot, which should make it look less recognizable.

So: 120 test samples in total. In the end copyleaks performed the best. The others didn’t do well.

 
vanrees.org logo

About me

My name is Reinout van Rees and I work a lot with Python (programming language) and Django (website framework). I live in The Netherlands and I'm happily married to Annie van Rees-Kooiman.

Weblog feeds

Most of my website content is in my weblog. You can keep up to date by subscribing to the automatic feeds (for instance with Google reader):