Update 11-16-2025. I am not SUPER convinced that I know exactly what is going on here. But what I do know is that I used Comet (Agentic Browser) to replicate some of the these patterns myself. So while I will not use these data to accuse students, I do have to change how I do things…and in the end so do you.
So as I was trying to figure out how to detect Agentic AI use in my classes, I was alarmed. In September there was nothing in the logs that suggested AI. But by November, there were several users in each class. In fact, when I mentioned to them that I had noticed that pattern, several emailed me after class to affirm that they were not using AI on quizzes. Those students who reached out were the ones that I was suspecting. I sent them email like this one, and put the ball in their court. When we take the new quiz format, we will have more evidence to consider.
All in all, I don’t like confronting students. Like really don’t. I tend to make it impossible to cheat so there isn’t an issue. But I also feel a responsibility to them, the other students, the school, and myself to do something. So far, most all of these students have admitted that they used AI, a couple are still holding out.
Below is analysis from one class for September 2025. Doesn’t show much supernatural speed and accuracy, see much more “randomness” when you look across them.
Below is from November 2025. Many seem to show Agentic AI usage. Like user 26 and 27. Several others like user 1, 5, and 6, for example, show the AI pattern but I see some questions have been returned to and changed (less typical of AI…for now). Question # is on the y-axis, so you can see if a question is revisited.