When Jeremy Sell saw the word 鈥減oignant鈥� spelled correctly in an essay, the jig was up.
Sell, a high school English teacher in California, already suspected that his student had used a generative AI tool like ChatGPT to compose the assignment.
The writing was a little too perfect. The voice was flat. 鈥淭oo vanilla, bland, smooth,鈥� in Sell鈥檚 description. The high-level vocabulary word鈥攏ot one Sell expected from this particular student鈥攚as just further confirmation.
Since ChatGPT鈥檚 introduction a year ago, Sell and other educators have used their grasp of students鈥� writing abilities鈥攁 Spidey sense honed over years in the classroom鈥攖o figure out whether an assignment had an AI ghost writer.
If I've got a kid who's willing to put in the time and effort to train a generative AI model on his own writing. ... There are some skills there.
But a newer, free version of ChatGPT released in the spring, ChatGPT 3.5, and even newer tools, like Google鈥檚 just-unveiled Gemini are scuttling that strategy. AI is rapidly becoming too sophisticated for even veteran educators鈥� detective skills, educators and experts say.
Enterprising students can put their own writing into these tools and direct it to emulate their voice and style, even adding in some spelling and grammar mistakes to make the cheating less obvious. Already, AI can produce a reasonable facsimile of a 4th grader鈥檚 essay.
And the technology is bound to get even better at imitating an individual author鈥檚 voice, experts say. That may leave even educators who consider themselves solid AI-sniffing bloodhounds in the lurch. After all, even linguists have difficulty distinguishing between a human-crafted piece of writing and one produced by AI,
鈥淚 definitely used to rely on that like [a] sixth sense of 鈥榯his doesn鈥檛 sound like you. I鈥檝e read things you鈥檝e written,鈥欌�� said Carly Ghantous, a humanities instructor at Davidson Academy Online, a private virtual school. 鈥淣ow that it鈥檚 clear that AI could generate that same [voice], it is a little bit unnerving to me as an English teacher who does require a lot of writing.鈥�
To be sure, when ChatGPT emerged about a year ago, it was 鈥渓ikely true鈥� that teachers could use their knowledge of student writing鈥攂oth students at a particular grade level, or their own individual students鈥攖o root out cheaters, said Stacy Hawthorne, the chief academic officer for Learn21, a nonprofit organization that works with schools to improve their use of education technology.
鈥淚t鈥檚 definitely not true now,鈥� Hawthorne said.
鈥榃riting generic responses to generic prompts鈥�
As an experiment, Hawthorne prompted ChatGPT to write in the style of a 4th-grade student, responding to a question about whether old objects鈥攍ike paintings鈥攕hould be thrown away or preserved. She asked the tool to consider tone, voice, sentence structure, and transitions. She also provided three writing samples from real 4th grade students, taken from the Utah Department of Education鈥檚 website.
ChatGPT鈥檚 first result had the right tone and style, but the spelling and grammar were too carefully crafted for a typical 4th grade student. Hawthorne gave the AI tool that feedback, and seconds later, ChatGPT spit out a version with more errors.
While it鈥檚 hard to imagine a 4th-grader navigating the tool successfully enough to cheat this way, it鈥檚 not much of a leap to envision a high schooler feeding ChatGPT, Gemini, or another generative AI tool some of their most recent work and asking for an essay on, say, the causes of the civil war, in their voice, Hawthorne said.
It鈥檚 unclear how many students have caught on to AI鈥檚 power to emulate their writing yet.
Sell doesn鈥檛 expect many of his students to have 鈥渢he wherewithal to do that鈥濃�攁t least not yet. In fact, he wondered if a student鈥檚 ability to get an essay out of a generative AI model that plausibly imitates their writing voice might be a demonstration of a different kind of know-how.
鈥淚f I鈥檝e got a kid who鈥檚 willing to put in the time and effort to train a generative AI model on his own writing,鈥� Sell said. 鈥淭here are some skills there.鈥�
But he expects that it will get exponentially easier as the tools mature, making cheating much harder to catch. That argues for rethinking how writing is taught, Sell said.
鈥淲e鈥檙e going to have to come to some sort of consensus ourselves about what would be acceptable use. AI is not going anywhere,鈥� Sell said. 鈥淎re we going to keep asking them to write really kind of generic responses to generic prompts that we鈥檝e used for years and years and years?鈥�
鈥榃riting can be a very messy process鈥�
Even as AI gets better at emulating individual students鈥� writing styles, there are still workarounds to ensure that students are doing their own work, educators and experts say.
For instance, Ghantous already requires students to show their work at different stages of the writing process, including brainstorming documents, outlines, and first drafts. That way, she will at least be able to catch major changes to their initial direction, Ghantous said.
Of course, that is unless students were 鈥渦sing AI through that entire process, in which case that sounds like a lot of work鈥� on the student鈥檚 part, Ghantous said.
Teachers can also use software that looks at student keystrokes to see if they actually typed a piece of writing themselves or if they cut and pasted it into a document, said Peter Gault, the founder and CEO of Quill, a nonprofit education technology literacy organization. He recommends DraftBack, which must be installed in advance of writing an assignment.
The tool can show how much a student is revising, how they are crafting individual arguments, and what their process for writing an outline looks like.
To be sure, it鈥檚 fair to question whether teachers should be getting such a thorough picture of their students鈥� writing process, Gault added.
鈥淲riting can be a very messy process,鈥� Gault said. 鈥淭he big ethical consideration is whether a teacher should or should not be able to see the students鈥� whole drafting process or not. But from a perspective of trying to see authentic writing happening, this is one way of doing so.鈥�
Will the real F. Scott Fitzgerald please stand up?
AI鈥檚 ability to mimic a writer鈥檚 voice can also serve as a teaching tool, exposing students to both the uses of the technology and the idea of a writer鈥檚 voice, Sell said. He鈥檚 teaching the high school English class staple The Great Gatsby by F. Scott Fitzgerald this school year and wondered if students could put some passages from the book into an AI tool and see how close it comes to emulating Fitzgerald鈥檚 vivid, prose.
English teachers could do the same with other authors that have a distinctive style, such as Ernest Hemingway, William Faulkner, or Virginia Woolf, Sell suggested.
鈥淵ou can use it [to] teach them about voice and what is it that makes this piece supposedly in the style of Hemingway? Where does [AI] fail to capture the [author鈥檚] voice?鈥� Sell said. 鈥淎nd as you鈥檙e having those kinds of discussions, then it opens up possibilities for students to think about 鈥極K, so what is my writer鈥檚 voice?鈥� Because, you know, they might have written these five-paragraph essays, but is that genuinely their voice?鈥�
Ghauntous agrees that could be a good way to use the tool productively. Still, AI鈥檚 ability to imitate individual writers鈥攊ncluding students鈥攃onvincingly is just another argument in favor of figuring out how to teach writing in a world where generative AI exists, she said.
鈥淚 definitely think it requires us as writing teachers to reexamine what we鈥檙e asking students to do and why we鈥檙e asking them to do it,鈥� Ghantous said. 鈥淚s what we鈥檙e asking them to produce the best way to determine that they have the skills that we think that they need to have?鈥�
Students will almost certainly need to know how to use AI as an effective writing partner in their future careers, Ghantous added.
鈥淚 don鈥檛 think AI is going to go away when they go to their jobs,鈥� she said. 鈥淭hey鈥檙e probably going to be expected to utilize it in some way after they leave high school or college. Maybe our focus shouldn鈥檛 be on trying to prevent them from using it but teaching them how to use it correctly and ethically.鈥�
