The ed-tech world has been buzzing for months about ChatGPT, the powerful artificial intelligence tool that can respond to seemingly any prompt. Observers have speculated about how it might change the nature of teachers鈥� jobs and personalize education for students.
Now, some in ed tech are betting it can improve tutoring鈥攁 strategy that has boomed as schools struggle to help kids make up lost ground after months of disrupted learning.
In March, the online learning platform Khan Academy debuted a new AI chatbot鈥擪hanmigo鈥攄esigned to tutor and coach students in one-on-one interactions. Saga Education, a nonprofit that works with districts to design and implement tutoring programs, is starting to use AI to analyze tutors鈥� performance and offer feedback. And Varsity Tutors, a platform that provides private tutoring and also works with schools, is rolling out AI-generated lesson plans.
Developing and staffing the kind of tutoring that research has shown is most effective鈥攐ften referred to as high quality, or high-impact tutoring鈥攊s complex, time-consuming, and expensive. Tutors meet with students at least three times a week, in small groups or one-on-one. Work should be targeted to a specific subject and aligned to high-quality curriculum, and should develop strong tutor-tutee relationships.
鈥淗igh-impact tutoring is not homework help. They鈥檙e not sporadically dropping in,鈥� said Carly Robinson, a senior researcher at Stanford University鈥檚 Graduate School of Education who works with the National Student Support Accelerator, a group promoting research-based tutoring programs.
Experts say AI can take over some pieces of this puzzle, but there are potential pitfalls, too.
An AI-enabled tutoring program can give students immediate, personalized feedback, said Helen Crompton, an associate professor of instructional technology at Old Dominion University in Norfolk, Va. And the kinds of questions that students ask of the AI can offer teachers and tutors an insight into their thinking.
But there鈥檚 also the possibility that a virtual tutor could present students with incorrect information, or reinforce bias, Crompton said. And then, there鈥檚 one crucial element of good tutoring that experts agree an AI can鈥檛 replace: the student-tutor relationship.
鈥淎I is all brain and no heart,鈥� Crompton said. 鈥淭here鈥檚 a human aspect that should always be added in.鈥�
How tutoring companies are adapting
Since ChatGPT exploded on the scene at the end of 2022, educators have debated how the tool, which generates its answers based on taking in huge amounts of written text, could be used in education. Still, the tool is far from foolproof: It plagiarizes, often makes up information, and has trouble with certain tasks, like solving math problems.
For now, in education, 鈥渨e鈥檙e at the stage of the early adopters,鈥� said Rob Moore, an assistant professor of educational technology at the University of Florida. Some of these early adopters are tutoring companies.
The most well-known of these might be Khan Academy, which debuted its AI tutor chatbot early this year. Called Khanmigo, the the Spanish words conmigo (鈥渨ith me鈥�) and amigo (鈥渇riend鈥�). The tool combines the technology that powers ChatGPT with tutoring-specific instructions and relevant information from Khan Academy鈥檚 platform, said Kristen DiCerbo, the company鈥檚 chief learning officer.
鈥淚f you just go to ChatGPT, and type in something, that鈥檚 going to get you a different experience than what we do,鈥� she said.
Say, for example, that a student types 鈥淚鈥檓 stuck鈥� into the chatbot. 鈥淲e don鈥檛 just send, 鈥業鈥檓 stuck,鈥� to the model,鈥� DiCerbo said. Khanmigo also gets a short prompt about how to be a Socratic tutor, asking students questions to get to the root of their misunderstanding, rather than just giving them the answer.
It also has access to the Khan Academy site鈥攚hat course student is in, what unit the class is working on now, and the specific skills that the student has or hasn鈥檛 mastered. It uses all of that information to craft its response, DiCerbo said.
Khan Academy is now piloting Khanmigo in schools. Most teachers are using it in a classroom context to provide students with individualized support while a teacher is present, rather than in a separate designated tutoring block, DiCerbo said.
In Khan Academy鈥檚 model, the AI is the tutor: Students ask Khanmigo questions and the bot helps them work through the problem. Other companies are using the ChatGPT technology to support the processes around tutoring鈥攃reating lesson plans, writing session notes, and offering tutors feedback, but not actually as a tutor.
Varsity Tutors, which works with about 200 school districts, is rolling out AI-generated lesson plans, which will be designed to align to standards and reflect individual students鈥� learning progressions, in the 2023-24 school year, said Anthony Salcito, the chief institutional business officer at Nerdy, the parent company for Varsity Tutors.
Right now, Varsity Tutors is testing AI-produced session notes: feeding the tool transcripts of tutoring sessions and asking it to provide a summary. 鈥淭hat鈥檚 exciting, because it brings us consistency,鈥� Salcito said. 鈥淲e can consume all the notes and then track patterns over time.鈥�
Finally, Saga Education, a tutoring nonprofit that works with school districts, is using AI to give the tutors feedback. The organization has partnered with the University of Colorado Boulder, using AI technology developed by researchers there to analyze recordings of tutoring sessions, said Krista Marks, chief technology officer at Saga Education.
The AI has been trained on rubrics of effective tutoring, measuring recordings of the sessions against those markers and offering feedback. Tutoring site directors can then review feedback from multiple sessions, and use that to identify strengths and weaknesses for coaching sessions with the tutors.
AI is all brain and no heart. There鈥檚 a human aspect that should always be added in.
The tool can offer site directors a way to personalize coaching conversations with their staff, without having to spend all day sitting in on different tutoring sessions, Marks said.
Marks, Salcito, and DiCerbo said that the next frontier is more personalization.
Next year, Saga Education will pilot technology that offers tutors real-time recommendations about the next steps to take in a tutoring session, adapting suggestions to individual student interests鈥攐ffering a two-step equation math problem about basketball, for example.
Khan Academy is hoping to tailor Khanmigo鈥檚 assistance more closely to student needs. Right now, DiCerbo said, the AI knows where kids are in a unit and their past performance. But it doesn鈥檛 know exactly why students are struggling, or how to pinpoint and address prerequisite skills that they need but might not have mastered.
鈥淚t鈥檚 not about, I need to just keep banging my head against the wall on this grade level thing,鈥� DiCerbo said. 鈥淚 need to fill in these gaps on things I haven鈥檛 learned yet.鈥�
For now, Khanmigo can鈥檛 do that, DiCerbo said: 鈥淚t鈥檚 shaky at best.鈥�
When AI gets the answers wrong
There are other, more immediate issues with AI tutoring technologies, too. Khanmigo, for example, struggles with math鈥攁 problem ChatGPT has as well.
鈥淚f you just ask it to do the problem, it usually does it correctly,鈥� DiCerbo said. Sometimes, though, it gets the wrong answer. And it has difficulty with math conversations, where it has to discuss problem-solving steps and strategies with students.
Khan Academy offers teachers and students an option to give feedback and flag interactions where the AI gives the wrong information. Khanmigo also asks kids to explain their reasoning when its answer doesn鈥檛 match a student鈥檚, DiCerbo said. 鈥淚t allows the model to check its own work and work through that,鈥� she said.
Pointing out these flaws to students can help them understand that AI isn鈥檛 infallible, said Moore, of the University of Florida. 鈥淵ou can flip that and make that a teaching moment.鈥�
Still, errors could introduce new challenges in tutoring, where a student is already struggling鈥攁nd might not have a good enough grasp on the material to recognize an AI鈥檚 misstep.
Not every student is going to be well-served by an AI tutor, said Robinson, the Stanford researcher. Beyond these technical limitations, there鈥檚 also a big question of motivation. Would the students who are in most need of support actually use the tool as intended?
When districts have provided on-demand optional programs in recent years, most students don鈥檛 actively engage with them, she said. The kids that do take advantage of them are more likely to be higher-achieving students鈥攏ot typically the demographic that schools were most hoping to reach, she added.
鈥淒elivering a scripted curriculum that can be responsive to students鈥� answers is something that AI could take on. Where we might actually need a human is where it comes to the relationships and the motivation and the engagement aspects of tutoring,鈥� Robinson said.
All of the company representatives said that AI is meant to complement teachers and tutors鈥攏ot replace them. 鈥淚f we do not have teachers, tutors, caring adults to guide students in how to ask good questions 鈥� I think we鈥檙e lost,鈥� said Marks, of Saga Education.
鈥榃e haven鈥檛 even scratched the surface鈥� on ethics
In in action that Khan Academy has shared, the bot is encouraging鈥攇ently prompting students to persevere and praising them when they get the right answer.
These cheery interactions with students are part of the programming, Crompton said. 鈥淚t doesn鈥檛 actually have a personal relationship with students. It doesn鈥檛 actually have that investment in how a student is doing.鈥�
And that鈥檚 a concern for some researchers: How an AI acts is based on the source material and instructions it鈥檚 given鈥攁 fact that introduces 鈥渁 lot of ethical concerns that we haven鈥檛 even scratched the surface on,鈥� said Robinson.
AI tools can be designed to have a positive and helpful attitude, 鈥渂ut they could just as easily be designed to bully,鈥� Robinson said.
Crompton fears the possibility for bias. The technology that powers ChatGPT pulls information from the internet, so it鈥檚 going to reflect dominant perspectives and ideas in published materials, she said. Take social studies as an example, a discipline whose subjectivity has led repeatedly to fierce debates over the years over which narratives should be taught.
鈥淭hose textbooks, those notes, all those have bias in them. So we are still going to have a biased product in the end,鈥� she said.
These fallibilities mean that districts need to carefully vet AI tutoring tools, the same way they would vet other materials and programs that they bring into schools, Crompton said.
鈥淲e鈥檒l need to do our due diligence and recognize that there will be a lot out there provided,鈥� she said. 鈥淎nd some AI programs will be good, and some won鈥檛 be as good.鈥�
