A new study upends the idea that AI simplifies writing, showing instead that it raises the cognitive stakes for students.
Writing with AI can look deceptively simple. Effortless, even.
Type in a prompt and a polished paragraph appears in seconds. Tidy, confident, clean.
But that apparent ease is also deceiving, says Abram Anders, associate professor of English and a professor of innovation at Iowa State University.
“Writing with AI doesn’t take the work out of writing,” he says. “It changes it.”
In a new study in Computers and Composition, Anders and coauthor Emily Dux Speltz, an Iowa State alum and assistant professor in the humanities and communication department at Embry-Riddle Aeronautical University, suggest the biggest hurdle in teaching students to write with AI isn’t the technology—it’s the students’ assumptions about what writing is.
“Students often expect AI to function as a shortcut, but the truth is, AI-assisted writing demands more thought from students, not less,” says Anders, who also serves as associate director of the Student Innovation Center at Iowa State.
“As a tool, AI only handles the surface-level writing, and the real heavy lifting—idea formation, judgment, revision strategy, and quality control—remains with the student writer.”
To conduct the study, Anders and Dux Speltz designed an experimental “AI and Writing” course that followed 38 undergraduate students from 22 majors as they learned to collaborate with generative AI tools over the course of two semesters. The students completed structured assignments, reflected on their process, and documented how their thinking changed as they experimented with AI tools.
At the start of the course, Anders says students carried a variety of assumptions, including “better tools should require less effort” and “AI will do the work for me.” But reality quickly challenged those beliefs, he adds, with one student reflecting, “I had to learn how to think about my thinking.”
What also emerged, the researchers found, were three “threshold concepts”—or big ideas—that students need to understand before they can write effectively with AI.
The first? Writing with AI is experimental, and students must learn to try, test, and tinker.
“AI isn’t going to provide a ‘perfect’ answer or automatically spit out what you need,” Anders says. “It requires trial and error—trying, testing, revising, and trying again.”
The researchers say some students reported they initially treated AI like a search engine: enter a vague prompt, accept whatever comes back. But as the course progressed, they learned that effective prompting required planning, clarity, and rhetorical awareness—the same skills strong writers use without AI.
Which brings us to the second threshold concept: writing with AI still requires human expertise.
“AI writes in confident sentences, uses the right tone and sounds smart,” Anders says. “But that polish can trick students into trusting it, even when it’s wrong, shallow, or missing the point entirely.”
This potential pitfall is sometimes to referred as the “fluency trap,” Anders says.
However, once students learn to read AI content critically and question it, they begin to see that fluency is not the same as understanding.
“It’s crucial that students learn to interrogate what AI produces and not just edit it,” Anders says. “This means checking claims, refining logic, and ensuring the writing aligns with different expectations related to different disciplines—all work that requires human judgment.”
This also leads into the idea of ownership, which Anders and Dux Speltz address with a third threshold concept: writing with AI should ultimately augment human agency, not replace it.
“Students must recognize that while AI can generate text, it can’t generate purpose—only the writer can do that,” Anders says.
“Generative AI can’t decide what it’s arguing, what matters or why the writing exists. It’s a tool that requires human direction, judgement, and boundaries.”
The researchers describe this as a shift from “outsourcing work to orchestrating it.”
“After crossing the third threshold concept, students are using AI to explore possibilities, test ideas, and refine thinking rather than to avoid the cognitive load of writing,” Anders says.
As AI tools become more common in academic, professional, and everyday writing, Anders and Dux Speltz say students will not only need technical proficiency, but also a deeper understanding of how writing works.
“AI changes the workflow, but it doesn’t change the fact that writing is thinking,” Anders says. “Students still have to make decisions, set direction, and shape meaning.”
Students who moved through the thresholds as part of the “AI and Writing” course reported becoming more reflective, more critical, and more intentional about their choices, the researchers say, and instead of treating AI as a shortcut, they began using it to evaluate ideas, explore alternatives, and strengthen their arguments—a shift that mirrors the demands of real-world writing.
“When students learn to direct AI rather than depend on it, they become stronger writers, and that’s the skill that will matter long after the tools change,” Anders says.
Source: Iowa State University