Comparison of homework and exam scores between students who use AI vs. those who don’t.

16 hours ago by cannedtuna to c/fuck_ai

The Generative AI Learning Penalty: Evidence from Chinese Secondary Education

Using 30 months of panel data on 26,811 Chinese students in grades 7-12, we study how generative AI affects homework productivity and learning. The data combine monthly closed-book exams, high-school and college entrance exams, and homework scores and completion time across nine subjects. We exploit staggered AI adoption in a difference-in-differences design. AI adoption raises homework scores by 18% and reduces completion time by 30%, but lowers monthly exam scores by 20% within six months. High-stakes entrance-exam scores fall by 18 and 24%, with the full penalty emerging only after about two years. The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys. The learning losses are concentrated among roughly 80% of AI users whose behavior is consistent with homework outsourcing, as indicated by exceptionally short homework completion time coupled with high homework scores. AI users who maintain similar homework completion time as non-AI users experience small learning losses.

load all comments
Lumidaub 26 points 15 hours ago

Wouldn't a bar graph be better for this sort of data? The line keeps suggesting change over time to me and it's making the whole thing hard to read, even with OP's note.

path: 0 25377667, hotness: undefined, score: 26, children: 3
TheYojimbo 8 points 15 hours ago

It got me confused too at first but once you think about it it makes a lot of sense : the gray line is mostly straight, efforts get rewarded, but the more they use AI in homework, the worst they do on exams, even worst than the worst of the no AI crowd

path: 0 25377667 25377967, hotness: undefined, score: 8, children: 0
fuck_ai
fuck_ai

@lemmy.world

login for more options
7994
4597
8702

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

go to feed...