Frequent AI Use in Programming Class Tied to Lower Student Performance

Since its public release in 2022, ChatGPT has sparked a true artificial intelligence boom worldwide. The novel chatbot quickly attracted attention in education, industry, and science. At the same time, questions emerged about how the use of AI affects knowledge acquisition and skills development.

AI’s Influence on Computer Science Education

The rise of AI has had the most significant impact on computer science, where chatbots can write code snippets, identify and correct errors, and provide explanations. However, little research has been carried out on their actual effect on students' learning and performance.

Research Methodology

This question was the focus of researchers at the University of Tartu Institute of Computer Science, who studied the use of AI tools among students in an object-oriented programming course. A total of 231 students completed the questionnaire. They were asked how frequently they used AI tools and for what purposes. The data were analysed using descriptive statistics, and Spearman's rank correlation analysis was performed to examine the strength of the relationships.

Findings: Usage Patterns and Academic Impact

The results showed that students primarily used AI assistance for solving programming tasks, such as debugging code and understanding examples. However, only a small proportion (under 4%) reported using AI tools weekly, suggesting that while AI was frequently tried, it was not consistently used throughout the course. A surprising finding, however, was that more frequent use of chatbots correlated with lower academic results. The correlation was weak to moderate, and the authors note that one possible explanation is that students who struggled more with the material were also more likely to turn to AI for help. Nevertheless, the finding suggests that the unguided use of AI and over-reliance on it may, in fact, hinder learning.

The Role of AI as a Supportive Tool

According to Associate Professor Marina Lepp, the role of AI in the learning process should primarily be supportive. She emphasises that students need guidance to ensure they use AI tools as learning aids rather than shortcuts that risk slowing the development of critical skills. "AI must support learning, not replace it," Lepp notes.

Creative Use of AI by Students

The study also revealed that many students applied AI creatively – for instance, using it to translate code from Python into Java, which in turn supported learning a new language. Students also reported using AI to assist with debugging, to clarify assignment requirements, and as a private tutor for exploring new concepts.

Student Attitudes and Perceived Impact

Interestingly, despite concerns in the education sector about students bypassing course content, the majority of respondents did not feel that AI prevented them from learning the material or exploring multiple solutions. In fact, students who used AI more often reported less struggle with homework and increased motivation, even though their academic performance was lower on average.

Some students avoided AI altogether, citing reasons such as a preference for independent learning, satisfaction with course materials, and concerns about the long-term impact of relying on AI tools.

Implications and Recommendations

The work of the University of Tartu researchers provides valuable insights not only for computer science lecturers but also more broadly for professionals in the field of education, helping to shape strategies for integrating AI into teaching in a meaningful and effective way. The authors recommend that AI tools be embedded into course design in a structured manner to maximise their educational benefit while avoiding over-reliance.