ChatGPT in higher education – opportunity or risk?

A recent systematic review, published in Computers & Education, examined the impact of ChatGPT on student learning. The meta-analysis covered 69 experimental studies from 2022 to 2024 and reveals both opportunities and challenges in integrating generative AI into higher education.

Opportunities: What does ChatGPT bring?

1. Improved performance: ChatGPT appears to improve academic performance, especially in language and social science subjects. Short interventions in physical classrooms show the strongest results. The researchers recommend adapting forms of assessment and placing more emphasis on authenticity and task complexity.
2. Motivation boost: Students show more motivation and engagement during learning activities with ChatGPT. Still, the question remains whether this effect lasts once the novelty wears off.
3. Higher-order thinking skills: Some students report that ChatGPT helps them with critical thinking and problem-solving. However, this conclusion is based mainly on self-reports. Objective measurements are needed to validate it further.
4. Reduced cognitive load: ChatGPT reduces mental effort on complex tasks by providing structure. However, this can lead to ‘cognitive offloading’: students rely too heavily on the AI and develop fewer argumentation skills. At the same time, it opens up room for new cognitive challenges.

Challenges: What should we look at critically?

1. Self-efficacy: The impact on students' self-confidence varies widely. Some feel empowered, while others actually become less sure of themselves through dependence on ChatGPT.
2. Long term unknown: Most studies were short, so the long-term effects on learning, motivation and thinking skills remain unclear.
3. Methodological limitations: A lack of consistent measurements and the absence of long-term analyses undermine the robustness of some findings.

Conclusion: No One-Size-Fits-All

This research underlines that the success of ChatGPT depends heavily on how it is used. Structured applications with clear goals in traditional learning environments deliver better results than free, unguided use.

Recommendations:

• Use ChatGPT as a complement to traditional learning methods, not as a replacement.
• Develop forms of assessment that reward authenticity and students' original contributions.
• Invest in teacher training to optimise the integration of AI into learning environments.

Want to know more? Visit our AI workshops page for practical support and to train AI literacy.

Source: Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2024). Does ChatGPT enhance student learning? Computers & Education. DOI: 10.1016/j.compedu.2024.105224