The blocky charts. The ability to solve a hard test problem. The hidden game of Snake. My graphing calculator was a 7th grade miracle.
AI is this generation’s graphing calculator. With about 2 years’ of studies, we can draw some conclusions on its impact. A meta-analysis published in Nature showed a medium to large impact on students.
ChatGPT’s Select Impact on Higher-Order Thinking
| Condition/Scenario |
Effect Size1 |
Significance (p-value) |
| Overall Effect |
0.457 |
< 0.001 |
| Type of Course: STEM and related |
0.737 |
< 0.001 |
| Learning Model: Personalized learning |
0.718 |
< 0.001 |
| Learning Model: Mixed |
0.719 |
< 0.001 |
| Duration: 4-8 weeks |
0.654 |
< 0.001 |
| Role of ChatGPT: Intelligent tutor |
0.945 |
< 0.001 |
| Role of ChatGPT: Intelligent learning tool |
0.428 |
< 0.001 |
| Area of Application: Tutoring |
0.478 |
< 0.05 |
The higher the Effect Size, the greater the Effect. 0.3-0.5 is considered a medium sized effect. Above 0.5 is considered a large effect.