This is both important and unsurprising. If you use AI to do something unfamiliar, you learn less and are not more productive. The weakest area was in finding bugs, exactly what is needed most. Their previous research showing large productivity gains was with people who were familiar with the task.
www.anthropic.com
How AI assistance impacts the formation of coding skills
Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.