Estimated reading time: 3 minutes
Devs who use AI are rated 9% less competent on average than their peers, a new study suggests. And the competency penalty is harsher for women.
AI use in coding fields is near-ubiquitous: 98% of respondents to LeadDevās AI Impact Report 2025 say they have either adopted or are exploring the use of AI tools, and 59% of them say AI has increased their productivity.
But that AI adoption comes at a cost among your peers, according to a new study published in Harvard Business Review. The experiment gave more than 1,000 engineers identical snippets of Python code to evaluate, and were told that it was either written by another engineer alone, or another engineer with AI assistance.
While the code didnāt differ, peopleās perception of its quality did depending on that context. Code purportedly written by engineers with the help of AI was rated 9% worse on average. When told the gender of the coder using AI assistance, engineers rated their colleagues using AI as 6% less competent if they were male, and 13% less competent if female. That number rose for male engineers who didnāt use AI assistance themselves, who rated female engineers who did as 26% less competent.
The researchers have dubbed this the AI competence penalty, where using tools designed to help are regularly viewed as a shortcut and evidence of a lack of competence by colleagues, especially if they are female.
The results arenāt āunreasonableā to Tamay Besiroglu, co-founder and CEO of Mechanize. āIf an engineer uses AI, thereās a greater risk they donāt fully understand the code and might miss basic issues,ā he says. āModels arenāt great yet, especially for large codebases or features where precision matters.ā
Besiroglu points out that he would rate a colleague or co-worker more highly if they produced an elegant proof for a maths problem themselves, rather than using Gemini 2.5 Pro or another AI model ā āsince almost anyone can do that,ā he says.
Your inbox, upgraded.
Receive weekly engineering insights to level up your leadership approach.
Inherent biases
āThe extra competence penalty for women who used AI is striking,ā says Amy Diehl, chief information officer at Wilson College, and author of Glass Walls. āIt is another case of women being perceived as ānever quite rightā. If women use AI, they are perceived to have lower competence. If they choose not to use AI, they are considered to not be competent.ā
One major issue with the research, identified by David Krueger, assistant professor in AI at the University of Montreal, is that the team behind it ā who did not respond to LeadDevās interview request ā see AI as an unvarnished good, thus are surprised by the results.
āIt’s interesting that they seem to assume adoption is good and not to consider legitimate reservations engineers may have had about using AI,ā says Krueger.Ā
There could be a number of different reasons why an engineer might not want to use AI. āMaybe the tool just isn’t actually that good; engineers may be worried about low-probability high-impact mistakes. They may be concerned that their skills will atrophy. They may anticipate that automation may threaten their livelihood or be pushed to a point where meaningful human oversight is lost,ā says Krueger.
More like this
Avoiding the AI competency penalty
Fixing the issue requires awareness of the problem, and deliberate thinking by managers.
The team behind the research put forward three proposals for those in charge to consider:
- Audit teams to understand where the competence penalty might hit the hardest, then actively encourage them to adopt the tools that they might otherwise not test for fear of being criticised.
- Improve AI adoption across your organisation. Those who were more likely to look down on people who used AI were those who werenāt using it. Knowing the tech, and having influencers within teams using it builds psychological safety for others.Ā
- Removing the label of āAI-assistedā. The code the researchers asked participants to evaluate didnāt change; perceptions did.Ā
āTo mitigate the competence penalty for women, use the āflip it to test itā approach,ā says Diehl. āAsk yourself, if a man provided the same work, how would it affect perceptions of his competence? For example, if John used AI to write his code, would you perceive his skills to be inadequate? And be sure to train everyone on the concept of the competence penalty and how to mitigate it.ā