Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Poor code quality due to AI assistants GitHub Copilot and ChatGPT

Jan 26, 2024 - blobstreaming.org
A study by GitClear, a Git analysis tool maker, suggests that the use of AI assistants like GitHub Copilot and ChatGPT is leading to a decrease in code quality and an increase in technical debt. The study, which analyzed 153 million lines of code on GitHub from 2020 to 2023, found that these AI assistants often suggest quick solutions that are not necessarily good or sustainable, leading to more repeated and bloated code, increased maintenance effort, and difficulty in interpretation for reviewers and subsequent users.

The study also found that churned code, or work that was corrected within two weeks, increased from 3.3% in 2020 to 5.5% in 2023, with a forecast of 7.1% for 2024. The proportion of developers using AI assistants also rose to 30% in 2023. The study suggests that the use of AI assistants is leading to more incorrect code being pushed into repositories and corrected later, negating the 55% efficiency gain promoted by GitHub. The study recommends the development of special cleaning tools to minimize this technical debt.

Key takeaways:

  • A study by GitClear suggests that the increasing use of AI assistants like GitHub Copilot and ChatGPT is leading to a decrease in code quality and an increase in technical debt.
  • The study analyzed 153 million lines of code and found that the use of these AI assistants often results in quick but not necessarily good and sustainable solutions, leading to code repetition and increased maintenance effort.
  • The proportion of churned code, or work that was corrected within two weeks, increased from 3.3 percent in 2020 to 5.5 percent in 2023, and is forecasted to reach 7.1 percent in 2024.
  • The study recommends the development of special cleaning tools to minimize this technical debt and questions whether there are any AI assistants trying to solve the problem.
View Full Article

Comments (0)

Be the first to comment!