Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

ChatGPT Isn't as Good at Coding as We Thought

Aug 15, 2023 - pcmag.com
A study from Purdue University found that AI chatbot ChatGPT struggles with coding skills, with 52% of its answers containing inaccuracies and 77% being verbose. The study also found that 54% of the errors were due to the bot not understanding the question concept, emphasizing the need for fact-checking its answers. However, the bot has shown some proficiency in coding, with Google determining it would be hired for a level three engineering position based on its responses to coding interview questions.

Despite its coding shortcomings, ChatGPT is expected to disrupt 19% of professions in the US job market, potentially replacing human translators and interpreters, among other roles, according to a study by OpenAI. However, the study also noted that ChatGPT tends to make up answers, suggesting that human oversight will still be necessary to ensure the accuracy of its work.

Key takeaways:

  • A study from Purdue University found that 52% of ChatGPT’s answers contain inaccuracies and 77% are verbose.
  • 54% of the errors made by the chatbot seemed to come from it not understanding the concept of the question it was being asked.
  • Despite its shortcomings, ChatGPT has shown potential in coding, with Google determining it would be hired for a level three engineering position based on its answers to interview questions.
  • ChatGPT is expected to disrupt 19% of professions, potentially replacing human translators and interpreters, but its tendency to make up answers means human oversight is still necessary.
View Full Article

Comments (0)

Be the first to comment!