Delving into ChatGPT usage in academic writing through excess vocabulary
Jun 23, 2024 - news.bensbites.com
The article discusses the impact of large language models (LLMs) like ChatGPT on academic writing. It reveals that despite their limitations, such as potential inaccuracy, bias reinforcement, and misuse, LLMs have been widely used by scientists to assist their scholarly writing. The study analyzed vocabulary changes in 14 million PubMed abstracts from 2010-2024 and found that the introduction of LLMs led to a significant increase in the use of certain style words. The research suggests that at least 10% of 2024 abstracts were processed with LLMs, with variations across disciplines, countries, and journals.
The study concludes that the emergence of LLM-based writing assistants has had a profound impact on scientific literature, even surpassing the effect of major world events like the Covid pandemic. The influence of LLMs is particularly noticeable in some PubMed sub-corpora, where up to 30% of abstracts appear to have been processed with these models.
Key takeaways:
Large language models (LLMs) like ChatGPT are being used to assist in scholarly writing, despite their limitations.
An analysis of 14 million PubMed abstracts from 2010-2024 shows an abrupt increase in the frequency of certain style words due to the appearance of LLMs.
At least 10% of 2024 abstracts were processed with LLMs, with some PubMed sub-corpora showing usage as high as 30%.
The impact of LLM-based writing assistants on scientific literature has been significant, surpassing the effect of major world events such as the Covid pandemic.
