ChatGPT Buzzwords Spill Into Everyday Speech, Study Finds

New research from Florida State University's Department of Modern Languages and Linguistics, Department of Computer Science, and Department of Mathematics is revealing notable evidence that AI buzzwords overused by chat-based large language models are no longer just suggested on screens—they're frequently showing up in how people actually speak.

The study

Their work, "Model Misalignment and Language Change: Traces of AI-Associated Language in Unscripted Spoken English," is the first peer-reviewed research to analyze whether the conversational human language system is changing in the wake of the widespread adoption of chat-based large language models, such as ChatGPT. It was accepted into the eighth Conference on AI, Ethics, and Society, hosted by the Association for the Advancement of AI and the Association for Computing Machinery, which will be held in October. The study will be published in EIES Proceedings as part of the conference.

"This research focuses on a central issue in the discourse surrounding AI and language: are these language changes happening because we're using a tool and repeating what it suggested or is language changing because AI is influencing the human language system?" said assistant professor of computational linguistics and principal investigator Tom Juzek. "By analyzing lexical trends before and after ChatGPT was released in 2022, we found a convergence between human word choices and LLM-associated patterns with AI buzzwords."

Evidence of language change

While rapid increases in the use of certain words—like Omicron—do occur, these increases are typically due to real-world events. Recent large-scale upticks in the use of words like "delve" and "intricate" in certain fields, especially education and academic writing, are attributed to the widespread introduction of LLMs with a chat function, like ChatGPT, that overuses those buzzwords.

"The changes we are seeing in spoken language are pretty remarkable, especially when compared to historical trends," Juzek said. "What stands out is the breadth of change: so many words are showing notable increases over a relatively short period. Given that these are all words typically overused by AI, it seems plausible to conjecture a link."

Words including "surpass," "boast," "meticulous," "strategically," and "garner" have also seen considerable increases in usage since the release of ChatGPT. While these words are often used in a formal or academic tone, which makes them less common in unscripted, spoken language, researchers found that nearly three-quarters of these target words showed increased usage, with some more than doubling in frequency.

Research methods and findings

The team, including Bryce Anderson, a rising senior majoring in computer science, and Riley Galpin, a rising junior double-majoring in computer science and pure mathematics, analyzed 22.1 million words from unscripted and spontaneous spoken language, including conversational podcasts on science and technology. Following the introduction of ChatGPT, researchers observed a notable increase in the use of AI-related buzzwords, but not their synonymous counterparts. For example, the AI buzzword "underscore" saw a considerable increase in usage while its synonym "accentuate" did not. FSU researchers said this shows that we're not just using AI; the language that AI uses is subtly seeping into how people talk.

"Language is the most powerful medium of communication that humanity has and understanding how AI will affect this medium is fundamentally important and timely," said Anderson, the paper's lead author. "My motivation to pursue this research stems from seeing AI push the limits of what's possible in major industries and realizing that this influence isn't just limited to tool usage—it can condition societal aspects, including how we use language."

Connections to previous research

This research builds upon the group's previous research into the impact of AI on the domain of written scientific English, which revealed large-scale structural changes that AI has had on scientific writing. Galpin presented the research on written language at the 38th International Florida AI Research Society Conference in May, and Anderson will join Juzek in presenting the team's new research on spoken language at the AIES Conference in October.

"Our research highlights many important ethical questions," Galpin said. "With the ability of LLMs to influence human language comes larger questions about how model biases and misalignment, or differences in behavior in LLMs, may begin to influence human behaviors."

Future directions

This research was conducted as part of FSU's Undergraduate Research Opportunity Program, which provides high-achieving undergraduates an opportunity to explore their research interests alongside a faculty member.

"I look forward to future research in this area," Juzek said. "While this is a critical development in understanding AI's role in language change, a big open question for future work is whether AI is amplifying conventional patterns of language change or directly driving them."

*Important notice: arXiv publishes preliminary scientific reports that are not peer-reviewed and, therefore, should not be regarded as definitive, used to guide development decisions, or treated as established information in the field of artificial intelligence research.