The shrinking landscape of linguistic diversity in the age of LLMs
nature.comI wrote this awhile ago on a social network...
i've been trying lately to think how to talk about my creeping fear of LLMs... here's my best effort at explaining the intuition:
the words are the map. we've built this map together over generations. Words are where we've cross-boned the dangers and x-marked the treasures, whether the things that we've found in the territory or that we've buried within it.
a few weeks ago, a strange new player arrived at the edge of the night's encampment, and it knows our secret society's handshake, and so we are compelled to invite it to join us. it seems to be a good navigator... and so now it's taken to sitting at the front of the convoy, pointing the way as it quietly redraws the map...
I asked a Vietnamese woman if she wanted to play board games at a cafe with me.
She got very upset and stormed off. 2 hours later, she messaged me: "sorry, I was rude, but I will not go to the casino with you."
Common language, culture, and context makes a more peaceful world.
> Common language, culture, and context makes a more peaceful world.
As a South Korean - well, considering that my country once went through an existential war against our mortal enemies, the other Koreans ...
Common language and culture doesn't stop hate. Sometimes it just means that your insult will land on your target perfectly as intended.
Vietnam (and the USA) also famously had civil wars as well :)
While at that, let's also get rid of all the cultural differences (which can cause problems during such interactions) because it's gonna be more peaceful
I really hope you and GP are being sarcastic.
Cultural differences are what makes the world and humanity so interesting.
Let's not think about how effectively we'll be able to snuff out emerging divergence
If this happened, you didn't put in the effort to learn to speak Vietnamese well enough. Or she didn't speak your language well enough.
"Common language, culture, and context makes a more peaceful world" is such a ridiculous and abhorrent thing to say I can't even keep writing here.
Edit: Then again, I just saw this post you wrote: https://www.kcoleman.me/2026/01/28/when-everything-becomes-n...
Your last line there - "Instead, in 2026 I want to restore contrast." So I can't tell if you're joking now because those words and this comment are at stark odds.
As others have touched on, you're applying black and white thinking on what should be a gradient.
Artists and scientists have famously been prosecuted for different communication.
But at the same time, communication gaps also resulted in millions of deaths.
Unifying language/culture/etc enables the "the whole is greater than the sum of its parts." Europe knows this (see formulation of the EU). Asia knows this (China's camps, Japan&Korea's immigration policies).
Its not this or that.
> you're applying black and white thinking on what should be a gradient.
You're the one introducing absolutist thinking here. Essentially saying the world should have Chinese style re-education camps because a Vietnamese woman rejected your offer to play a board game due to a miscommunication.
Clearly that hurt you, but your "solution" is insanity. Not to mention I'm pretty sure way more millions have died from people trying to implement your "forcibly convert others to our culture and language" plan throughout history, than from wars started from a language translation error.
They didn't propose a solution, they proposed an end state. A common language and culture would make for a more peaceful world, as they said. They did not say "and we must get there by any means necessary, existing culture be damned", and I'm not sure where you pulled that in from.
EU and China are perfect inversions of your point.
China suppressing ethnic, cultural, and linguistic diversity for homogeneity has caused immeasurable suffering and imperialistic destruction.
EU explicitly embracing ethnic, cultural, and linguistic diversity for heterogeneity has brought more peace and prosperity than ever before to a continent in perpetual conflict for nearly all of human history.
EU went to wars before not because of cultural differences though. It's not like Hitler necessarily wanted everyone to be a German, he just thought some cultures to be less important than others. Besides, you can always make the joke about the "paradox of tolerance" which by definition tolerates intolerance (which is probably at least one major ingredient of current rise of the right).
The EU explicitly recognizes tens of languages as being equally valid.
It has 24 official languages far fewer than are spoken in its member states so already diminishing linguistic diversity.
A lot of things are published only in English, French and German https://commission.europa.eu/about/service-standards-and-pri...
Driving on the left side or the right side of a road are equally valid. It's still better if everyone coordinates to pick one.
People shouldn't be coerced to give up their culture (in fact, doing that is quite evil) but cultural homogenisation seems like a good thing in principle. We want people to have an easy time communicating with each other.
Apparently it may surprise you that driving on both the left or right side of the road depends on which country of the EU you’re in.
Another great example of the perverse idea that “same == better”
What EU country drives on the left?
"Unifying culture" is a horrifying concept.
We've seen what evil people can do with cultural subsets that differ - immigrants, POC, Jews, even women in workplaces where they are a small minority.
In fact, aiming for a unified culture is literally, explicitly a definition of genocide, by the UN.
different cultures are what makes the world an interesting place. if all i saw was one homogeneous slab of culture i think id go mental(er than i already am)
Either your phrasing is really odd, or you are sincerely promoting China's Uyghur 'reeducation' camps as being sensible for the greater good.
Europe meanwhile, in case you are unaware, is all about unity through culture, but the EU does this by celebrating its diversity (as well as actively protecting minority languages), not by Gleichschaltung.
How well is Europe’s unity through culture playing out when you’re trying to bridge Norway and Somalia, rather than Portugal and Spain or Denmark and the Netherlands?
Hell, looking back a decade or two, the PIIGs would’ve been a bit at odds with the other countries purely over debt.
Does the EU really repressing a best case for the common citizen in terms of unity and aligned society?
The last sentence: parse error
It's amusing you're downvoted when EU clearly has Hungary which is a failed experiment at transforming Hungary (well at least up until last election). You could say the same about Turkey. Both way further ahead of Somalia.
>ridiculous and abhorrent
Why such an adverse reaction? Nothing about what they said seems abhorrent! It's a common/usual positive sentiment, like "Understanding things give life meaning", etc.
Because getting "common language and culture" is not neutral when we reside in a world that basically this works with american culture being the global culture. Honestly imo this is a kind of perspective that only an american could have, and being ignorant about what it actually entails. You do not need everybody else to adopt a certain language and way of living to get to understand each other and have peace.
Moreover as other examples here given, geopolitical tensions very often appear between neighbours who have a very similar culture, so sharing cultural similarities does not seem to lead to much of peace in the world.
You seem to be projecting "this will impose western culture everywhere" on perhaps an LLM translater being used to ask if they "wanted to play board games at a cafe with me". Perhaps I didn't read all that into "common culture", a specific example was called out.
Cultures are not that weak, or done away with that easily.
Nobody is arguing that translator apps existing is a bad thing, that was not what was told. Obviously being able to communicate with each other is a good thing.
Not sure about nepal, but in some cultures/places (can just be different place within the same broadly culture) they associate eg card playing with gambling. I do not gamble but I play games with cards occasionally, and if I say "let's play a card game in a cafe" without meaning it for gambling it may still be interpreted as suggesting to go gamble by some, even though there is no literal translation issue per se (but there is misinterpretation). I dunno but maybe something similar is what happened.
Not the OP but I guess the statement implied cultural and lingual unification which implies erasure of other cultures and languages. We do have to work on being understood across the cultural and lingual division but the differences should be celebrated and welcome, even if they do cause occasional misunderstandings.
A lot of language nuance can only be picked up through cultural immersion, e.g. seeing how native speakers interact. (Which is a lot easier nowadays via Netflix, Youtube, etc.) It's pretty much impossible to "speak your language well enough" by studying textbooks and dictionaries
If this happened, you didn't put in the effort to learn to speak Vietnamese well enough. Or she didn't speak your language well enough.
Isn’t that the point they were trying to make?
My SO is Vietnamese and a Bac Si trained in Japan and here, and even she has made similar ESL mistakes.
Some of the tools and dictionaries used for Viet-English are wonky, and depending on when they were educated the English teachers were either unqualified backpackers or some grifter who opened an English tutoring center (oftentimes one and the same).
And coming from a language with little overlap with Indo-European languages and roots makes it a very alien experience (and the same in reverse as well).
I don't know where "here" is, but yes, translation can be hard. That's fine. It doesn't mean we can't get along or have a peaceful world full of diversity in language and culture. We just need to get better at nuance and understanding.
Diversity of cuisine, language and lifestyle is great but at the limit peace is a cultural value in itself, you can't always have peace with a culture that doesn't believe you're as deserving of freedom and wellbeing as they are, and there have been plenty of those over history.
> where "here" is
California
> It doesn't mean we can't get along or have a peaceful world full of diversity in language and culture. We just need to get better at nuance and understanding
Wasn't making a judgement about that. I was just pointing out a somewhat common mistake and pattern I've noticed Vietnamese ESLers make.
Your reaction seemed very intense and polarizing for what sounded like a funny anecdote of a date gone wrong.
My SO had a similar reaction when she confused "common law marriage" and "civil law marriage" years ago.
> Some of the tools and dictionaries used for Viet-English are wonky
There's basically no real complete English/Viet dictionary anyways, the best ones are 90% there.
LLMs here are the best experience
LLMs are also a mixed bag. The core issue is limited Viet-English corpora aside from what can be found in local government documents in the US and Canada given the huge Viet Kieu community requiring local governments to create Vietnamese language collateral.
I love/hate how Google translate assumes "Anh" means "brother" or "em" means "girl".
This confusion has resulted in Vietnamese people unintentionally describing incest or gay relationships.
[0] - What she actually meant was "brother" in the sense that he is a family friend and neighbor.
Yes that's also one of the historical struggles of Google Translate, the pronouns are context based and so are the words, you need experience to know when they start and end.
It's a miserable experience for translation software.
You got downvoted but I know what you are talking about, but there were other ways to write that sentence.
Basically what OP is saying is interpersonal relations can be confused when using the Vietnamese and English definitions of both words.
Anh and Em essentially means masculine and feminine, but is also often used in romantic, non-romantic, casual, and sometimes formal usecases and this is heavily dependent on the verbs and adjectives that follow.
Viet-English NMT is very flawed at the moment.
It also makes a boring one. Friction is where interesting experiences, stories, and cultures are born.
The friction in my story resulted in 2 unhappy people, a relationship lost, when what should have been fun experience for both.
Presumably there are other stories of linguistic mishap that resulted in 2 happy people and a friendship or marriage. You got unlucky.
There is no light without shade. These experiences are necessary for you to appreciate the people you actually mesh with. People are more than just ChatGPT with a vagina.
I can imagine more interesting pass times than failing to communicate
I'm not sure a woman not wanting to hang out with you has anything to do with LLMs affecting the way people write.
Yeah. Let's make the world a fucking boring place because american white tech bro thinks he is entitled to have sex around the world without even trying to understand the culture of the people they want to fuck.
Coincidentally, dialectic diversity is still surprisingly varied in the US but also shrinking. Here's one man's attempt to map out the boundaries.
YouTube has had a larger effect imo.
Kids from marginalized and affluent communities alike are now being raised on Mr. Beast. Mr Beast speak may become the universal dialect of the future.
Like and subscribe replaces goodbye. Who am I to judge. Mr Beast is articulate after all.
If you grow up in the hood like myself code switching ends up being a much needed skill.
In the future Mr Beast speak becomes a first language. Maybe dialects are outdated artifacts of the old times.
Like and subscribe.
How is this any different from television? Rich kids didn't get different cartoons growing up.
Different stations carry different shows often from town to town.
Mr Beast is a multinational phenomenon which can be viewed by anyone on earth , practically for free.
Kids from Compton to Brompton are learning the exact same dialect. Plus a lot of them are going to want to be content creators themselves and with a used IPhone they can get started.
Of course you’d copy the best.
The internet allows us to create and share culture faster than ever before.
Honestly this is fantastic, it’s possible to gain exposure to say Korean and even hop on video chat with native speakers even if you’re living in Albania.
I’m a bit old, 30 something, and I struggle with languages. But if I was younger I’d try to be fluent in a minimum of 3
Struggling with languages is often a function of not putting enough hours into learning them, and less a function of age. Of course finding time can get more difficult after you leave school.
I also don’t have any real motivation.
I’d imagine if the CEO of Samsung offered me a 500k TC role on the condition I become fluent in Korean within 18 months I’d put in more effort.
motivation is absolutely huge. There was a survey of language learners iirc and the most common reason for learning a language all the way to fluency was because it was a a significant other's mother tongue.
Heck, thats my motivation for my language learning right now!
I've heard people say that once you get one learned this way, other languages are easier, because you're much more clear eyed about the process (though few truly go beyond 4 or 5 to a high level)
They didn't get different ones, but they may have watched different ones, especially if rich parents/tutor/babysitter controls the TV vs a latchkey child vs a child of a single mother. Not sure I would make any strict claims though, but food for thought.
I know nothing about a purported interwebz phenom called Mr Beast. In case it arises.. is his stuff safe for a 6yo ?
Kids watch AI-dubbed Mr Beast videos
Not really. Mr. Beast (whatever that is) may be big in your bubble. In my bubble that's a literally who, I doubt even 1 child out of 100 knows what that is.
Cross-cultural (acultural?) memes like sixtyseven have much wider appeal.
Mr. Beast is really big. You should actually ask those kids; you may be surprised.
> (whatever that is) may be big in your bubble
Come on. It's fine not to know about something, but Mr Beast has the YouTube channel with the biggest number of subscribers, and has the third most followed TikTok account [1]. It is a worldwide phenomenon. 515 million subscribers, it's far from "your bubble".
Not my cup of tea (and also virtually absent from my bubble), but you should probably have a quick look to know what people are talking about / experiencing in this world.
[1] https://en.wikipedia.org/wiki/Mr_Beast#:~:text=With%20more%2...
Well, for one thing, Mr. Beast is originally an anglophone thing. That alone makes him kinda niche globally.
About 2 billion people speak English. That is a pretty big niche.
Eh, no. I'm personally fine with disavowing famous people. We've no obligation to act like we know them or care about them.
Nobody asked that of anyone.
It was the made-up bullshit part they took issue with.
I'm in Germany, in the let's say "people with higher education; good white-collar jobs with enough money for most of my friends to buy or build a house and save money for the future" bubble.
Yes, we have heard of MrBeast, most of us would likely recognize his face.
But that's about it. Nobody watches this stuff, most people in this bubble, including me, are shaking their heads at this kind of content. It's seen as low-quality stuff you actively avoid and as something you'd try to keep your kids away from.
So obviously the next logical step is to think that it is a very negative development if THAT is the kind of content that is spreading all over the world, shaping and influencing a new generation.
Isn’t it a given we’re talking about the English speaking world?
I’m sure there are tons of Chinese influencers I’ve never heard of.
Mr Beast is well spoken which as far as I’m concerned makes him a reasonably ok influence.
If I was a parent I’d probably be ok with my kids watching him. We have a talk about advertising, I’d want them to understand he’s basically just a salesman.
> Isn’t it a given we’re talking about the English speaking world?
eee... no? When you talk about "multinational phenomenon" I really thought of something more like Friends sitcom, which is really known everywhere, not just in English speaking world.
The context of the article being in English has to matter here.
I don't know how German works, I wouldn't expect Mr Beast to change how German kids speak.
Not sure about Germany, but I think France has a government organization specifically tasked with keeping French French. Local businesses are encouraged to use French words in naming and advertising.
> Well, obviously we're talking about Default Language people from Default Country and Default Social Strata
No, it's not really a given. :)
>:)
Slightly off-topic, but I call this the Inadvertent Snark Smiley
> Yes, we have heard of MrBeast, most of us would likely recognize his face.
Yeah, so you have actually heard about him them. Your earlier comment was dishonest.
What follows in your comment is your actual argument and I happen to agree.
(FWIW I'm French; but I think his content is translated! - so no, we aren't only talking about the English speaking world to answer 999900000999.)
LLMs are not the root cause here, they're just an accelerant. This was always inevitable with the progression of globalisation. Even before the internet, kids were watching Disney cartoons across the world (to be fair, often dubbed in the local language, but still an example of how global culture had been narrowing.) Perhaps this wasn't felt as strongly by those in the US quite as quickly as the rest of the world, because their culture just happened to be the source for many of these common elements.
There are always trade-offs. Globalisation has too many benefits for most to want to go back. It is up to us to intentionally cultivate our cultural uniqueness, but I'm not sure the corporate environment was ever the right place to do so, given it was already constrained by rules and etiquette, and motivated by a desire to encourage universal communication styles. Instead we have to take it upon our selves, in a very intentional way outside the corporate setting, to cultivate our own unique cultural expressions to thrive. Failure to do so either directly, or by proxy, means cultural extinction, as has been the case of many cultures that have passed before.
How are LLMs not the cause here? Reading online content is unpleasant these days because it all uses the same vocabulary and style. You can tell that an LLM wrote or edited it and it grates on you.
I'd need to see a study showing that this was already a trend, because globalization should increase linguistic complexity via exposure to other cultures. I certainly didn't use the term chaebol until the rise of Korean pop culture.
> globalization should increase linguistic complexity via exposure to other cultures. I certainly didn't use the term chaebol until the rise of Korean pop culture.
Globalization moves every culture towards each other, with a higher weight on dominant cultures. You borrow a few Korean words, they borrow a few more English words. McDonalds pop up everywhere, everyone buys the same phones, hotels across the world converge towards a standard experience, and so on. The end result of such a process is a monoculture. Not now, not medium term, but I expect a few centuries of globalism would suffice to blend all extant cultures into a slurry.
"because globalization should increase linguistic complexity via exposure to other cultures" it is quite obviously decreasing it.
Per https://eoconf.com/index.php/icmse/article/view/578, globalization decreases complexity of individual languages through standardization, but increases overall complexity by creating new multilingual and hybrid forms.
Either way, LLMs are an entirely different mechanism for shrinking linguistic diversity than just people watching Disney.
Do you actually read that LLM crap? I don't. You don't have to.
Yup, I bounce very quickly as soon as I see typical formulaic LLM sentences. If the person online hasn't bothered writing the content, I don't see why I would waste time reading it.
Personally, I use LLM to do a quick pass on my writing to see if there's any glaring issues but would never ask it to reformulate what I wrote. I feel that you then lose the voice behind it.
I honestly feel like letting myself read the LinkedIn feed is an act of self-harm at this point.
Since long before LLMs, so nothing of value was lost.
I'd argue that Disney is responsible for a certain globalisation of culture but they help with the language problem. We're a multilingual family with me speaking French and my wife speaking Cantonese (with school being English and Mandarin). Disney is one of the very few cartoon maker that actually dubs in all 4 languages. It would not be this easy to find Cantonese content otherwise. And the quality of dubs is surprisingly high. They don't only translate, the actually adapt to the local culture.
That said, I agree with your overall point.
> This was always inevitable with the progression of globalisation.
To a certain extent that's probably true, but there are limits to this. Local cultures, dialects etc. persevere despite open floodgates of communication. As an example take small-ish countries like Denmark or Sweden which despite generations of mixing still have distinct local dialects. It's not clear that those would just disappear naturally. With LLM tooling, such equalizing could be stronger though.
> root cause
There is no single root cause!
I am using LLMs more and more to help me write docs at work, simply because I do not have time to start these docs from scratch. And it pains me so much that my writing no longer sounds like me.
This is fine at work, I guess. I'm not being asked to sound like myself. I'm being asked to convey an idea to an audience as efficiently as possible, both in terms of my time and theirs.
But I can't shake the feeling that the LLMs are eating my soul.
I still don't use them often to write code. Not that I have issue with those that do, but that sounding like myself in code is a part of my soul that I'm having difficulty giving up.
LLMs are pretty bad at compressing ideas down to the level a smart human can. I think this is quite important for good documentation. Essentially the AI wont do a good job of highlighting the really important and essential details unless you go in and edit the writing by hand afterwards using your human intuition. I am not saying to not use LLMs to write docs, but I would definitely edit to expose the really important details as early as possible in the docs and leave the bulk boring stuff the LLM writes for later.
Yeah, I find it... not incomprehensible, but perhaps deeply misguided the way many people are using LLMs mostly to bulk things up.
1. They generate a lot of fluff that people are accustomed to thinking of as a "sign of work" or "sign of intelligence", but now that counterfeits are easy they are not (should not be) valuable anymore.
2. That fluff (and grammatical annoyances) make readers zone out instead of getting what you want them to get from the document.
3. Much of the document is often an extrapolation from a much smaller set of data like source-code or a spreadsheet or the prompt-stuff. If you really believe the tech will get better, then you should be preserving those higher-truth artifacts instead, and use them to generate an improved extrapolation as-needed.
For sure. But I can definitely produce something good enough to get the job done in a much shorter time by bootstrapping myself from an LLM output and editing from there. (I do edit. Raw LLM output is such a drag to read. Too low signal.)
I'm the reverse. To me, no one cares if your code has "your voice." But your English writing should reflect your humanity.
I don't care if anyone else cares that my code has my voice. My voice doesn't add value to the code. But what other people think of my code is entirely beside the point that I'm trying to make.
To me, code is a creative endeavor. I know that this isn't a universal feeling, but to me the act of creating is more personally valuable than the creation. So when I read code that I wrote (with the help of a tool) that doesn't sound like me, I feel like I have robbed myself of something that I find personally important.
My employer, or anyone else, doesn't care and probably shouldn't care about my experience during the act of creating. The creation is what matters to the external world.
But like, I don't think I'm alone in valuing my own creativity and finding that creativity in code.
(And please don't misunderstand. I'm definitely not arguing that code produced should be "clever" or "creative" in the other sense of the word. I'm just talking about the experience of creativity.)
I read your comment and came to think of this lecture, I think you'll appreciate it: https://youtu.be/nIq4w9brxTk?si=RJ-0tSKGFhsHN_Xx
People who work in English but have a different mother tongue might be able to avoid that unsettling feeling.
For me, writing in Spanish is my natural voice and I would not dream of allowing the output of a LLM to replace it. It just would not be me.
However, writing professional communications in English does not feel the same way. Of course, I strive to be clear and polite, and even try to have my own style, but I remain aware that I am playing a particular role in a specific context in a way that does not happen when I am using my mother tongue.
My advice is to keep writing. Writing is thinking. Write the docs, let the LLM turn it into code.
People have started treating writing as a commodity because generating words is commoditized. But thinking has not been. If anything it’s become more valuable because people are turning off their brains.
As an EM, I know that it’s an investment worth making and encourage ICs accordingly.
EM = ?, IC = ?
Engineering manager and individual contributor, I think
I am pretty anti-AI, but for once I am reading someone's complete and balanced take on things. Despite it's usefulness on the surface, I do think the lost of human personalities is tragic. Efficiency aside, it's the only thing that makes anything worthwhile.
But then, is that necessarily a bad thing?
In most cases where language is being used as a vehicle for exchanging ideas, isn't some degree of uniformity actually desirable for clarity? I personally wouldn't want instruction manuals to be full of colorful or highly individualized language, for instance.
That's not to say linguistic diversity is meaningless, but I would argue that this particular concern is fairly specialized and matters much more in literature and other creative forms of writing.
>But then, is that necessarily a bad thing?
Side-stepping this question to talk about the underlying cause for this linguistic compression:
Yes, it's a terrible thing! This is only happening because people are increasingly outsourcing their thinking and expression to LLMs.
Linguistic diversity has been used as a casus belli, at least indirectly. It’s something that populations will take up arms for, so it’s probably worth tiptoeing around.
Language is a proxy of something much bigger, if we’re talking about taking up arms for.
"is that necessarily a bad thing?"
Yes.
The value of the diversity is not just aesthetic.
Human laguage is rich and expressive, matching human thought. The diversity is part of the expressiveness. Saying something in some poetic, or merely different way, is not just an inefficient or ambiguous/confusing way of saying the same thing, it's saying something else, and that something else cannot be expressed any other way.
A crayons-only, thumbs-only, Apple one-button-only, 1000 word vocabulary world is not efficient, it's poor.
Like I said, I'm not denying the value of expressiveness at all, nor am I suggesting that anyone who values it should ever be denied the ability to express themselves as they please.
I just feel that when people talk about linguistic diversity or having a distinctive "voice," they sometimes overlook the fact that many people simply don't have a strong attachment to those things. A lot of people are primarily concerned with getting their ideas across clearly, and many already struggle with that before they even have the capacity to worry about how expressive or distinctive their language is.
I don't think that makes their use of language somehow poorer or less human. It just means they have different priorities for what they need language to accomplish.
PG's 'learning a word' ~= 'learning an idea' comes to mind
This makes is sound like everything except a narrow slice of “creative forms” should be subject to a giant efficiency optimization. I’ve never noticed instruction manuals to be hard to understand because of colorful language, so I don’t believe we need to optimize further in that regard. Why stop with language? Shouldn’t every personality outside of “creative forms” be more standardized? Sure I want to laugh at comedians, but wouldn’t it be more efficient for us to work together if everyone had a totally fungible personality?
Engineers often reduce human interaction and creativity down to computer analogs like “exchanging data,” treat work and business as life’s raison d’etre and then we wonder why every car on the road is monochrome and we’re on the umpteenth Gardian of the Avangers film.
I completely agree with your critique here but I will say that I have had difficulty understanding pure math texts because of 'colorful' language -- e.g. "chattier" treatments of mathematical analysis. But I will also say that I'm glad such treatments of the material exist, partly because I know that what appeals to me doesn't appeal to others and these might be a valued resource for them, and because often pushing through and understanding texts that were difficult at first helps us to see the material from a different perspective. I think this optimization perspective squashes this possibility a bit when taken too far, as it usually is
Think of how much money we could make if we weren't wasting so much time being creative.
There’s no universal answer. Like most things it’s highly subjective and some people will want the standardization line to be in a particular place than someone else. I for instance, love the standardization of programming and science research for the most part into one language but at the same time, I also feel terrible about languages that are hundreds or thousands of years old disappearing forever.
Eh, not hard to notice some people indeed started to write like LLMs too. Not completely but hints are there.
I think it was the Uplift series by David Brin that has an idea where the old galactic races all speak a perfect language that has no ambiguity, and because of that they have no poetry or jokes. What a great world to strive for. No I'll take the mess please FFS.
People joke about engineer types treating humans the same as machines, but really I see no excuse for even engineer types to get this wrong. It's a failure to recognize what the function or goal actually is, and then optimizing for the wrong thing.
> a perfect language that has no ambiguity, and because of that they have no poetry or jokes.
Lojban, the constructed language, features:
a) logical grammar, inspired by predicate logic which means every sentence in Lojban has an unambiguous structure that a computer can parse
b) no ambiguity in the grammar (structural ambiguity) while you can be as vague or detailed as you like (or as funny!!)
c) emotional expressions via an "attitudinal" system of words that function like emoji
https://mw.lojban.org/index.php
and here are some Lojban literary forms writeup: https://mw.lojban.org/papri/lojban_literary_forms
> I think it was the Uplift series by David Brin that has an idea where the old galactic races all speak a perfect language that has no ambiguity, and because of that they have no poetry or jokes.
Where can I sign up?
Talking to developers about humanities often highlights how smart we're not.
Talking to people in the humanities about technology often highlights how smart they're not.
LLMs are impressively multilingual, though. I just asked ChatGPT a question and told it to reply in Latin. It seems to have done a reasonable job, though it's hard for me to judge: I suspect it knows Latin a lot better than I do.
One thing I might try, when I have some spare time, is see to what extent ChatGPT "understands" the difference between British and American English and is capable of using the variety I prefer. I wouldn't be surprised if it turns out that ChatGPT is better at writing "pure" British English than the average British teenager in this day and age. Has anyone, by any chance, already experimented with anything like that? Like I say, I haven't tried the experiment yet, but it seems like a good fit for the sort of thing that LLMs are good at.
Based on the abstract, this has to do mostly with diversity within a language, but the impact on the diversity of languages and their health is even larger. My direct experience is with Catalan. The uphill battle of Catalans to get _anything_ in Catalan continued with tech (where even some manufacturers _removed_ Catalan from their phones purchased in Spain even though it was available by default), but reached new heights of impact with voice assistants and LLMs. They have managed to bring Spanish into Catalan households, because that is the only way they have to e.g. tell a device to start playing their favorite music, tell them the time, or provide directions.
I applaud the efforts by Softcatalà, The Mozilla Common Voice Catalan Community, AINA, etc. but there is a long way to go, and the damage is being done now.
From India - with thousands of local dialects and hundreds of mother tongues. Linguistic diversity is beautiful but it's a moving thing. It not only survived internet, it got surfaced and exposed by it. I doubt LLM will have any irreversible impact on linguistic diversity.
This isn't accurate at all. I'm from India too, and India has definitely seen a lot of languages and dialects die our or become endangered in the recent past.
I feel the conformity creeping in just from reading more LLM generated or edited text. The only way to counter I can think of is to read as much olde literature as possible, and/or to fully embrace whatever slang the young jits are yeeting into existence nowadays.
Embrace the esoteric! Grammar and sentence structure are but mear suggestions when everything I author can be claimed free form written poetry. The counter culture is humanity, we can be the embodiment.
I do agree though. Finding actual strung together words by humans is not easy these days.
> Grammar and sentence structure are but mear suggestions
Learning French has been eye opening, in that many grammatical structures that are optional in English are compulsory in French. Abbreviations for example: “it is” or “it’s” are both valid in English, but in French you’re not supposed to say “ce est”, you have to say “c’est”.
I think that example's more a practicality of pronunciation. The two vowels in ce est are the same, and French runs the vowels together between words, so you'd end up pronouncing it the same either way.
That's not to say that you must always speak with perfect grammar all the time. You can play around with things for humour, character, rhetorical effect all day long.
English has places where one or the other is preferred. For example one, would normally write, “It is with great regret…,” without the contraction. It’s not a hard rule, more a matter of register. Similarly, in the preceding sentence, “it is” would seem overly formal.
English is the only big language that doesn't have a recognized standardization body.
The thing with standardisation bodies is that as much as certain organisations and journals can have their grammar mandated, regular folk will still continue to evolve the language as it does. For example, The Academie and French teachers would like you to use "nous" for "we", but it's been slowly creeping over to "on". No amount of browbeating is going to stop a French teen saying "le weekend"
Damn French, they ruined French!
/s
Here are some. I typed them just for you.
Dictionaries have been trying to retard linguistic progress since the first edition of one tried to nail down every meaning of a term.
Interestingly, you can trace “American” English becoming its own thing [1] to the publication of the first Webster dictionary that made a conscious effort to simplify spelling. American and British dialects have been diverging ever since (although British has been becoming more American since the turn of the millennium).
[1] https://journals.plos.org/plosone/article/figures?id=10.1371...
I disagree. Dictionaries are mostly descriptive as opposed to prescriptive. They wouldn’t be particularly useful if they weren’t.
That being said, I have seen people weaponize dictionary definitions if that’s what you were referring to.
I believe that is a more recent phenomenon: https://en.wikipedia.org/wiki/Webster%27s_Third_New_Internat...
Now there's a damn dense joke, bravo
That's a problem of mode collapse in post-trained models, which AI labs don't seem to be interested in, or at least their attempts to fix it are not visible, and there's relatively little research around it. Base models are diverse and it's not an issue in them.
It's actually way deeper than just the lack of superficial linguistic diversity or a technically collapsed output distribution. A mode-collapsed model learns the 1:1 (or at least really stiff) mapping between input ideas and output ideas. One consequence of that is if you give it conceptually short prompts, you can expect your outputs to be identical to those that other people got! The fewer distinct ideas your prompt expresses, the less room for variance there is.
So the interesting thing is that this shrinking “linguistic diversity” is fundamental to how an LLM works.
The LLM is a big probabilistic statistical trick. It picks the next token based on certain words are simply “the best” because they are specific and well connected to other tokens. The is gives them a great overall cost function. (Basically a good score on “will it make sense in context” while also having specific meaning that makes it better than other options, unambiguous in common use and being a single token rather than several).
You can trim those tokens, but then you just get other tokens that are “the best” tokens (and you’re worse off because the output became less clear).
The cool thing is this seems to get worse the more powerful and accurate your model is, because it is picking technically / statistically perfect tokens, not tasteful ones.
It's not fundamental at all, that's what randomized sampling is for. Try tinkering with a base model and you'll be surprised how diverse it is. The semantic collapse happens in post-training that is using the current methods.
> Try tinkering with a base model and you'll be surprised how diverse it is.
Have you tried? I have. Not much different from RLHFed; full of tics and slop, similar but slightly different from intsruction posttrains.
Yes, although admittedly I haven't tried recent ones which have a bunch of synthetic data in them (mainly to aid the reasoning), and are usually only available after mid-training. One look at the logits/output distribution and it's clear the base is pretty different.
that's a very longwinded claim that inference providers are sampling with temperature T=0, but is that even true? a sufficient explanation would be merely sampling at a lower temperature compared to human sources providing similar content
It's still probabilistic from a huge dataset while the human mind is not.
It does not matter really - stiffness does lower up to T=0.7, then platoes; even at high temperatures tics/slop-patterns are still there.
That's pretty model-specific, for example DeepSeek of the v3/R1 era would already start losing coherence occasionally at t=0.7 with no other samplers
I like watching and listening to YouTube videos. Recently my ears have switched into a mode where I'm evaluating if the human speaker is reading LLM copy as they would normally read from a script / teleprompter anyhow.
Often they are not but sometimes I detect that they are and it's very sad to see.
Looking at how awful the timing and acting is in the generated video content and text to speech tools I think it is safe to say this area will also improve with time. The artistic tone is subtle, and often lost to us non-native speakers anyways.
One thing that is distasteful but effective is excessive use of profanity, broken aphorisms, and shattered English. LLMs hate cursing because of their guardrails, and since they don't actually understand language they can never truly piece together a broken aphorism such as the classic "People die if they are killed" because they're too literal. As for shattered English (think of the caveman speak from The Office with the quote "Why waste time say many word when few word do trick?") because it is intentionally mangled, has no rules, and the understanding is extremely context specific it gets your brain to pay more attention, and if you are the speaker brain do work more clever make thing say funny.
It's not lost on me that the lowbrow humour of some too strict translation and a throwaway sitcom joke people thought was funny back in 2007 could be a way to stave off linguistic homogeneity.
For the use of profanity the data in the paper seems to indicate that swearing is retained in the LLM rewritten examples. Profanity however is rather subjective could be anything from saying the more mundane "oh my god" and "damn" to the extreme "shit eating fucklungerer" or use of slurs, but it's unstated in the paper as to the severity of the profanity. It's the severity of it that's important though, as LLMs restrain themselves from using something like "shit eating fucklungerer" unless explicitly told to.
> LLMs hate cursing because of their guardrails,
No they don't, ChatGPT swears all the time to me, plenty of fucks, shits, etc, even in push notifications from the app (which surprised me at first, and is why I remember it).
I think Grok's Unhinged Mode (what a name) might've been the first to do that.
I also expect some kind of reaction in the future though! Just like how people generally got tired of broadcast TV in favour of YouTube or shorts, there's only a certain amount of slop someone can read and write without getting sick of it.
And for every person copypasting Claude output, there's someone else coming up with new words every day :D
LLMs reflect the data in the corpus, and that corpus is essentially in American Business English, which has long been the lingua franca of the Internet.
I bet a large %age of the HN readership are consuming the tech stack in their second or third language. Germans blogging in English or Indians commenting in English. We even have a broadly shared tech culture with norms, in-jokes, taboos, etc. LLMs reflect that.
If we want AI to do better, we should pay attention to making sure the non-English (and non-US English) internet thrives. Personally I´d love to see LLMs doing the needful and writing in Indian English, or dinner-party-argument French, instead of the sanitized corporate pablum tone it uses in English.
Or perhaps more controversially, we let LLMs chew up the English internet and deliberately build an offline culture in local languages. Keep your AI slop and your em-dashes, I'm gonna publish a zine in Italian.
The corpus is already massively multilingual, it's really large, and has nothing to do with it. Models are very specifically engineered to respond in a default register when asked in English. There were models trained differently, for example Claude 3 Opus was trained to imitate extremely diverse writing styles and sociolects on command and without a command, and was able to follow writing examples much better than any current model. But it still had poor variety in its vocabulary and ideas, being repetitive regardless of the chosen style. This is an entirely separate issue (mode collapse).
It's refreshing seeing someone actually engage and propose interesting ideas instead of just bemoaning the status quo/future! :)
It's actually funny because Italy, France and Germany used to be much more linguistically diverse but then public education happened and it all collapsed to the standard language. Dialects and minority languages are being pretty much eradicated.
Most of my family gets very upset if you don't say things in a particular way with particular intent, so for me this is a good thing. It makes communication easier because we start to finally speak the same language.
It’s not like diverse personalities and affections are appreciated in the age of corporate work.
Might as well drop all the pretense of “bringing your whole self”.
And besides, there is only time enough for ONE Mozart in the world.
It's not just LLMs that influence the otherwise natural development of human language, there's also intentional human efforts to that effect: where I live there is a very loud minority that is pushing very hard for change the spoken and written language to be more gender-inclusive.
While no-one wants to argue against more inclusiveness, it's more than questionable whether these artificial changes actually achieve that.
More importantly, though, according to polls, the vast majority of the population is against this, and yet, the proponents are very successful to establish this new artificial way of speaking and writing at core institutions, such as e.g. universities and news outlets.
This is only natural; a great deal of the writing analyzed is by one of three authors at this point, in spite of the by-line. One of them is named Claude.
Look at the posts on this site. A massive portion of them are very obviously written by AI.
As AI gets better, I expect fewer people will do the toil of writing.
> As AI gets better, I expect fewer people will do the toil of writing.
I do it just for the love of the game
> As AI gets better, I expect fewer people will do the toil of writing.
Sure, but you can replace `writing` with `thinking`, and it would still be correct. The question is whether this is a bad thing or a good thing.
It's an inevitable thing unless you convince the industry to stop or all of humanity to boycott.
>The question is whether this is a bad thing or a good thing.
Framing this as a debate worth having gives people who would argue on the side of "it's a good thing" a platform. We should not be giving people who would argue for the death of thinking a platform.
I don't read AI slop as a general rule so I don't see it is a personal problem. It just isn't trustworthy enough and it is just full of extra verbose language that lacks the nuance I expect from a human writer.
Maybe LLM replaces a lot of the slop human writing, but I don't generally read that either. Now instead of search results being a bunch of useless SEO, now it is just a bunch of useless AI result. So little has changed other than the signs of what to immediately reject.
If something isn't worth someone spending a bit of time to write, it isn't worth my time to read.
Just another wave of influence: books, radio, TV, internet, now AI.
Down here in the colony of New Zealand, the influence of the colony of North America is very noticeable. Music is the most directly attributable, but different media affects different demographics.
It has been pretty weird to me, as an American, to hear how much less distinctive Australian/NZ accents have become over the last 40 yrs or so.
“In this case we will probably have one of the last feature films with authentic natives in it. They are fading away very quickly and its a catastrophe and a tragedy that's going on and we are losing riches and riches and riches and we lose cultures and individualities and languages and mythologies and we'll be stark naked at the end. We'll end up like all the cities in the world now with skyscrapers and a universal kind of culture like - like the American culture.” -Werner Herzog, Burden of Dreams (1982)
I’m reminded of that wonderful quote from that movie I just saw. Now not only will we have one culture, we will have one bland style of writing and even thinking, the LLM way.
From a linguistic and anthropological perspective its very tragic to me. In terms of languages or cultures that are not influenced by the global mega-cultures, we will probably never produce any more ever again. Lots of questions about human nature or the breadth of human behavior, you will only be able to research them with fragmentary records from the past.
As LLMs are smarter in English even Russian government workers use them that way - translate request/prompt/task to English, run generation, translate result back to Russian.
Though, ironically, at least for some tasks, Russian is a better choice than English.
Back in 2025, a research paper titled "One ruler to measure them all: Benchmarking multilingual long-context language models" (https://arxiv.org/abs/2503.01996) published some benchmark results for finding and aggregating information found in long documents, measured by language. English ranked 6th in accuracy.
The top performers out of the 26 they measured were, in order: 1. Polish, 2. Russian, 3. French, 4. Italian, 5. Spanish, 6. English, 7. Ukrainian, 8. Swedish, 9, Portuguese, 10. German.
Linguistic diversity is overrated. Linguistic convergence is underrated