The TikTok ban and Donald Trump's rise to power show how fragile our social media accounts are. We must normalize and invest in decentralized social media.
A few have registration requirements, but it’s usually something banal like “say I agree in Spanish to prove your Spanish enough for this instance” etc.
This is a choice any instance can make if they want, none are but that doesn’t mean they can’t or it doesn’t work.
Doesn’t matter if they’re shit or not, they don’t want bots crawling their sites, straining their resources, or constantly shit posting, but they do anyway. And if the billion dollar corporations can’t stop them, it’s probably a good bet that you can’t either.
@a1studmuffin@ceenote the only reason these massive Web 2.0 platforms achieved such dominance is because they got huge before governments understood what was happening and then claimed they were too big to follow basic publishing law or properly vet content/posters. So those laws were changed to give them their own special carve-outs. We’re not mentally equipped for social networks this huge.
I disagree, I think we’re built for social networks that huge. The problems happen when money comes into the equation. If we lived in a world without price tags, and resources went where they needed to go instead of to who has the most money, and we were free to experiment with new lifestyles and ideas, we would thrive with a huge and diverse social network. Money is like a religious mind-virus that triggers psycopathy and narcissism in human beings by design, yet we believe in it like it’s a force of nature like God or something. A new enlightenment is happening all thanks to huge social networks allowing us to express our nature, it’s the institutions of control that aren’t equipped to handle such breakdown of social barriers (like the printing press protestant revolution, or the indigenous critiques before the enlightenment period)
Could do something like discord. Rather than communities, you have “micro instances” existing on top of the larger instance, and communities existing within the micro instances. And of course make it so that making micro instances are easier to create.
We have a human vetted application process too and that’s why there’s rarely any bots or spam accounts originating from our instance. I imagine it’s a similar situation for programming.dev. It’s just not worth the tradeoff to have completely open signups imo. The last thing lemmy needs is a massive influx of Meta users from threads, facebook or instagram, or from shitter. Slow, organic growth is completely fine when you don’t have shareholders and investors to answer to.
Techy people are a lot more likely to jump through a couple of hoops for something better, compared to your average Joe who isn’t even aware of the problem
Techy people are a lot more likely to jump through hoops because that knowledge/experience makes it easier for them, they understand it’s worthwhile or because it’s fun.
If software can be made easier for non-techy people and there’s no downsides then of course that aught to be done.
I know people don’t want to hear it but can we expect non-techies to meet techies half way by leveling their tech skill tree?
In order to charge her iphone, my mom first turns on airplane mode, and THEN she powers it down. Turns it off completely. I asked why she does any of that. She says “Because they won’t flip the charge switch for me until they do! I wish I could take the battery out first, and THEN turn off the phone. But I suppose if they can’t see my battery with airplane mode on first, this is just as good.”
10th largest instance being like 10k users… we’re talking about the need for a solution to help pull the literal billions of users from mainstream social media
There isn’t a solution. People don’t want to pay for something that costs huge resources. So their attention becoming the product that’s sold is inevitable. They also want to doomscroll slop; it’s mindless and mildly entertaining. The same way tabloid newspapers were massively popular before the internet and gossip mags exist despite being utter horseshite. It’s what people want. Truly fighting it would requires huge benevolent resources, a group willing to finance a manipulative and compelling experience and then not exploit it for ad dollars, push educational things instead or something. Facebook, twitter etc are enshitified but they still cost huge amounts to run. And for all their faults at least they’re a single point where illegal material can be tackled. There isn’t a proper corollary for this in decentralised solutions once things scale up. It’s better that free, decentralised services stay small so they can stay under the radar of bots and bad actors. When things do get bigger then gated communities probably are the way to go. Perhaps until there’s a social media not-for-profit that’s trusted to manage identity, that people don’t mind contributing costs to. But that’s a huge undertaking. One day hopefully…
They also want to doomscroll slop; it’s mindless and mildly entertaining. The same way tabloid newspapers were massively popular before the internet and gossip mags exist despite being utter horseshite. It’s what people want.
The same analogy is applicable to food.
People want to eat fastfood because it’s tasty, easily available and cheap. Healthy food is hard to come by, needs time to prepare and might not always be tasty. We have the concepts of nutrition taught at school and people still want to eat fast-food.
We have to do the same thing about social/internet literacy at school and I’m not sure whether that will be enough.
We’re talking about the need for a system to deal with major access of a main facebook/insta/twitter etc… to a majority of people.
IE of the scale that someone can go “Hey I bet my aunt that I haven’t talked to in 15 years might be on here, let me check”. Not a common occourance in a closed off discord community.
Also, noting that doesn’t fully solve the primary problem… of still being at the whims and controls of a single point of failure. of which if Discord Inc could at any point in time decide to spy on closed rooms, censor any content they dislike etc…
I question if we really need spaces like that anymore. But I see where you are coming from.
I was definitely only thinking about social places like Lemmy and Discord. Not networking places like Facebook and LinkedIn.
It really feels like there are zero solutions available. I’m at a point where I realize that all social networks have major negative impacts on society. And I can’t imagine anything fixing it that isn’t going back to smaller, local, and private. Maybe we don’t need places where you can expect everyone to be there.
When we can expect everyone on the planet to be present in a network the conflict and vitrol would be perpetual. We are not mature enough and all on the same page enough as a species to not resort to mud slinging
Problem with tech oligarchy is it just takes one person to get corrupted and then he blocks out all opinion that attacks his goals.
So the solution is federation, free speech instances that everyone can say whatever they want no matter how unpopular.
How do we counteract the bots…
Well we need the instances to verify who gets in, and make sure the members aren’t bots or saying unpopular things. These instances will need to be big, and well funded.
How do we counter these instance owners getting bought out, corrupted (repeat loop).
No? The problem of tech oligarchy is that they control the systems. Here anyone can start up a new instance at the press of a button. That is the solution, not allowing unfiltered freeze peach garbage.
Small “local” human sized groups are the only way we ensure the humanity of a group. These groups can vouch for each-other just as we do with Fediseer.
One big gatekeeper is not the answer and is exactly the problem we want to get away from.
You counter them by moving to a different instance.
Concept is however that if a new instance is detatched from the old one… then it’s basically the same story of leaving myspace for facebook etc… we go through the long vetting process etc… over and over again, userbase fragments reaching critical mass is a challange every time. I mean yeah if we start with a circle of 10 trusted networks. One goes wrong it defederates, people migrate to one of the 9 or a new one gets brought into the circle. but actual vetting is a difficult process to go with, and makes growing very difficult.
There might be clever ways of doing this: Having volunteers help with the vetting process, allowing a certain number of members per day + a queue and then vetting them along the way…
I feel like it’s only a matter of time before most people just have AI’s write their posts.
The rest of us with brains, that don’t post our status as if the entire world cares, will likely be here, or some place similar… Screaming into the wind.
We could ask for anonymous digital certificates. It works this way.
Many countries already emit digital certificates for it’s citizens. Only one certificate by id. Then anonymous certificates could be made. The anonymous certificate contains enough information to be verificable as valid but not enough to identify the user. Websites could ask for an anonymous certificate for register/login. With the certificate they would validate that it’s an human being while keeping that human being anonymous. The only leaked data would probably be the country of origin as these certificates tend to be authentificated by a national AC.
The only problem I see in this is international adoption outside fully developed countries: many countries not being able to provide this for their citizens, having lower security standards so fraudulent certificates could be made, or a big enough poor population that would gladly sell their certificate for bot farms.
Your last sentence highlights the problem. I can have a bot that posts for me. Also, if an authority is in charge of issuing the certificates then they have an incentive to create some fake ones.
Bots are vastly more useful as the ratio of bots to humans drops.
Also the problem of relying on a nation state to allow these certificates to be issued in the first place. A repressive regime could simply refuse to give its citizens a certificate, which would effectively block them from access to a platform that required them.
Data scraping is a logical consequence of being an open protocol, and as such I don’t think it’s worth investing much time in resisting it so long as it’s not impacting instance health. At least while the user experience and basic federation issues are still extant.
We also need a solution to fucking despot mods and admins deleting comments and posts left-and-right because it doesn’t align with their personal views.
I’ve seen it happen to me personally across multiple Lemmy domains (I’m a moron and don’t care much to have empathy in my writing, and it sets these limp-wrist morbidly obese mods/admins to delete my shit and ban me), and it happens to many people as well.
Freedom of expression does not mean freedom from consequences. As someone who loves to engage on trolling for a laugh online I can tell you that if you get banned for being an asshole you deserve it. I know I have.
Instances that don’t vet users sufficiently get defederated for spam. Users then leave for instances that don’t get blocked. If instances are too heavy handed in their moderation then users leave those instances for more open ones and the market of the fediverse will balance itself out to what the users want.
The sad truth is that when Reddit blocked 3rd party apps, and the mods revolted, Reddit was able to drive away the most nerdy users and the disloyal moderators. And this made Reddit a more mainstream place that even my sister and her friends know about now.
There are simple tests to out LLMs, mostly things that will trip up the tokenizers or sampling algorithms (with character counting being the most famous example). I know people hate captchas, but it’s a small price to pay.
Also, while no one really wants to hear this, locally hosted “automod” LLMs could help seek out spam too. Or maybe even a Kobold Hoard type “swarm.”
Captchas don’t do shit and have actually been training for computer vision for probably over a decade at this point.
Also: Any “simple test” is fixed in the next version. It is similar to how people still insist “AI can’t do feet” (much like rob liefeld). That was fixed pretty quick it is just that much of the freeware out there is using very outdated models.
Decentralized authentication system that support pseudonymous handles. The authentication system would have optional verification levels.
So I wouldn’t know who you are but I would know that you have verified against some form of id.
The next step would then by attributes one of which is your real name but also country of birth, race, gender, and other non-mutable attributes that can be used but not polled.
So I could post that I am Bob living in Arizona and I was born in Nepal and those would be tagged as verified, but someone couldn’t reverse that and request if I want to post without revealing those bits of data.
I mentioned this in another comment, but we need to somehow move away from free form text. So here’s a super flawed makes-you-think idea to start the conversation:
Suppose you had an alternative kind of Lemmy instance where every post has to include both the post like normal and a “Simple English” summary of your own post. (Like, using only the “ten hundred most common words” Simple English) If your summary doesn’t match your text, that’s bannable. (It’s a hypothetical, just go with me on this.)
Now you have simple text you can search against, use automated moderation tools on, and run scripts against. If there’s a debate, code can follow the conversation and intervene if someone is being dishonest. If lots of users are saying the same thing, their statements can be merged to avoid duplicate effort. If someone is breaking the rules, rule enforcement can be automated.
Ok so obviously this idea as written can never work. (Though I love the idea of brand new users only being allowed to post in Simple English until they are allow-listed, to avoid spam, but that’s a different thing.) But the essence and meaning of a post can be represented in some way. Analyze things automatically with an LLM, make people diagram their sentences like English class, I don’t know.
I think I communicated part of this badly. My intent was to address “what is this speech?” classification, to make moderation scale better. I might have misunderstood you but I think you’re talking about a “who is speaking?” problem. That would be solved by something different.
It sounds like you’re describing doublespeak from 1984.
Simplifying language removes nuance. If you make moderation decisions based on the simple English vs. what the person is actually saying, then you’re policing the simple English more than the nuanced take.
I’ve got a knee-jerk reaction against simplifying language past the point of clarity, and especially automated tools trying to understand it.
A simple thing that may help a lot is for all new accounts to be flagged as bots, requiring opt out of the status for normal users. It’s a small thing, but any barrier is one more step a bot farm has to overcome.
Agreed. But we need a solution against bots just as much. There’s no way the majority of comments in the near future won’t just be LLMs.
Closed instances with vetted members, there’s no other way.
If you could vet members in any meaningful way, they’d be doing it already.
It could be cool to get a blue check mark for hosting your own domain (excluding the free domains)
It would be more expensive than bot armies are willing to deal with.
Most instances are open wide to the public.
A few have registration requirements, but it’s usually something banal like “say I agree in Spanish to prove your Spanish enough for this instance” etc.
This is a choice any instance can make if they want, none are but that doesn’t mean they can’t or it doesn’t work.
I was referring to some of the larger players in the space, ie Meta, Twitter, etc.
Right, but they’re shit and don’t good things out of principle.
We, the Fediverse, are the alternative to them.
Doesn’t matter if they’re shit or not, they don’t want bots crawling their sites, straining their resources, or constantly shit posting, but they do anyway. And if the billion dollar corporations can’t stop them, it’s probably a good bet that you can’t either.
Because they want user data over anything.
We want quality communities over anything.
We can be selective, they go bankrupt without consistent growth.
Okay, but the bots work for other people…
Too high of a barrier to entry is doomed to fail.
It’s how most large forums ran back in the day and it worked great. Quality over quantity.
@a1studmuffin @ceenote the only reason these massive Web 2.0 platforms achieved such dominance is because they got huge before governments understood what was happening and then claimed they were too big to follow basic publishing law or properly vet content/posters. So those laws were changed to give them their own special carve-outs. We’re not mentally equipped for social networks this huge.
I disagree, I think we’re built for social networks that huge. The problems happen when money comes into the equation. If we lived in a world without price tags, and resources went where they needed to go instead of to who has the most money, and we were free to experiment with new lifestyles and ideas, we would thrive with a huge and diverse social network. Money is like a religious mind-virus that triggers psycopathy and narcissism in human beings by design, yet we believe in it like it’s a force of nature like God or something. A new enlightenment is happening all thanks to huge social networks allowing us to express our nature, it’s the institutions of control that aren’t equipped to handle such breakdown of social barriers (like the printing press protestant revolution, or the indigenous critiques before the enlightenment period)
Could do something like discord. Rather than communities, you have “micro instances” existing on top of the larger instance, and communities existing within the micro instances. And of course make it so that making micro instances are easier to create.
Programming.dev does this and is the tenth largest instance.
We have a human vetted application process too and that’s why there’s rarely any bots or spam accounts originating from our instance. I imagine it’s a similar situation for programming.dev. It’s just not worth the tradeoff to have completely open signups imo. The last thing lemmy needs is a massive influx of Meta users from threads, facebook or instagram, or from shitter. Slow, organic growth is completely fine when you don’t have shareholders and investors to answer to.
Techy people are a lot more likely to jump through a couple of hoops for something better, compared to your average Joe who isn’t even aware of the problem
I started using Twitter in 2009. It was just techy people back then. Things are allowed to take time and grow organically.
Techy people are a lot more likely to jump through hoops because that knowledge/experience makes it easier for them, they understand it’s worthwhile or because it’s fun. If software can be made easier for non-techy people and there’s no downsides then of course that aught to be done.
Ok, now tell the linux people this.
It’s not always obvious or easy to make what non-techies will find easy. Changes could unintentionally make the experience worse for long-time users.
I know people don’t want to hear it but can we expect non-techies to meet techies half way by leveling their tech skill tree a bit?
In order to charge her iphone, my mom first turns on airplane mode, and THEN she powers it down. Turns it off completely. I asked why she does any of that. She says “Because they won’t flip the charge switch for me until they do! I wish I could take the battery out first, and THEN turn off the phone. But I suppose if they can’t see my battery with airplane mode on first, this is just as good.”
And you want this woman to learn terminal?
Yeah that was kinda my point
10th largest instance being like 10k users… we’re talking about the need for a solution to help pull the literal billions of users from mainstream social media
There isn’t a solution. People don’t want to pay for something that costs huge resources. So their attention becoming the product that’s sold is inevitable. They also want to doomscroll slop; it’s mindless and mildly entertaining. The same way tabloid newspapers were massively popular before the internet and gossip mags exist despite being utter horseshite. It’s what people want. Truly fighting it would requires huge benevolent resources, a group willing to finance a manipulative and compelling experience and then not exploit it for ad dollars, push educational things instead or something. Facebook, twitter etc are enshitified but they still cost huge amounts to run. And for all their faults at least they’re a single point where illegal material can be tackled. There isn’t a proper corollary for this in decentralised solutions once things scale up. It’s better that free, decentralised services stay small so they can stay under the radar of bots and bad actors. When things do get bigger then gated communities probably are the way to go. Perhaps until there’s a social media not-for-profit that’s trusted to manage identity, that people don’t mind contributing costs to. But that’s a huge undertaking. One day hopefully…
The same analogy is applicable to food.
People want to eat fastfood because it’s tasty, easily available and cheap. Healthy food is hard to come by, needs time to prepare and might not always be tasty. We have the concepts of nutrition taught at school and people still want to eat fast-food. We have to do the same thing about social/internet literacy at school and I’m not sure whether that will be enough.
I dunno man. Discord has thousands of closed servers that are doing great.
We’re talking about the need for a system to deal with major access of a main facebook/insta/twitter etc… to a majority of people.
IE of the scale that someone can go “Hey I bet my aunt that I haven’t talked to in 15 years might be on here, let me check”. Not a common occourance in a closed off discord community.
Also, noting that doesn’t fully solve the primary problem… of still being at the whims and controls of a single point of failure. of which if Discord Inc could at any point in time decide to spy on closed rooms, censor any content they dislike etc…
I question if we really need spaces like that anymore. But I see where you are coming from.
I was definitely only thinking about social places like Lemmy and Discord. Not networking places like Facebook and LinkedIn.
It really feels like there are zero solutions available. I’m at a point where I realize that all social networks have major negative impacts on society. And I can’t imagine anything fixing it that isn’t going back to smaller, local, and private. Maybe we don’t need places where you can expect everyone to be there.
When we can expect everyone on the planet to be present in a network the conflict and vitrol would be perpetual. We are not mature enough and all on the same page enough as a species to not resort to mud slinging
If we’re talking about breaking tech oligarchs hold on social media, no closed server anywhere comes close as a replacement to meta or Twitter.
Vetted members could still bot though or have ther accounts compromised. Not a realistic solution.
Isn’t that basically the same result though…
Problem with tech oligarchy is it just takes one person to get corrupted and then he blocks out all opinion that attacks his goals.
So the solution is federation, free speech instances that everyone can say whatever they want no matter how unpopular.
How do we counteract the bots…
Well we need the instances to verify who gets in, and make sure the members aren’t bots or saying unpopular things. These instances will need to be big, and well funded.
How do we counter these instance owners getting bought out, corrupted (repeat loop).
No? The problem of tech oligarchy is that they control the systems. Here anyone can start up a new instance at the press of a button. That is the solution, not allowing unfiltered freeze peach garbage.
Small “local” human sized groups are the only way we ensure the humanity of a group. These groups can vouch for each-other just as we do with Fediseer.
One big gatekeeper is not the answer and is exactly the problem we want to get away from.
You counter them by moving to a different instance.
Concept is however that if a new instance is detatched from the old one… then it’s basically the same story of leaving myspace for facebook etc… we go through the long vetting process etc… over and over again, userbase fragments reaching critical mass is a challange every time. I mean yeah if we start with a circle of 10 trusted networks. One goes wrong it defederates, people migrate to one of the 9 or a new one gets brought into the circle. but actual vetting is a difficult process to go with, and makes growing very difficult.
How is it going to be as big as reddit if EVERYONE is vetted?
Why do you want it to be as big as Reddit?
Can you have an instance that allows viewing other instances, but others can’t see in?
There might be clever ways of doing this: Having volunteers help with the vetting process, allowing a certain number of members per day + a queue and then vetting them along the way…
I feel like it’s only a matter of time before most people just have AI’s write their posts.
The rest of us with brains, that don’t post our status as if the entire world cares, will likely be here, or some place similar… Screaming into the wind.
That’s going right into /dev/null as soon as I detect it-- both user and content.
We could ask for anonymous digital certificates. It works this way.
Many countries already emit digital certificates for it’s citizens. Only one certificate by id. Then anonymous certificates could be made. The anonymous certificate contains enough information to be verificable as valid but not enough to identify the user. Websites could ask for an anonymous certificate for register/login. With the certificate they would validate that it’s an human being while keeping that human being anonymous. The only leaked data would probably be the country of origin as these certificates tend to be authentificated by a national AC.
The only problem I see in this is international adoption outside fully developed countries: many countries not being able to provide this for their citizens, having lower security standards so fraudulent certificates could be made, or a big enough poor population that would gladly sell their certificate for bot farms.
Your last sentence highlights the problem. I can have a bot that posts for me. Also, if an authority is in charge of issuing the certificates then they have an incentive to create some fake ones.
Bots are vastly more useful as the ratio of bots to humans drops.
Also the problem of relying on a nation state to allow these certificates to be issued in the first place. A repressive regime could simply refuse to give its citizens a certificate, which would effectively block them from access to a platform that required them.
Also is data scraping as much of an issue?
Data scraping is a logical consequence of being an open protocol, and as such I don’t think it’s worth investing much time in resisting it so long as it’s not impacting instance health. At least while the user experience and basic federation issues are still extant.
We also need a solution to fucking despot mods and admins deleting comments and posts left-and-right because it doesn’t align with their personal views.
I’ve seen it happen to me personally across multiple Lemmy domains (I’m a moron and don’t care much to have empathy in my writing, and it sets these limp-wrist morbidly obese mods/admins to delete my shit and ban me), and it happens to many people as well.
Yeah you can go fuck yourself for pinning your flavor of bullshit on ADHD. Take some accountability for your actions.
So much irony in this one
Good job chief 🤡
Freedom of expression does not mean freedom from consequences. As someone who loves to engage on trolling for a laugh online I can tell you that if you get banned for being an asshole you deserve it. I know I have.
Who is the asshole here?
That tells me all I need to know
Yes
Don’t go blaming your inability to have empathy on adhd. That is in absolutely no way connected. You’re just a rude person.
I’m also rude in real life too! 😄
lemm.ee and lemmy.dbzer0.com both seem like very level-headed instances. You can say stuff even if the admins disagree with it, and it’s not a crisis.
Some of the big other ones seem some other way, yes.
Lemm.ee hasn’t booted me yet? Much like OP, I’m not the most empathetic person, and if I’m annoyed then what little filter that I have disappears.
Shockingly, I might offend folks sometimes!
Instances that don’t vet users sufficiently get defederated for spam. Users then leave for instances that don’t get blocked. If instances are too heavy handed in their moderation then users leave those instances for more open ones and the market of the fediverse will balance itself out to what the users want.
I wish this was the case but the average user is uninformed and can’t be bothered leaving.
Otherwise the bigger service would be lemmy, not reddit.
Just like classical macroeconomics, you make the deadly (false) assumption that users are rational and will make the choice that’s best for them.
The sad truth is that when Reddit blocked 3rd party apps, and the mods revolted, Reddit was able to drive away the most nerdy users and the disloyal moderators. And this made Reddit a more mainstream place that even my sister and her friends know about now.
There are simple tests to out LLMs, mostly things that will trip up the tokenizers or sampling algorithms (with character counting being the most famous example). I know people hate captchas, but it’s a small price to pay.
Also, while no one really wants to hear this, locally hosted “automod” LLMs could help seek out spam too. Or maybe even a Kobold Hoard type “swarm.”
Captchas don’t do shit and have actually been training for computer vision for probably over a decade at this point.
Also: Any “simple test” is fixed in the next version. It is similar to how people still insist “AI can’t do feet” (much like rob liefeld). That was fixed pretty quick it is just that much of the freeware out there is using very outdated models.
Decentralized authentication system that support pseudonymous handles. The authentication system would have optional verification levels.
So I wouldn’t know who you are but I would know that you have verified against some form of id.
The next step would then by attributes one of which is your real name but also country of birth, race, gender, and other non-mutable attributes that can be used but not polled.
So I could post that I am Bob living in Arizona and I was born in Nepal and those would be tagged as verified, but someone couldn’t reverse that and request if I want to post without revealing those bits of data.
we have to use trust from real life. it’s the only thing that centralized entities can’t fake
What? I post a lot, but the majority?
…oh, you said LLM. I thought you said LMM.
I mentioned this in another comment, but we need to somehow move away from free form text. So here’s a super flawed makes-you-think idea to start the conversation:
Suppose you had an alternative kind of Lemmy instance where every post has to include both the post like normal and a “Simple English” summary of your own post. (Like, using only the “ten hundred most common words” Simple English) If your summary doesn’t match your text, that’s bannable. (It’s a hypothetical, just go with me on this.)
Now you have simple text you can search against, use automated moderation tools on, and run scripts against. If there’s a debate, code can follow the conversation and intervene if someone is being dishonest. If lots of users are saying the same thing, their statements can be merged to avoid duplicate effort. If someone is breaking the rules, rule enforcement can be automated.
Ok so obviously this idea as written can never work. (Though I love the idea of brand new users only being allowed to post in Simple English until they are allow-listed, to avoid spam, but that’s a different thing.) But the essence and meaning of a post can be represented in some way. Analyze things automatically with an LLM, make people diagram their sentences like English class, I don’t know.
A bot can do that and do it at scale.
I think we are going to need to reconceptualize the Internet and why we are on here at all.
It already is practically impossible to stop bots and I’m a very short time it’ll be completely impossible.
I think I communicated part of this badly. My intent was to address “what is this speech?” classification, to make moderation scale better. I might have misunderstood you but I think you’re talking about a “who is speaking?” problem. That would be solved by something different.
It sounds like you’re describing doublespeak from 1984.
Simplifying language removes nuance. If you make moderation decisions based on the simple English vs. what the person is actually saying, then you’re policing the simple English more than the nuanced take.
I’ve got a knee-jerk reaction against simplifying language past the point of clarity, and especially automated tools trying to understand it.
A simple thing that may help a lot is for all new accounts to be flagged as bots, requiring opt out of the status for normal users. It’s a small thing, but any barrier is one more step a bot farm has to overcome.