ADMIN, isn't it time to move from lemmy.world?

3 years ago by peregus to c/selfhosted

Every time I try to access this community, ther's some kind of problem with the server. If you have a look at the status page, it's almost all orange/red. The problem aren't DDoS attack since the server is behind Cloudflare protection. Admin/mods, why don't you move this community to a different server instance? I'm not accusing anybody, I know that maintain a server can be a challenging sometimes, I just want to enjoy this community!

Please!

@Loki

static09 46 points 3 years ago

ADMIN, isn't it time to move from lemmy.world?

They said, from their lemmy.world account.

path: 0 2332959, hotness: undefined, score: 46, children: 11
eager_eagle 7 points 3 years ago

just a user of an instance saying things about that instance - I would find the opposite weird.

path: 0 2332959 2335289, hotness: undefined, score: 7, children: 0
peregus -1 points 3 years ago

What's wrong with that? I've started here some months ago and I mainly follow this community.

path: 0 2332959 2333186, hotness: undefined, score: -1, children: 9
DrJenkem 17 points 3 years ago

The problem is it's the largest and is being attacked. Use a different instance and you'll have no problem accessing this community. If it weren't for people posting about the outages, I'd never even know.

path: 0 2332959 2333186 2333319, hotness: undefined, score: 17, children: 3
Mubelotix 3 points 3 years ago

This community is on lemmy.world so yes, there would be problems

path: 0 2332959 2333186 2333319 2333508, hotness: undefined, score: 3, children: 2
ninjan 6 points 3 years ago

I honestly haven't noticed. For me to see the posts they simply need to get pushed, which is pretty lightweight. And if Lemmy.world crashes after and stays down for a few hours it won't impact my ability to view the post. For a lemmy.world user the instance needs to be up for them to view any content.

path: 0 2332959 2333186 2333319 2333508 2335478, hotness: undefined, score: 6, children: 0
DrJenkem 2 points 3 years ago

In a way yes, when I post a comment, no one else will be able to see it while the site is down. But it eventually will go through when the site is up. And because I'm browsing from a different instance, I can see all the content even if lemmy.world is offline.

path: 0 2332959 2333186 2333319 2333508 2340772, hotness: undefined, score: 2, children: 0
PeleSpirit 0 points 3 years ago
path: 0 2332959 2333186 2333424, hotness: undefined, score: 0, children: 4
peregus 5 points 3 years ago

I actually didn't think about it.Icm on Lemmy, but I'm not a Lemmy specialist so I didn't know that I could go to a different instance and access this communit indirectly. Thanks

P.s. I didn't get the agenda part.

path: 0 2332959 2333186 2333424 2333656, hotness: undefined, score: 5, children: 3
PeleSpirit 1 point 3 years ago
path: 0 2332959 2333186 2333424 2333656 2333869, hotness: undefined, score: 1, children: 2
rhokwar 30 points 3 years ago path: 0 2332999, hotness: undefined, score: 30, children: 9
peregus 3 points 3 years ago

But isn't Cloudflare supposed to block those attacks?

path: 0 2332999 2333565, hotness: undefined, score: 3, children: 8
dditty 8 points 3 years ago

Cloudflare DDos protection isn't a silver bullet; the attacks are distributed and come from shifting source IPs, and are sophisticated in that they exploit resource intensive queries specifically designed to overload a Lemmy instance. If lemmy.world were to pivot to some other instance, who's to say the culprits wouldn't just resume their efforts pointed at the new location? There are theories these may be carried out by the recently-defederated fringe hate communities

path: 0 2332999 2333565 2334398, hotness: undefined, score: 8, children: 0
xebix 7 points 3 years ago

They explained that the attacks are in the form of requests that tax the database server, not the website itself.

path: 0 2332999 2333565 2334701, hotness: undefined, score: 7, children: 2
peregus -8 points 3 years ago

The database can't be accessed directly, all the requests needs to be done from the website or API.

path: 0 2332999 2333565 2334701 2334836, hotness: undefined, score: -8, children: 1
xebix 8 points 3 years ago

Right, but itโ€™s possible to execute those API requests to trigger those expensive database requests in a way that wouldnโ€™t necessarily trigger cloudflareโ€™s DDoS protection.

path: 0 2332999 2333565 2334701 2334836 2334927, hotness: undefined, score: 8, children: 0
gabriele97 6 points 3 years ago

Yep Cloudflare protects against classic DDoS (like many clients doing a lot of small requests). Here attacks are performed presumibly by users that know very well how the Lemmy's backend works and where bottlenecks are, so that with a small number of well made requests they are able to mess up the backend and Cloudflare doesn't notice it

path: 0 2332999 2333565 2337070, hotness: undefined, score: 6, children: 0
pankkake 3 points 3 years ago

From what I understand, Cloudflare can block some DDoS attacks, but not all of them.

The attacks on Lemmy have to do with poorly optimized SQL requests; these are requests that shouldn't take long to execute, but do due to some oversight. By spamming these requests, the attackers can bring Lemmy on it's knees.

Actually, wouldn't this attack better be categorized as a DoS attack ? What's so distributed about it ?

path: 0 2332999 2333565 2334007, hotness: undefined, score: 3, children: 0
habitualTartare 3 points 3 years ago

Cloudflare has DDoS protection but it can't stop everything 100% of the time. According to the admins, the attackers are very familiar with how lemmy works and are using this knowledge to overwhelm resources. This isn't just a simple script kiddy or bonnet for hire but likely points to someone that has worked within the lemmy community.

https://www.cloudflare.com/...

https://www.cloudflare.com/...

path: 0 2332999 2333565 2334104, hotness: undefined, score: 3, children: 0
FARTYSHARTBLAST 2 points 3 years ago

It can help, but is not perfect. There's kind of been an arms race between services like Cloudflare and script kiddies/hackers DDOSing: Their methods became a little more sophisticated to the point that they keep the traffic shifting from address to address so it's harder to track/block.

They'll do other things to mess with the host too like spamming "white noise" pictures to fill up server storage space, so while DDOS attacks play a role, there are other issues at play on top of that.

For what it's worth, I've been using Kbin.social and sh.itjust.works as well and they have also had some issues here and there. No host will be perfect and invulnerable from every attack, and when an instance becomes more popular, it becomes increasingly likely to be targeted by attackers.

path: 0 2332999 2333565 2335544, hotness: undefined, score: 2, children: 0
sneezycat 14 points 3 years ago

Ironic. They could self-host for others, but they couldn't self-host themselves.

path: 0 2332773, hotness: undefined, score: 14, children: 2
greybeard 7 points 3 years ago

There's a difference between self hosting and running a public service. There's a lot more overhead running a pubic service.

path: 0 2332773 2333011, hotness: undefined, score: 7, children: 0
peregus 0 points 3 years ago

What's wrong with that? I've started here some months ago and I mainly follow this community and I don't blame anyone.

path: 0 2332773 2333120, hotness: undefined, score: 0, children: 0
jesterraiin 12 points 3 years ago

I find this comment section a prime example of dickish hivemind seething over nothing.

There's a dude, obviously quite fresh in the ways of Mastodon. He probably doesn't realize all the nuts & bolts supporting the system and how it all works. He is asking a question that is logical, but it needs clarification, like "it doesn't work like this, my man".

Instead he gets "Hsssssssssssssss, selfhost it, hsssssssssssssssssssss, interloper, hsssssssssssssssssss, you want to destroy this place, hssssssssssssssss..."

Get a life, eejits.

path: 0 2333785, hotness: undefined, score: 12, children: 9
johannes 7 points 3 years ago

Your post is more offensive then the others.

Not to mention that the OP is open for interpretation, and it came across (at least to me) as another entitled person moaning about a free service.

Next to that, teaching people about the selfhost option is actually what lemmy is all about. Not beeing owned by a single corporate entity, so endusers have freedom to choose.

If lemmy want to survive, it depends on people who know how to selfhost it.

path: 0 2333785 2335055, hotness: undefined, score: 7, children: 4
jesterraiin -9 points 3 years ago
path: 0 2333785 2335055 2337476, hotness: undefined, score: -9, children: 3
johannes 3 points 3 years ago

Grow up.

path: 0 2333785 2335055 2337476 2341015, hotness: undefined, score: 3, children: 0
vd1n 1 point 3 years ago

I agree with you. Lemmy seems to have a lot of entitled people that stifle freedom. It's pretty disappointing.

I always thought "touch grass" was a stupid saying on reddit. But on here I've really wanted to use it. Like ...get outside and see the world is chaos and you're not that significant or special.

path: 0 2333785 2335055 2337476 2343683, hotness: undefined, score: 1, children: 1
jesterraiin 1 point 3 years ago

Yeah.

Those people seem to migrate from Reddit, but still carry it in their hearts and minds. ๐Ÿ˜‘

path: 0 2333785 2335055 2337476 2343683 2353330, hotness: undefined, score: 1, children: 0
peregus 3 points 3 years ago

Thanks! As you, I thought that this was a community to share thought and knowledge. In fact a couple of guys here pointed out that I could solve my problem accessing this community in another instance, not in the better way, but at least that was helpful!

path: 0 2333785 2333925, hotness: undefined, score: 3, children: 1
jesterraiin 0 points 3 years ago

Yeah. It's good that there are users who actually take time to explain some stuff, rather than just hissssssss like rabid vipers merely because somebody - oh no, what a preposterous idea! - asked a harmless question.

path: 0 2333785 2333925 2334003, hotness: undefined, score: 0, children: 0
krayj 3 points 3 years ago

They are making an assertion as if it is a statement of fact...and they are, in fact, wrong. That's ignorant and not helpful for discussion or helpful for understanfing and solving the actual issue. If they had actually asked an innocent question it would be different, but they didn't. That is why the responses are the way they are.

path: 0 2333785 2349329, hotness: undefined, score: 3, children: 1
jesterraiin 0 points 3 years ago

No. The responses are the way they are, because people who gave them are already thinking they joined some elitistic "muh sikret klub!" group.

Simple "eh, it won't fix the problem, and here's why and how YOU can help" would be preferable, but no, special elite force of lemmy underground is too privileged to bother.

Thank heavens not everyone is like that. Saves the number of times I have to hit "block the idiot" button.

path: 0 2333785 2349329 2352970, hotness: undefined, score: 0, children: 0
droolio 8 points 3 years ago

Well your account is on lemmy.world so how d'ya know the issue isn't with your own access to the front end?

Many don't interact with the lemmy.world directly, so we might only see delays in post propogation (if there is such an issue on the backend - I don't see any but could be wrong).

I agree picking the biggest instances isn't great from a scaling perspective, but s'gonna be hard to move any community once established.

path: 0 2333025, hotness: undefined, score: 8, children: 0
SpaceNoodle 7 points 3 years ago

Sounds like you're offering to self-host it

path: 0 2332668, hotness: undefined, score: 7, children: 4
peregus 0 points 3 years ago

I mean to a different instance, not the same instance to a new server. The title was clear, I'be edited the comment to avoid misinterpretation.

path: 0 2332668 2333094, hotness: undefined, score: 0, children: 3
SpaceNoodle -1 points 3 years ago

Yeah, a different instance that you'll be self-hosting.

path: 0 2332668 2333094 2335418, hotness: undefined, score: -1, children: 2
peregus 0 points 3 years ago

A reply to this kind of message has been written by jesterraiin just up here!

path: 0 2332668 2333094 2335418 2335507, hotness: undefined, score: 0, children: 1
SpaceNoodle -1 points 3 years ago

Oh, you're so fragile that you can't even recognize irony.

path: 0 2332668 2333094 2335418 2335507 2340004, hotness: undefined, score: -1, children: 0
fireshaper 7 points 3 years ago path: 0 2343846, hotness: undefined, score: 7, children: 1
krayj 1 point 3 years ago
path: 0 2343846 2349044, hotness: undefined, score: 1, children: 0
cpo 5 points 3 years ago

And what would moving the server to another server solve according to you?

path: 0 2332661, hotness: undefined, score: 5, children: 2
peregus 3 points 3 years ago

Moving to a more stable instance means that I can access this community!

path: 0 2332661 2333054, hotness: undefined, score: 3, children: 1
cpo 0 points 3 years ago

As long as the DDoS goes on, the instance itself has no influence whatsoever, aside from kernel hardening.

It is not a matter of just switching the server.

Edit: and you have no clue of the work involved in keeping lemmy.world up and running while DDoS attacks are performed.

Either run your own or join one of the smaller instances.

path: 0 2332661 2333054 2336590, hotness: undefined, score: 0, children: 0
boyi 4 points 3 years ago

The problem is not the server. One of the reasons is because lemmy world is being DDoS attacked by certain party with grudges. Because lemmy is not used to this kind of attack, which is made difficult by way it is designed and open source nature where the attacker can easily uncover vulnerabilities, it took some times and learning to mitigate them. You can open new account in other instances or move if that's too much inconvenience for you. No one is stopping you.

path: 0 2333683, hotness: undefined, score: 4, children: 0
PeachMan 2 points 3 years ago

What makes you think other servers aren't having similar problems?

(spoiler alert: they all are, lemmy is an immature platform)

path: 0 2334080, hotness: undefined, score: 2, children: 0
krayj 2 points 3 years ago

By claiming that the problem isn't DDOS, you're just advertising your ignorance. Cloudflair is outstanding for protecting static web content against DDOS, and Lemmy.world is well protected against that. The problem is certain dynamic pages and api calls that can only be rendered from costly realtime dynamic database operations...those are the url that the DDOS attackers are focusing on and those are the kinds of content that cannot be easily protected by cloudflair.

Your premise, though, is still accidently correct. The way to mitigate instances being targeted by DDOS is to spread the user base and community hosting across a vast number of instances so that no one instance is such a rewarding target for DDOS attack.

path: 0 2349154, hotness: undefined, score: 2, children: 1
peregus 1 point 3 years ago

You're right about my ignorance about Lemmy, I'm a user on this federated ...thing and I know nothing ahout the Lemmy server. Being in a selfhosted community your answer is what I was expecting (maybe with less attack). The API are used only by the federated instance or also by the smartphone apps? For what I see, it seems to be the former, and, if it really is so, the API calls could be allowed only by those server and blocked from everyone else, Cloidflare WAF can do this. I know that the servers are a lot, but it could be possible to insert in the WAF all the IPs of the federated instances. ...or not?

path: 0 2349154 2350929, hotness: undefined, score: 1, children: 0
johannes 2 points 3 years ago

Have you donated money so they can?

Another server (and i assume you mean one with better specs) means more money. Its not just challenging, its also costly.

Alternative you could setup your own lemmy instance, you can still join the communityโ€™s on lemmy.world or lemmy.ml or whereever :) and its fun to do.

path: 0 2332659, hotness: undefined, score: 2, children: 5
peregus 1 point 3 years ago

I mean to a different instance, not the same instance to a new server. The title was clear, I'be edited the comment to avoid misinterpretation.

path: 0 2332659 2333129, hotness: undefined, score: 1, children: 4
johannes 1 point 3 years ago

Its a shame Lemmy doesnt allow us to migrate our profiles (yet) like Mastodon for instance. But i have good hopes this will come in the future, so you can move to a different (better, depending on your definition) server easily :) Weโ€™ll just have to wait a while i guess :)

path: 0 2332659 2333129 2333253, hotness: undefined, score: 1, children: 3
PeleSpirit 2 points 3 years ago
path: 0 2332659 2333129 2333253 2333354, hotness: undefined, score: 2, children: 2
johannes 2 points 3 years ago

Well there goes my hope.. crushed like a candy! :(

path: 0 2332659 2333129 2333253 2333354 2333845, hotness: undefined, score: 2, children: 1
solberg 1 point 3 years ago

Is it possible to migrate a community from one instance to another?

path: 0 2344196, hotness: undefined, score: 1, children: 1
krayj 1 point 3 years ago

No, not programmatically. The only way to 'move' an instance is for a community of users to create a new community elsewhere and arbitrarily start using it as their preferred community. There is no way to force it and there is no mechanic for moving.

path: 0 2344196 2349265, hotness: undefined, score: 1, children: 0
andreluis034 1 point 3 years ago

I think the admin of c/selfhosted is the admin of Lemmy.world

path: 0 2337996, hotness: undefined, score: 1, children: 1
andreluis034 1 point 3 years ago
path: 0 2337996 3618244, hotness: undefined, score: 1, children: 0
Tiritibambix 1 point 3 years ago
path: 0 2339047, hotness: undefined, score: 1, children: 0
selfhosted
selfhosted

@lemmy.world

login for more options
63058
6824
6401

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

go to feed...