Current status of Friendica.World

a year ago by Ruud to c/friendicaworld

At this moment, friendica.world is not stable. You can experience 504 or 503 errors, or just be unable to load the site.

This is being worked on. We'll keep track of the currently known issues in this post.

Database query tuning

One of the main issues at the moment is the database hanging with many inefficient queries running for minutes or even hours. Most of them are using an inefficient 'NOT IN' or similar construction. We've created an issue for that here: https://github.com/...

Also we've created an issue for many updates to a key-value table: https://github.com/...

Update 30-06-2025

The beforementioned issues were closed, we'll upgrade to 2025.07-RC in order to get the latest fixes and do troubleshooting from there. We'll send the slow qeury logs to the devs.

Update 03-10-2025

It has been a while, so here's a long overdue update. In the last update I mentioned installing 2025.07-RC, which we did in test. But we noticed it broke the media (S3 plugin).
This issue has been raised, and it seems it has been fixed but not yet pushed (see https://github.com/...). Looks like it's close. If this has been fixed, we can re-try installing the update on test, and if it works, on prod.

We're now looking into another issue, which is the diskspace running out. Partly because of performance issues with cleanup jobs, the database is growing very rapidly. And as this is a physical server, we can't easily extend storage. So we're looking into options to extend the space without introducing a big extra cost.

Update 05-10-2025

We have ordered extra disks for the DB server.

Update 06-10-2025

Apparently this server only had room for 1 extra disk. We need 2 extra disks, so we can mirror them. We now decided to get a 'new' auction server for Friendica's database, with more disk. The server we ordered also has more CPU cores and RAM so that's a bonus.

We'll migrate the database soon, and will announce the downtime here.

Update 08-10-2025

Two updates:

  • We've planned the db migration for this Saturday Oct 11th.
  • A PR is ready which fixed the issue with the S3 addon for the Friendica update. We've tested this fix on the Dev instance and it works. Once the PR is merged and the docker image updated, we can upgrade prod.

Update 04-11-2025

The database has been migrated to the larger server, and today we also rescaled the 2 app servers to a larger plan, so they have double CPU and RAM.

ano 6 points a year ago

Rooting for you! Friendica is by far my preferred way of accessing the Fediverse – and it seems .world is the largest European server on the whole platform, so I really need it to work, aaaaa

path: 0 17421884, hotness: undefined, score: 6, children: 6
ruud 8 points a year ago

Thanks! We're doing our best. But we also need the github issues solved by the devs. Or others with programming skills

path: 0 17421884 17422369, hotness: undefined, score: 8, children: 4
convene_depth 2 points a year ago path: 0 17421884 17422369 17688476, hotness: undefined, score: 2, children: 3
ruud 3 points a year ago

Yes I saw. Looks like they only addressed the example query I provided, and not all 'NOT IN' queries.. looks like I have to submit an issue for every query I find.

path: 0 17421884 17422369 17688476 17691278, hotness: undefined, score: 3, children: 2
convene_depth 2 points a year ago

Do you have a test instance to check whether the recent change does help?

path: 0 17421884 17422369 17688476 17691278 17756926, hotness: undefined, score: 2, children: 1
Sunshine 1 point a year ago

I really like the local feed! I miss it already.

path: 0 17421884 17931638, hotness: undefined, score: 1, children: 0
Jerry 3 points a year ago

My instance only has 387 users, but these queries plague mine as well, locking tables for very long times, causing huge stalls.

path: 0 17826202, hotness: undefined, score: 3, children: 2
heluecht 1 point a year ago
path: 0 17826202 17968298, hotness: undefined, score: 1, children: 1
Jerry 1 point a year ago

This is great! Can't wait for the new release! Thanks.

path: 0 17826202 17968298 17968938, hotness: undefined, score: 1, children: 0
Kalon 2 points 8 months ago

Really hope Friendica can be improved to make it more stable. I, and many others, are sick of FB. I would like to recommend Friendica because it's the best fit for those with FB expectations, but it's hard to get a social movement away from a platform and even worse if things fall down on people.

I know these issues are not in your control and you're doing thi best you can. Thank you. I'm just looking forward to this day when we can make the move with confidence.

path: 0 22066701, hotness: undefined, score: 2, children: 1
ghrasko 1 point 8 months ago

As I see, the performance ticket has been opened half year ago.

Are there similar performance problems with other Friendica servers as well, or only with Friendica.world?

path: 0 22066701 22140516, hotness: undefined, score: 1, children: 0
eve 2 points a year ago

Is this still ongoing? I’m still having problems accessing it

path: 0 19100725, hotness: undefined, score: 2, children: 0
n816Life 1 point a year ago

Are there some other friendica based sites experiencing similar problems ?

path: 0 17744995, hotness: undefined, score: 1, children: 11
ruud 1 point a year ago

Not really, there are no Friendica sites with this many users...

path: 0 17744995 17746875, hotness: undefined, score: 1, children: 10
convene_depth 1 point a year ago path: 0 17744995 17746875 17756912, hotness: undefined, score: 1, children: 9
ruud 1 point a year ago

Ah I didn't know that one, they only have 80 mnthly active users though. I'll see if I can contact them

path: 0 17744995 17746875 17756912 17768658, hotness: undefined, score: 1, children: 8
heluecht 2 points a year ago
path: 0 17744995 17746875 17756912 17768658 17968337, hotness: undefined, score: 2, children: 3
convene_depth 2 points a year ago

Now that 2025.07RC is out had you considered updating to that?

path: 0 17744995 17746875 17756912 17768658 17968080, hotness: undefined, score: 2, children: 3
n816Life 1 point a year ago
path: 0 18543713, hotness: undefined, score: 1, children: 0
ankorage 1 point a year ago

Good morning. What is the current status of the active research and mitigation of the performance issues? Timeouts are still encountered, even with the Tip in use. The tip is not a solid WO, so it effectively doesn't really exist as timeouts still do occur, albeit less frequent.

Thank you. Much appreciated.

path: 0 19694849, hotness: undefined, score: 1, children: 1
ruud 1 point a year ago

I will put an update in the post. Thank you!

path: 0 19694849 19730886, hotness: undefined, score: 1, children: 0
Kalon 1 point 8 months ago

Don't have personal experience but I have seen many comments from admins who complain about the DB getting bogged down rapidly.

path: 0 22141239, hotness: undefined, score: 1, children: 0
friendicaworld

@lemmy.world

login for more options
161
14
1

This community is for status, support and issues on the Friendica.World instance

go to feed...