Any way to help with federation/syncing?

3 years ago by HTTP_404_NotFound to c/lemmyworld

I have a lot of subscriptions, of which don't appear to be up to date.

Some communities, I see hardly no comments, and the vote counters never go up.

My assumption is the instance hosting the community is completely overloaded.

My instance, has gigabit symmetrical internet, 128G of assigned ram, and an entire E5-2697a v4 processor allocated to it (16 cores, 32 threads)

The worker count is turned up, but, in terms of my instance, it is basically sitting "near" idle, with a load average of < 0.30

There- anyway to speed up federation other then the instances hosting the communities upgrading their servers?

colifloro 4 points 3 years ago

You can perhaps make use of this script https://lemmy.world/post/226441

save

path: 0 299170, hotness: undefined, score: 4, children: 1

xtremeownage 0 points 3 years ago

I just added a link to it. I plan on cleaning up the post in the next day or so, and adding a lot more useful things to it (as- I myself, am learning about this platform as I go too)

Edit- sorry, got the context wrong. I was thinking of my introduction to fediverse guide-

https://static.xtremeownage.com/...

But- still makes a great link to include there.

save

path: 0 299170 337793, hotness: undefined, score: 0, children: 0

dannym 3 points 3 years ago

save

path: 0 295530, hotness: undefined, score: 3, children: 4

mirisbowring 2 points 3 years ago

I‘ve read that lemmy servers always use UTC and the UIs will map them to thw actual date

save

path: 0 295530 295763, hotness: undefined, score: 2, children: 1

dannym 1 point 3 years ago

indeed, ignore what I said tho, I misread your question :)

save

path: 0 295530 295763 296521, hotness: undefined, score: 1, children: 0

xtremeownage 1 point 3 years ago

So- I have been messing with testing federation between two instances I own.

On the instance sending the subscription, no errors appear.

On the instance hosting the community, I only see a few things of interest which stands out in the logs-

WARN Error encountered while processing the incoming HTTP request: lemmy_server::root_span_builder: Header is expired

WARN Error encountered while processing the incoming HTTP request: lemmy_server::root_span_builder: error decoding response body: expected value at line 2 column 12 0: lemmy_server::root_span_builder::HTTP request with http.method=POST http.scheme="https" http.host=lemmyonline.com http.target=/inbox otel.kind="server" request_id=cb0488b8-4744-41ff-baf7-d1456bf04a53 http.status_code=400 otel.status_code="OK" at src/root_span_builder.rs:16 LemmyError { message: None, inner: error decoding response body: expected value at line 2 column 12

Caused by: expected value at line 2 column 12, context: "SpanTrace" }

2023-06-21T01:36:24.103371Z WARN Error encountered while processing the incoming HTTP request: lemmy_server::root_span_builder: Header is expired 0: lemmy_server::root_span_builder::HTTP request with http.method=POST http.scheme="https" http.host=lemmyonline.com http.target=/inbox otel.kind="server" request_id=74ad3ab1-8c89-46bf-a77e-997d7c8f896c http.status_code=400 otel.status_code="OK" at src/root_span_builder.rs:16 LemmyError { message: None, inner: Header is expired, context: "SpanTrace" }

If- you have any ideas on either of those two errors, I am all ears!

save

path: 0 295530 397652, hotness: undefined, score: 1, children: 0

xtremeownage 0 points 3 years ago

I have had it cranked up to 256 for a while now.

Didn't make much of a difference.

I can dig up some logs later.

save

path: 0 295530 299546, hotness: undefined, score: 0, children: 0

manitcor 3 points 3 years ago

same, i have a small instance, only running 8 cores on about 32gb right now but could easily scale as needed. Don't even have 50 users and the edge is handling 60% of the traffic. I bet a lot of smaller instances could take 5-10x thier current user counts.

Best way to find instances with shared interests ive seen is : https://browse.feddit.de/

save

path: 0 295197, hotness: undefined, score: 3, children: 0

spaduf 2 points 3 years ago

Does anybody know if interaction prompts syncing? I feel like if I comment on something and come back a little bit later things look better federated.

save

path: 0 296848, hotness: undefined, score: 2, children: 0

xtremeownage 1 point 3 years ago

A random idea I had as well- https://github.com/LemmyNet/lemmy/issues/3245

save

path: 0 413780, hotness: undefined, score: 1, children: 0