For what it's worth, as the creator of lemmit.online, I totally understand people not wanting to see automated content bots. I, for one, wouldn't want to see them mixed with regular content. That is why I made sure to put it on its own instance, and not allow any users - so there would be minimal harm if a server would decide to defederate.

And yes, NSFW content is allowed on my server :). For more answers, see this FAQ post. For more questions, please post them in that comment thread there.

If that's what happens, that's what happens. ¯\_(ツ)_/¯

I'm just here to offer a service for people who Do like it.

Yups. It's all done by one bot though, so you'll just have to block that to get rid of them.

Personally I'd be fine with allowing it in bios only. If people want to see more, they'll check out the bio, and see the link there. In other cases someone will just be like "... Nice." without feeling advertised to.

In the end, it's all about the rules the community itself puts up. Personally, I get more enjoyment out of fewer "real" (imperfect/amateur) out-of-love quality, than more perfect/fitgirl for-profit quantity. But I'm aware this is generally a minority opinion.

Nope, it doesn't use the API, but relies on the RSS feed and scraping old.reddit.com And those will probably also die at some point in the future, this will probably keep working a bit longer.

Interesting idea! I have some thoughts if you’re open to feedback:

Always!

Have you considered moderation? These mirrored communities on lemmit.online will still be getting comments from all over the federated network, and if you’re the only user and sole moderator of every community, then it might get quite overwhelming!

I have, and I hope it won't be a problem ;) I'm a software engineer, as mentioned above, have little interest in managing people outside of work :P If anyone wants to become a moderator, they're free to request it.

A small VPS might not be able to handle that

We'll see how well it does. I don't mind spending a little money on this (few dozen €/$ per month), if it takes off. In the end though, it's more meant as a kickstart for Lemmy content than anything else.

How are you planning to deal with API limits from Reddit?

HA! By not using the API. For starters, because someone-who-isnt-me would like to browse NSFW content. I do a bit of client-side throttling between requests, which I hope will keep me under the radar. But it's mostly based on rss for the subreddit overview, and scraping for the individual posts.

In the end... we'll just have to see how it goes.

Congrats on reaching this set of sane rules. The efforts of creating an admin community behind the scenes are really starting to show off.

Request for clarification for uhmm, a friend of mine: When someone creates that own instance, with blackjack and hookers, and one of your users subscribes to a community there, it will synchronise part of that content to lemmynsfw. What will you do then?

I'd like to remind you that some beautiful maniacs can be quite reasonable ;)

I'm absolutely with you on that on. If anything, part of the reason I wanted this was to have some fresh content that I knew I was going to miss once after July 1st. Stuff like !itookapicture@lemmit.online for example. There's a bit too much reddit-circlejerk going on right now, even here imho.

No no no, thank YOU for a great improvement :)

Yups. Combination of scraping and rss. With a bit of client-side throttling thrown in to stay under the radar.

I'll need to investigate what went wrong here, eh. Sorry.

As a side effect, I did manage to find and fix another bug that would lead to a crash in the bot :D

Yeah, the bot only operates on its own instance. So you can have !bestof@lemmit.online and !bestof@lemmy.ml.

Deployed. 🤞

Unfortunately, Lemmy cannot handle community names over 20 characters, so this won't be possible.

...

of course this exists.

(I'm not complaining)

Doing the lord's work here, I see 👍 .

That bug is next on the list ;)

Ontopic: A tip I got elsewhere is not to use the rss feed, but the json feed (just put .json at the end instead of .rss), although the same problem applies there I suppose.

I think you'd have to create some sort of recursive loop to crawl the comments - Going deeper every time you encounter "continue this thread".

I fully applaud your endeavor btw. As mentioned elsewhere, comment syncing is not the scope of this project (nor is it feasible), but I can see how some subs are kinda worthless without it.

I'm having similar issues on lemmy.ml, not sure what causes it.

Well... There is the thing that I had this service running on another host at some point, it got federated with quite a few instances (including lemmy.ml and some others), and I had to reinstall it. Maybe those instances have a hard time accepting the new installation?

I'm kinda hoping it will sort itself out over time, maybe those instances just need to restart 🤞 .

I think @tubbadu@lemmy.one wrote something to that effect (I'm still a mess with making proper links on here :/)

And I also found something else that was written in java (not javascript).

The downside from using the RSS feed is that it doesn't contain the whole body, which my scraper does fetch.