Lemmy to Piefed migration preparations

a year ago by Kris to c/piefed_meta

Due to the unfortunate down-time of slrpnk.net we are currently researching possible blockers for creating a Lemmy to Piefed migration guide or script for a relaunch in 1-2 months.

I have never done such a migration before, but generally it seems possible, although migrating image uploads from Pict-rs adds additional complexity (that might not be worth it).

I have created an issue on Codeberg about possible blockers here, but additional input on possible issues or examples of similar migration scripts would be appreciated.

If anyone else has similar plans, please let me know so that we can work together on this.

Blaze 15 points a year ago

Good luck!

path: 0 17534387, hotness: undefined, score: 15, children: 0

AccountMaker 15 points a year ago

Let's goooo!
I'll see if I can find the time to start contributing code to PieFed

path: 0 17535126, hotness: undefined, score: 15, children: 3

jollyroberts 10 points a year ago

This helped me get a good handle on the code base when I started: https://join.piefed.social/...

Some are a little out of date now but still an excellent place to start!

path: 0 17535126 17536741, hotness: undefined, score: 10, children: 2

AccountMaker 2 points a year ago

Thanks for the link!
I guess I should start with the Flask tutorial, since I never worked with it before.

path: 0 17535126 17536741 17560972, hotness: undefined, score: 2, children: 1

jollyroberts 3 points a year ago

Yeah, I did that, plus the videos, plus just running a local test instance and tweaking things.

The app/activity pub code is probably the most complex to follow. Most of the rest is easier to get your head around.

Feel free to ping me if you have questions. Or join the matrix channels, they are pretty lively too.

path: 0 17535126 17536741 17560972 17563254, hotness: undefined, score: 3, children: 0

PirateFrog 12 points a year ago

Quite excited to see how this develops ^^

path: 0 17535087, hotness: undefined, score: 12, children: 0

nemo 7 points a year ago

This is the @poVoq@slrpnk.net alt, right?

path: 0 17536129, hotness: undefined, score: 7, children: 1

Blaze 7 points a year ago

Correct

path: 0 17536129 17536151, hotness: undefined, score: 7, children: 0

AnarchistArtificer 5 points a year ago

I don't know how to link to users, but I think Ada, the admin of lemmy.blahaj.zone, recently migrated the instance to Piefed. Might be worth reaching out

Edit: found the post I was thinking of. Looks like it's not a full migration, but there might still be some relevant insight.

I'm also now remembering another instance that has done a migration recently. I think it seemed like they were able to migrate across a lot of info, but possibly not users' subscribe lists(?), I think? I don't remember specifics, but I'll update this post if I stumble across the post I'm remembering

path: 0 17568153, hotness: undefined, score: 5, children: 6

PirateFrog 5 points a year ago

Lemmy.ca also created a secondary piefed instance recently.

path: 0 17568153 17570436, hotness: undefined, score: 5, children: 0

Blaze 3 points a year ago

https://quokk.au/

path: 0 17568153 17572710, hotness: undefined, score: 3, children: 3

Kris 4 points a year ago

They actually migrated stuff from Lemmy? I thought it was a new instance?

path: 0 17568153 17572710 17580461, hotness: undefined, score: 4, children: 2

Blaze 2 points a year ago

It used to be a Lemmy instance since around 8 months: https://lemmy.world/c/world@quokk.au?dataType=Post&sort=Old

For more details: https://lemmy.world/post/31077672

path: 0 17568153 17572710 17580461 17580509, hotness: undefined, score: 2, children: 1

Kris 4 points a year ago

Ah, right they just swapped out without migrating anything. Thats not really what we are aiming for, but their comment confirmes that remote subscriptions might get lost.

path: 0 17568153 17572710 17580461 17580509 17580706, hotness: undefined, score: 4, children: 0

Kris 3 points a year ago

I would need to check at database level, but I guess on the subscribing side it is only a list of communities to display? The real "work" for subscriptions happens on the remote instance to decide with activities to send.

But that indeed raises the interesting point on how to retain subscriptions of remote users. Anyone got an idea how that is handled on database level? Is it just the same list but for the non-local users that are mirrored in the database?

path: 0 17568153 17580568, hotness: undefined, score: 3, children: 0

bjoern_tantau 3 points a year ago

For the pictures, collecting them via wget and then instructing your webserver to map that URL to a path on your server should be possible. I've been thinking of doing that for a while now for caching purposes and to check if that really needs 25 GB of space just for me.

path: 0 17597508, hotness: undefined, score: 3, children: 0

rimu 1 point a year ago

path: 0 17534661, hotness: undefined, score: 1, children: 0

@piefed.social

login for more options

Discuss PieFed project direction, provide feedback, ask questions, suggest improvements, and engage in conversations related to the platform organization, policies, features, and community dynamics.

Wiki

go to feed...

@piefed.social

login for more options

Discuss PieFed project direction, provide feedback, ask questions, suggest improvements, and engage in conversations related to the platform organization, policies, features, and community dynamics.

Wiki

go to feed...