- cross-posted to:
- selfhosted@lemmy.world
- cross-posted to:
- selfhosted@lemmy.world
I made this tool to help self-hosters, new admins, or smaller instances have more global and updated content on their instances.
This is the similar to Lemmy Community Seeder but is designed to be run periodically to capture new communities, and include EVERYTHING by default.
EDIT: As noted in the comments, this is an admin tool. Please do not run it as a user if you don’t know what you are doing. If you want a better “All,” ask your admin first! That said, lemmony in no way constitutes abuse! You can cause a DOS with curl, but that’s not what curl was written for. This tool is to legitimately use an API to enhance our experience. Admins that desire to accommodate high volume on a public service will not know this tool is running against, or on their instances. If it causes performance issues, that is unfortunate. They are free to throttle, ban or block API access to their instance in a multitude of ways.
EDIT 2: Donate to your instance/admin if you like Lemmy!
You must log in or # to comment.
deleted by creator
This is a neat idea. I’m guessing it’s something the admin of the instance has to run?
deleted by creator
Quite a bit of space could be saved with database compression. The database side of things has lower hanging fruit right now though.
deleted by creator
Images are not federated, they only live on the hosting instance.
Thumbnails might copied though, I’m not sure.
deleted by creator
There is some discussion. https://github.com/LemmyNet/lemmy/issues/2947
I am still fairly confident that it shouldn’t be storing images, but I’ll admit my pict-rs directory is growing quite fast compared to the database. Have to keep a close eye on this.
deleted by creator
EVERYTHING by default. Also working on “discover only” for searching without the subscribe-to-everything. That said: It’s far less than 3GB per day for EVERYTHING I can see, plus: you don’t HAVE to keep it forever. Were you doing something that got other than text?
deleted by creator
They’re not supposed to, and don’t call me friend, buddy.
deleted by creator
Do you have a link to a documentation concerning retention/cleanup for instances?
Hosting an instance myself, I’m not amused, because if forces my instance to literally sync all content there is on the lemmyverse, drastically increasing traffic, storage use etc.
Please don’t force resource consumption beyond any rational usage!
deleted by creator
I’d recommend anyone using this to really consider how much data this’ll use on their system.
deleted by creator
