Mastodon's built-in CLI gives you the availability to clean attachments and previews from remote accounts, purging the disk cache. This is fantastic and you couldn't possible survive with out it.
My current crontab that runs every 3 hours:
0 */3 * * * /bin/bash /home/mastodon/purge-media.shCode language: Bash (bash)As of Mastodon 4.1.0, we have new available commands. Here's the content of my purge-media.sh script:
#!/bin/bash
# Prune remote accounts that never interacted with a local user
RAILS_ENV=production /home/mastodon/live/bin/tootctl accounts prune;
# Remove remote statuses that local users never interacted with older than 4 days
RAILS_ENV=production /home/mastodon/live/bin/tootctl statuses remove --days 4;
# Remove media attachments older than 4 days
RAILS_ENV=production /home/mastodon/live/bin/tootctl media remove --days 4;
# Remove all headers (including people I follow)
RAILS_ENV=production /home/mastodon/live/bin/tootctl media remove --remove-headers --include-follows --days 0;
# Remove link previews older than 4 days
RAILS_ENV=production /home/mastodon/live/bin/tootctl preview_cards remove --days 4;
# Remove files not linked to any post
RAILS_ENV=production /home/mastodon/live/bin/tootctl media remove-orphans;Code language: PHP (php)β οΈ If you've never run these commands before I'd suggest run them one by one (not in a cronjob) as they might take several hours (or days) to run each. The size of the cached media and database will depend on how many people you follow, how many are on your instance, how many relays you have added to your instance, etc.
Having like 10 relays added to my single-user instance with the bash script above I'm around 30Gb in my Object Storage S3.
Do you have any other tips on how to keep a Mastodon instance lean?
π Don't miss the follow up post: Scaling Mastodon: moving media assets to Object Storage
@ricard nice improvement!
@borghal Thank you, Borghal!
@ricard As a FYI The cert on that server appears to be bad. Cert seems to be for your Mastodon instance.
@wild1145 Thank you for the heads upSomething weird is going on as I can load it no problem
@ricard If it helps this is the cert that I’m getting presented. Not sure exactly what’s caused it but yeah, looks like the wrong LE Cert.
@wild1145 I have re-issues a certificate for the .dev domain.Could you please try again? π
@ricard Appears to be showing the same cert atm for me
@wild1145 This is very weird. The nginx site config for .dev and .social is pointing to a different cert π€·
@ricard Atm it could be a caching issue on my side if Firefox is having a weird day, I’ll try in a in-private window in case.
@ricard Nope same in-private. Dumb question but I assume you reloaded the NGINX Config after re-issuing the cert?
@wild1145 Yep. Tried myself on FF and Safari and I do see the new cert.
@wild1145 I think it could have been something with IPv6 I’ve compared my other domains and .dev had it set up at the Linode Domain dashboard, for some reason.I’ve removed the extra configuration (which I don’t remember creating) for IPv6 and now they look the same, see if that solves it after propagation π€ Thank you again for the feedback π
I have taken a stab at fixing this: https://github.com/mastodon/mastodon/pull/21995
That’s awesome, Evan. Thank you for leading with example π
Hopefully Mastodon maintainers take the time to review it.
Oh god thank you for this π
I still dont’ know why I decided to do my own instance.
It was a good decision! Decentralization π
We just have to find the sweet spot for disk usage and resources
@ricard What’s the reasoning for removing all headers including your follows?
@ricard I do not have any cronjobs, I have delayed it for so long, obviously too long I actually have that page open, going to set up a cronjob soon as soon as I get the initial prunes done (need some space before making it automatic).Hetzner 1TB storage costs β¬ 3.20 per month. It’s the cheapest I know. And really reliable too.
@ricard Also worth noting that I follow almost 4000 users. On top of that I have 15 relays.
@rolle that somewhat explains it
@ricard @anlomedad While it takes a while to do so you might not want to run it every night (as well as some providers charging for the api calls to check all the files), I didn’t see a command in there to remove orphans ( https://docs.joinmastodon.org/admin/tootctl/#media-remove-orphans )tootctl media remove-orphansIt will go through for media files that aren’t connected to stuff anymore, just taking up space.
Using the admin CLI – Mastodon documentation
@daevien @anlomedad Thank you for raising it! I had it in my actual cronjob but forgot to add it to my blog post. Updated β Indeed remove-orphans is quite needed.
@ricard @VlarpNL My single user instance has over 100Gb of media storage with 7 day media retention. The S3 bucket is still less than $USD1 a month on Backblaze
@ricard doesn’t that do the same thing like Mastodon’s built-in caching deletion?
@mondanzo It’s different. The cache retention deletes everything (posts you’ve liked, bookmarked, etc).There’s a PR to amend the text so it’s easier to understand.The CLI commands are way more refined and only delete stuff you haven’t interacted with, etc.
@ricard thanks! will check that out!