Slrpnk.net outage
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable 😓
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing 😥
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
like this
devAlot doesn't like this.
MyOpinion
in reply to Kris • • •like this
WingedObsidian, jojop and hoanbridgetroll like this.
don't like this
vatlark, colforge, WingedObsidian, catloaf, user_name, Lazycog, ✺roguetrick✺, SineIraEtStudio, MemmingenFan, TheImpressiveX, beartato, misericordiae, RanzigFettreduziert, tofu, SatansMaggotyCumFart, nocturne, PirateFrog, Blaze (he/him), empireOfLove2, Rentlar, Rubberman, jojop, partial_accumen, splangy, hoanbridgetroll, A_cook_not_a_chef, statingtheobvious, InquisitiveApathy, PhilipTheBucket, Null User Object, stupididiot, MelodiousFunk, Prostetnic Jeltz, Da Bald Eagul, dubyakay, Korthrun, Botzo, TeryVeneno, pandakhan, Jomn, Zer0Rank, fxomt, StellarExtract, irelephant [he/him], francois, Mia, Five, glaber, deergon, riddell, unprovenbreeze and Rose don't like this.
PirateFrog
in reply to MyOpinion • • •like this
TeryVeneno, jawa22, fxomt, Five, glaber and unprovenbreeze like this.
MyOpinion
in reply to PirateFrog • • •don't like this
nocturne, pandakhan, RanzigFettreduziert, catloaf, user_name, blarh, Five, glaber and unprovenbreeze don't like this.
PirateFrog
in reply to MyOpinion • • •I know, I'm the one who approved your application.
You happened to sign up right before we've had our first particularly bad issue in 3 years. Unlucky, yes, but it's a bit out of order (IMO) to say we're a poorly managed instance based on that, especially seeing as you lost nothing besides the time it took to write your application. :\
like this
nocturne, tofu, jawa22, perestroika, MelodiousFunk, jinx, Five, glaber and riot like this.
khaleer
in reply to Kris • • •It looks like there is no enough solar power for solarpunk!
~~no need to show me where doors are, I will find them by myself~~
anyway, good luck with that!
like this
RanzigFettreduziert, Takapapatapaka, fxomt, TeryVeneno, Lazycog and irelephant [he/him] like this.
RanzigFettreduziert
in reply to Kris • • •like this
, univers3man, TeryVeneno, tenchiken, deafboy, Starfighter, chelatna, Match!!, nocturne, Hubi, Lazycog, Xkdrxodrixkr, PirateFrog, evulhotdog, Stety, Five, This is fine🔥🐶☕🔥, ThePinkUnicorn, 9bananas, arcterus, ArachnidMania, blazeknave, mad_lentil, Sunshine (she/her), AccountMaker, pjusk, AlternateCatfox, ArcticDagger and someacnt like this.
Kris
in reply to RanzigFettreduziert • • •like this
univers3man, TeryVeneno, Starfighter, Match!!, nocturne, curbstickle, Hubi, Lazycog, flamingos-cant, Xkdrxodrixkr, qaz, Five, This is fine🔥🐶☕🔥, ThePinkUnicorn, 9bananas, ArachnidMania, blazeknave, AccountMaker, pjusk, AlternateCatfox and someacnt like this.
RanzigFettreduziert
in reply to Kris • • •like this
univers3man, TeryVeneno, Starfighter, Hubi, Lazycog, 9bananas, pjusk and someacnt like this.
Takapapatapaka
in reply to RanzigFettreduziert • • •like this
Lazycog, herrcaptain, acockworkorange, mad_lentil and someacnt like this.
Kris
in reply to Takapapatapaka • • •like this
RanzigFettreduziert, Blaze (he/him), TeryVeneno, Takapapatapaka, ᴍᴜᴛɪʟᴀᴛɪᴏɴᴡᴀᴠᴇ, db0, Match!!, curbstickle, Hubi, Lazycog, irelephant [he/him], herrcaptain, qaz, Five, ThePinkUnicorn, 9bananas, arcterus, acockworkorange, riot, mad_lentil, pjusk, HootinNHollerin, ArcticDagger and someacnt like this.
perestroika
in reply to Kris • • •Thanks for the info, a healthy amount of real life awaits then. 😀
I knew it was running on solar energy and old hardware so I guessed something like this had happened. 😀
If you need fail-over to awaken a backup system when the primary fails, things can be designed. 😀
like this
PirateFrog, user_name, irelephant [he/him], Rentlar, Fizz and ℕ𝕖𝕞𝕠 like this.
PirateFrog
in reply to Kris • • •Alt of ProdigalFrog@slrpnk.net chiming in, thanks for giving us the sitrep, poVoq!
This is an unusually unlucky set of circumstances, but for the Solarpunks who find their way here, let's try to make the best of it. If you don't already have an alternative account somewhere, you may want to create one to use until we're back up and running. lemmy.dbzer0.com, sopuli.xyz, or lemmy.cafe are some solid choices to consider. After that, you may want to favorite poVoq's post here so you can check back on any news.
Even without our home base, we can still share the solarpunky stuff we find and create around the threadiverse (though as Tofu mentioned, maybe this could be a time to take a breather to be refreshed when we come back 😄).
Besides, if the past is any indication, time will fly by and we'll be back before you know it!
like this
ᴍᴜᴛɪʟᴀᴛɪᴏɴᴡᴀᴠᴇ, db0, Teal, Match!!, Lazycog, Scroll Responsibly, irelephant [he/him], MelodiousFunk, curbstickle, Initiateofthevoid, threelonmusketeers, Five, khaliso, blazeknave, Foxfire, skysurfer, riot, AccountMaker, pjusk and AlternateCatfox like this.
catloaf doesn't like this.
Kris
in reply to PirateFrog • • •like this
ᴍᴜᴛɪʟᴀᴛɪᴏɴᴡᴀᴠᴇ, Teal, Lazycog, Five, mad_lentil and AccountMaker like this.
tenchiken
in reply to Kris • • •Not sure about your area, but a wireguard accessible OOB connection is a great piece of kit to keep handy. I use a cheap 768kbps SIM in an Ethernet connected switch into my personal systems. It's saved my skin numerous times.
I'm sure this is obvious, especially in hindsight, but just mentioning because the existence of IoT LTE data plans for a minimal fee ( $100/year for me in Midwest US) was NOT obvious to me until 2 years ago.
like this
MelodiousFunk, psychepomp and Five like this.
Kris
in reply to tenchiken • • •like this
Lazycog, MelodiousFunk and Five like this.
mad_lentil
in reply to Kris • • •Might it also be possible/feasible to send an "email blast" to everyone with a slrpnk.net account? It would probably be quite complicated to send that many emails at once without getting blocked by the major email providers, but hypothetically we've all registered with emails...
Just spitballing ideas for the future. Everything's fine now. Gives me an excuse to spend a little more time on the Canadian end of the fediverse. 😀
AccountMaker likes this.
Kris
in reply to mad_lentil • • •As email in profile is an optional feature on our instance about 50% of the userbase opted to not share one so we would only reach some people. But yes, getting spam filtered would be another problem of mass-mailing.
But I found a way to put up a simple html error page and will add this later to inform our members and link to this thread.
Lazycog
in reply to PirateFrog • • •like this
PirateFrog and threelonmusketeers like this.
grue
in reply to Kris • • •Sounds like your 'bus factor' is too high and you need a few more backup admins.
MyOpinion likes this.
don't like this
Mia and catloaf don't like this.
Sergio
in reply to Kris • • •Hey fellow slrpnk.net refugees... if you're looking to recreate your list of subscribed communities, here's a good place to start:
::: spoiler click here for a list of communities that are NOT politics, tech, or meme -related.
Most are currently active (except for the ones with a * which were less active last I checked) Sometimes politics, tech or memes sneak in but they're not the focus.
GENERAL DISCUSSION / QUESTIONS
ART / PHOTOS
- !artporn@lemm.ee
- !astrophotography@lemmy.world
- !accidentalrenaissance@lemmy.blahaj.zone
- !badrealestate@feddit.uk *
- !collage@lemmy.ml *
- !desire_paths@sh.itjust.works
- !fakehistoryporn@lemmy.world *
- !fediclicks@viewfinder.pro *
- !filmsframes@lemmy.world
- !foodphotos@sh.itjust.works *
- !gameart@sopuli.xyz
- !grasweeti@slrpnk.net
- !hmmm@lemmy.world
- !imadethis@lemm.ee
- !imaginary@reddthat.com
- !inhabitedbeauty@lemmy.world
- !liminalspace@lemmy.world
- !mobile_wallpaper@lemmy.dbzer0.com
- !nocontextpics@lemmy.world
- !pics@lemmy.world
- !pictures@lemm.ee
- !pixelart@retrolemmy.com
- !pixelart@lemmy.ml *
- !sillydrawingrequests@sopuli.xyz
- !traditional_art@lemmy.world
- !trams_trolleys_streetcars@lemmy.blahaj.zone
- !wallpapers@lemmy.ca
- !52weeksofart@lemmy.world
ANIMALS
- !bats@lemmy.world
- !catposting@lemmy.blahaj.zone
- !cat@lemmy.world
- !catsstandingup@lemmy.world *
- !opossums@lemmy.world
- !scrungycats@lemmy.world *
- !superbowl@lemmy.world
COMICS / GRAPHIC NOVELS
- !alanmoore@feddit.uk *
- !comics@lemmy.blahaj.zone
- !comicstrips@lemmy.world
- !eurographicnovels@lemm.ee
- !truecomics@midwest.social *
- !garfield@lemmy.world
- !outofcontextcomics@lemmy.world
- !unix_surrealism@lemmy.sdf.org
ENTERTAINMENT
- !80smusic@lemmy.world
- !90smusic@lemmy.world
- !90s_tv@lemmy.sdf.org
- !badmovies@lemmy.world
- !bmoviebonanza@lemmy.world
- !Bside@fedia.io
- !boardgames@sopuli.xyz
- !cultfilms@lemux.minnix.dev *
- !dwarffortress@lemmy.ml
- !edm@reddthat.com
- !fullmoviesonyoutube@lemm.ee
- !iasip@sh.itjust.works
- !martialartsmovies@lemm.ee *
- !metal@lemmy.world
- !movies@lemm.ee
- !music@lemmy.world
- !pokemon@lemm.ee
- !pokemon@lemmy.world
- !pokemongo@lemmy.world *
- !ska@lemmy.blahaj.zone
- !thrashmetal@lemmy.world
- !trailers@lemmy.blahaj.zone
GENRES / STYLES
- !cassettefuturism@lemm.ee
- !cosmichorror@lemm.ee
- !cyberpunk@lemmy.zip
- !fuckyournelsonlamp@lemmy.world *
- !goblincore@lemmy.blahaj.zone
- !gothindustrial@lemmy.world
- !lovecraft_mythos@lemmy.world
- !mullets@lemmy.ca *
- !punk@lemmy.world
- !punk_rock@lemmy.ca
- !raygungothic@lemm.ee
- !streetwear@lemmy.world *
- !vampires@lemmy.zip
- !weirdcore@sopuli.xyz
- !witchcraft@lemmy.ml *
- !witchesvspatriarchy@lemmy.ca
HISTORY
INFORMATION / KNOWLEDGE
- !buyitforlife@slrpnk.net
- !catastrophicfailure@lemmy.world *
- !creepywikipedia@lemmy.world
- !dataisbeautiful@lemmy.ml
- !documentaries@lemmy.cafe
- !esa@feddit.nl
- !explainlikeimfive@lemmy.world
- !goodnewseveryone@sh.itjust.works
- !humanities@beehaw.org
- !interestingasfuck@lemmy.world
- !math@lemmy.world
- !mealtimevideos@lemmy.cafe
- !recommendations@lemmy.world
- !solarpunk@slrpnk.net
- !thingscutinhalf@lemmy.world
- !til@lemmy.world
- !vexillology@lemmy.world
- !whatisthisthing@lemmy.world
- !wikipedia@lemmy.world
- !youshouldknow@lemmy.world
OTHER
- !andfinally@feddit.uk
- !academiagonewild@lemmy.world *
- !internetisbeautiful@lemm.ee
- !mildlyinteresting@lemmy.world
- !nowhereelsetoshare@sh.itjust.works
- !pbsod@lemmy.ohaa.xyz
- !publictransport@slrpnk.net
- !stick@sh.itjust.works *
- !sumo@lemmy.world *
- !shortstories@literature.cafe
- !treehuggers@slrpnk.net
- !the_heinlein_society@lemmy.world
- !woahdude@lemmy.world *
- !youcantparktheremate@feddit.uk *
FEDIVERSE
- !fedibridge@lemmy.dbzer0.com
- !fedigrow@lemm.ee
- !fediverse@lemmy.world
- !fediverse@piefed.social
- !fediverselore@lemmy.ca
- !lemmyapps@lemmy.world
- !comm_revival@lemmy.dbzer0.com *
- !yepowertrippinbastards@lemmy.dbzer0.com
FINDING NEW/GOOD COMMUNITIES ON LEMMY
- !communities@ponder.cat
- !communitypromo@lemmy.ca
- !findacommunity@lemmy.ml
- !index@lemmy.world *
- !lemmy411@lemmy.ca
- !newcommunities@discuss.online
- !newcommunities@lemmy.world
- !trendingcommunities@feddit.nl
- !wowthislemmyexists@lemmy.ca *
:::
::: spoiler click here for a list of (mostly non-political) meme communities
MEMES, SOCIAL MEDIA REPOSTS, AND HUMOR
Most of these are currently active. (except for the ones with a * which were less active last I checked). Sometimes these include politics but that's not the sole focus.
:::
(luckily I was posting this to newcomers whenever I had the chance...)
like this
DeathByDenim, Culf, Crankenstein, MelonYellow, unprovenbreeze and pjusk like this.
PirateFrog
in reply to Sergio • • •ocean
in reply to Kris • • •I this it’s a law that servers run 100% perfect until the literal day one leaves town with zero way to return home. One of the many reasons I got all my services off of unraid.
Very cool to learn you’re running your own machines. Do you go into detail about this anywhere?
like this
paris, Something Burger 🍔, plyth, pjusk, AlternateCatfox and sgibson5150 like this.
Kris
in reply to ocean • • •We have a small write up about the hardware on our wiki, but it is also down right now.
I think we will share a post-mortem write up of the actual improvements we will do to avoid this in the future.
One thing I will definitly do is to add a KVM remote management console to one of our server boards and move the main firewall into a VM with hardware passthrough of the NICs (this was anyways planned for a 10gbit network upgrade for the second half of 2025). This way I should be able to reboot and even reinstall the main ingress point remotely, so that only the fiber gateway remains as a failure point that requires physical access.
like this
paris, skaffi, AlternateCatfox, sgibson5150, MelodiousFunk and ocean like this.
skaffi doesn't like this.