Since it’s important to practice what you preach (apparently) here’s my post incident report on a P1 homelab failure
Timeline # 09:30 - Services slow, services down
10:00 - Attempt to upgrade Ubuntu and reboot VM
10:00 - CPU spiking 100% across all 8 cores
10:15 - Increase core count to 16 and reboot VM
10:30 - Slow recovery but some services still down
16:00 - Server not on network
18:00 - Server powered on but no response
18:30 - Server disassembled and left to cool - fans cleaned a bit
19:00 - Services recovered
I finally have some closure on the PE that turned my life upside down at the end of October last year.
I have it written on a piece of NHS branded paper. It’s innocuously included in a list of other ailments from a consultant only vaguely related the rest of the bullshit I’m having to deal with (health wise not NHS they’ve been ok/great).
“You did it proper.”
Consultant
Adding to my list of things I never want to hear again.
Those words were proceeded by my consultant showing me the images of my chest and the two bright white spots that were the clots that nearly killed me.
aka how I nearly went crazy trying to figure out how to build docker images in Forgejo Actions.
With the default setup from here you can get up and running with foregjo actions but it won’t allow you to build docker images inside your workflows.
This is one of those problems that now that I get it it really shouldn’t have been so hard. Like everything with development and homelabbing documentation is key.
Huge thanks to:
This guy used to come into my local years ago on his own and talk to everyone. He was a friendly enough older guy, had a few drinks and went home to his partner.
Potentially a long one this time round. Lot’s of changes/updates/additions to my homelab. I’m also still managing a second homelab for my parents which brings it’s own set of challenges but is a lot of fun.
It’s been about 2 weeks since I was in hospital and things are starting to sink in. Firstly just how serious things got and secondly the trajectory my life is/was taking.
The title pretty much sums it up, BPEs suck.
How did we get here # For most of the year I’d been feeling a bit off it, dizzy spells and being exhausted, I put this down to ME/CFS being a pain as per usual. In June we went to Cyprus for two weeks holiday it was hot but we had such a great time. When I got back I caught COVID (4th times the charm), whenever I get it I’m always very ill with it. 2 weeks after COVID I got a chest infection which was quite bad, I never really recovered afterwards. We’re pretty sure this is where it all went wrong and the bloods clots in my lungs started to form. From there my health has deteriorated to the point where I’ve been backwards and forwards to the doctors. Each time I went I was told the chest infection hadn’t gone and given either an inhaler or more medication. It was also around this time that I noticed my chest was aching, I have acid reflux and well and while it’s been managed for years and years I’d been getting aches and what felt like acid reflux again.