#debugging
Let's swap war stories. Here's teh screen that haunted me for a weekend: app logs looked healthy, heatlh check passed locally, restarting fixed it for about twenty minutes and then teh 502s came back lol turned out to be something embarrassingly small.…
help!! small conifg change, rolled out to EKS, and now the frnotend pod is looping: rollback would be easy but i wanna undersatnd what happened. restart counter keeps clmibing and my on call phone is buzzing. The change was just a couple of environment…
our Ruby job runner has been rock solid for a year. since heavy concurrency it dies every few minutes with this: no exception, no stack trace, teh supervisor just restarts it. customers get random failures and i have literally nothing to grep for 🤦 how do…
help!! this is a good thread. Imagine your phone buzzing in the middle of the night because a clients store is showing this to every visitor: thats the etnire page. front end and /wp admin both. i had auto upadtes on for plugins, so something udpated…
Every time i open a news sites video player, videos refuse to load xD i refreshed, celared cache, rebooted. My colleague on teh same network opens teh exact same page and it works perfectly. The only difference i can think of is that i have a bunch of…
small config cahnge, rolled out to AKS, and now the frontend pod is looping: rollback would be easy but I want to undrestand what happened :/ restart counter keeps climbing and my on call phone is buzzing. The change was just a couple of environment…
long time lurker first post lol I'm a backend dev, not a C person. Today my Ruby job runner started crashing after heavy concurrency, and all I get is: Our own code is plain high level code. I don't manage memory anywhere xD So how can it segfault? Is the…
Reproducible crash, at least. heavy concurrency kills the C++ API server instantly: i found a core file somewhere once but no idea what to do with it :D do i really need to learn gdb tonight? i can reproduce it in staging with the exact same input, which…
not gonna lie this is driving me nuts our Python worker with a C extension has been rock solid for a year. since heavy concurrency it dies every few minutes with this: no exception, no stack trace, the supervisor just restarts it. customers get random…
Deployed our cron job to GKE and it never becomes ready: kubectl get pods shows CrashLoopBackOff and a growing restart count. kubectl logs returns nothing at all. The same image runs fine with docker run on my laptop. Where do I look? The deployment manifest…
long time lurker first post lol deployed our worker pod to GKE and it never becomes ready: kubectl get pods shows CrashLoopBackOff and a growing restart count. kubectl logs returns nothing at all. The same image runs fine with docker run on my latpop. Where…
so annoyed rn deployed our database migration job to EKS and it never becomes ready: kubectl get pods shows CrashLoopBackOff and a growing restart count. kubectl logs returns nothing at all. The same image runs fine with docker run on my laptop. where do i…
our Python worker with a C extension has been rock solid for a year. since heavy concurrency it dies every few minutes with this: No exception, no stack trace, teh supervisor just restarts it. Customers get random failures and i have literally nothing to…
new to Kubernetes, please be gentle :D my frontend pod on k3s won't stay up: The status says CrashLoopBackOff... i googled it and it seems to just mean it crashes a lot. Thanks, Kubernetes. How do i find out WHY? i can see the pod, i can see the restart…
help!! i run a small business and customers keep emailing that on our project management board, the page goes completely blank. our developer cannot reproduce it on any of his devices. one customer sent a screenshot and i spotted an ad blocker in their…
so annoyed rn i run a small business and customers keep emailing that on a news sites video player, the layout is scrambled. Our developer canont reproduce it on any of his devices. one customer sent a screenshot and I spotted an ad blocker in their toolbar…
guys pls help reproducible crash, at least... the new OS image kills teh Ruby job runner instantly: i found a core file somewhere once but no idea what to do with it. Do i really need to learn gdb tonihgt? I can reproduce it in staging with the exact same…
ok so im a backend dev, not a C person, today my C++ API server started crashing after a library upgrade, and all I get is: Our own code is plain high level code. i dont manage memory anywhere. So how can it segfault? Is the server hardware dying? my manager…
ugh. small config change, rolled out to k3s, and now the worker pod is looping: rollback would be easy but i want to understand what happened. restart counter keeps climbing and my on call phone is buzzing. The change was just a couple of environment…
ok so i run a small business and customers keep emailing that on our project management board, the page goes completely blank. Our developer cannot reproduce it on any of his devices. One customer sent a screenshot and i spotted a dark mode extension in…
new to Kubernetes, please be gentle. my database migration job on EKS wont stay up: the stauts says CrashLoopBackOff... i googled it and it seems to just mean it crashes alot.. :D thanks, Kubernetes... how do i find out WHY? I can see teh pod, I can see the…
this one is personal. a government form has been unusable for me for days: videos refuse to load. i was about to write an angry message to their support. then i opened a private window on a whim and everything worked 🔥 so its something in my normal browser…
I run a small business and customers keep emailing that on our project management board, forms submit twice :) Our developer cannot reproduce it on any of his devices. One customer sent a screenshot and i spotted a dark mode extension in their toolbar. Is it…
ok weird one i run a small business and customers keep emailing that on our project management board, buttons do nothing. our developer cannot reproduce it on any of his devices. One customer sent a screenshot and i spotted a password manager extension in…
i run a small business and customers keep emailing that on my online stores checkout, the layout is scrambled, our developer cannot reporduce it on any of his devices. one customer sent a screenshot and i spotted a dark mode extension in their tooblar, is it…
