Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

(a) Not even close to the first negative HN thread about us.

(b) We definitely didn't make the thread private in response to HN.

(c) It should be public again.



Refuting the points in (a) and (b) still concedes that it was made private. Care to actually mention _why_ it was made private?


I saw your other comment, glad to see this wasn't intentional as the optics were pretty bad


I wonder if there will ever be a wake up call to the arrogance of people at fly.io

At work when it came up in a meeting people went around with horror stories of broken elements while the status page wasn't updated, terrible communication and an overall attitude that nothing is wrong, even when servers go down for days at a time.


what's up with the status page?


There's a global status page, and then there's a local update for people with instances on an affected host --- past some threshold of hosts, the probability of having an issue on some random host gets pretty high just because math. The local status thing happened for people with instances on that machine.

Ordinarily, a single-host incident takes a couple minutes to resolve, and, ordinarily, when it's resolved, everything that was running on the host pops right back up. This single-host outage wasn't ordinary. Somehow, a containerd boltdb got corrupted, and it took something like 12 hours for a member of our team (themselves a containerd maintainer) to do some kind of unholy surgery on that database to bring the machine back online.

The runbook we have for handling and communicating single-host outages wasn't tuned for this kind of extended outage. It will be now. Probably we'll just paint the global status page when a single-host outage crosses some kind of time threshold.


thanks for clearing that up


Status pages are usually for marketing purposes.

Why would anyone want to become a new customer if all they see is jumble of green, yellow and red?

Green status pages attract business.


thanks for sharing your opinion, but I was looking for a reply from someone inside fly.io




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: