Monday, October 04, 2021

 

Gone in Minutes, Out for Hours: Outage Shakes Facebook

When apps used by billions of people worldwide blinked out, lives were disrupted, businesses were cut off from customers — and some Facebook employees were locked out of their offices.

...Within minutes, Facebook had disappeared from the internet.

[Imagine that: Just BOOM you disappear from the INTERNET! Christ.]

...the cause of the outage remained unclear. It was unlikely that a cyberattack was the culprit because a hack generally does not affect so many apps at once, said two members of Facebook’s security team, who spoke on the condition of anonymity. Security experts said the problem most likely stemmed instead from a problem with Facebook’s server computers, which were not letting people connect to its sites like Instagram and WhatsApp.
...
Inside Facebook, workers also scrambled because their internal systems stopped functioning. The company’s global security team “was notified of a system outage affecting all Facebook internal systems and tools,” according to an internal memo sent to employees and shared with The New York Times. Those tools included security systems, an internal calendar and scheduling tools, the memo said.

Employees said they had trouble making calls from work-issued cellphones and receiving emails from people outside the company.

[This is getting to be a little funny.]

Facebook’s internal communications platform, Workplace, was also taken out, leaving many unable to do their jobs. Some turned to other platforms to communicate, including LinkedIn and Zoom as well as Discord chat rooms.

Some Facebook employees who had returned to working in the office were also unable to enter buildings and conference rooms because their digital badges stopped working. Security engineers said they were hampered from assessing the outage because they could not get to server areas.

Facebook’s global security operations center determined the outage was “a HIGH risk to the People, MODERATE risk to Assets and a HIGH risk to the Reputation of Facebook,” the company memo said.
...
John Graham-Cumming, the chief technology officer of Cloudflare, a web infrastructure company, said in an interview that Monday’s problem was most likely a misconfiguration of Facebook’s servers.

Computers convert websites such as facebook.com to numeric internet protocol addresses, through a system that is likened to a phone’s address book. Facebook’s issue was the equivalent of removing people’s phone numbers from under their names in their address book, making it impossible to call them, he said...

“It was as if Facebook just said, ‘Goodbye, we’re leaving now,’” Mr. Graham-Cumming said.