Blue Screen Of Death Hits the North Coast: St. Joseph’s Is Having Issues, But Mad River Hospital Remains Online

By Microsoft Corporation - Jonathan Flusser on X (direct link), Public Domain, https://commons.wikimedia.org/w/index.php?curid=150527250

Screenshot of a blue screen of death as captured on a Windows Server machine with the faulty CrowdStrike driver installed. [By Microsoft Corporation – Jonathan Flusser on X (direct link), Public Domain

Many computer-reliant systems of commerce, data keeping, and organizing across the nation have gone dead to the world, at least temporarily, and Humboldt is no exception.

If you’ve ever had to bring your computer back from the brink of the ever-feared “Blue Screen of Death” you know how potentially debilitating a computer crash can be. Across the globe, the terrifyingly frozen blue screen has derailed business, travel and everyday functions for computer-reliant systems from Humboldt to, well, nearly anywhere you can think of.  The international technology snafu resulted from a single defect in an overnight cybersecurity update, which, when coupled with computers running Microsoft’s Windows operating system, causes a computer system to stop functioning has sent shockwaves through the digital landscape, resulting in the disruption of critical internet services worldwide. 

The root of the issue was identified by CrowdStrike, a leading cybersecurity company catering to global giants, which attributed the widespread outages to a flawed software update rather than a deliberate cyberattack or state-sponsored interference. As explained by a spokesperson from the American Hospital Association to Axios, several U.S. hospitals and health care systems encountered disruptions, prompting federal authorities to assess the potential ramifications on government entities.  Humboldt was no exception, with Providence St, Joseph Hospital, which relies on software called “Epic” being hit by the paralyzing software update. 

Rainy weather at Providence St. Joseph Hospital in Eureka.

Rainy weather at Providence St. Joseph Hospital in Eureka. [2023 Photo by Ryan Hutson]

When we requested information, Providence confirmed that they are experiencing the dreaded update failure, and replied that they are working to restore full functionality, saying, “Providence, like other organizations across the world, is impacted by the Crowdstrike outage. Our IT teams have been working overnight to respond to the issue and have restored key functionality in the Epic electronic health record so that nurses, physicians and other caregivers can access patient records and perform clinical documentation.”

Providence explained that the problem is negatively impacting their ability to provide services, explaining that “other clinical applications and workstations continue to be impacted, and our IT teams are working to restore these services as soon as possible. Patient safety and access to care is always the top priority at Providence,” and added that the hospital will provide updates. 

North of St. Joes, officials at Mar River Hospital in Arcata assured us that they are still up and running, and have not been impacted by the debilitating computer glitch. 

Larry Wood, Safety Officer and Emergency Preparedness Coordinator for Mad River Community Hospital said by phone Friday night that the hospital was not affected.. Wood explained that Mad River Hospital was not impacted by the CrowdStrike software glitch. Wood said, “We are fully functioning in all depts – anyone has an emergency, please don’t hesitate to come in.”

Wood wanted to make it clear that the hospital doors were open. “We are ready and willing to assist our neighboring hospitals where we can,” said Wood. “We are up and running in all areas. However we can help, we are here to serve the community,” he said, as he explained that if needed, Mad River could assist St. Joes if it were needed during the temporary technology breakdown.  

Due to having an independent server and using different software than those that were linked to the update, the hospital remains online in all departments. “We are independent, we have our own in-house IT that manages our antivirus and firewalls,” Wood said, explaining that the software was different from that used by Providence. 

Some government agencies in Humboldt County have been affected also. The Humboldt County library for instance. They reported early Saturday, “County Information Technicians have been able to restore most government computers to full function, including those that serve you at the Libraries. Blue Lake and Trinidad Libraries are the last – they are getting attention today and their computers will be working sometime this afternoon.”

According to the Times Standard, 911 was not affected in Humboldt County. However, “Cati Gallardo, spokesperson for Humboldt County said in an email Friday some computer systems were affected. The IT department restored services at the Sherriff’s Dispatch and the jail to be fully operational Thursday night and is working with other departments to get all systems fully functional, with critical services prioritized, she said.”

According to reporting by Axios, this digital collapse might not be remedied immediately for  those it has impacted. experts anticipate that affected organizations may remain offline for an extended period of time, according to , possibly stretching into days. The incident, marked by the emergence of the dreaded “Blue Screen of Death,” prevented users from accessing their computers, effectively barricading them from their systems until an alternative access route could be established.

CEO of CrowdStrike, George Kurtz, shed light on the predicament, attributing the blue screen to a software glitch embedded in an update for the company’s endpoint security product, with Windows systems bearing the brunt of the impact. Despite CrowdStrike’s recommendations to tackle the issue, the manual nature of the resolution process, according to reporting by Axios, has posed a notable challenge. Omer Grossman, CIO at Israeli cyber company CyberArk, emphasized the arduous nature of the task in his correspondence, stating, “Because the endpoints have crashed — the Blue Screen of Death — they cannot be updated remotely, and the problem must be solved manually, endpoint by endpoint. This is expected to be a process that will take days.”

For those who are impacted, like many airports across the world, for example, the correction could be as simple as a reboot, however for other companies and affected systems, it could take longer.  According to a recent article by the Associated Press, “The breadth of the outages highlighted the fragility of a digitized world dependent on just a few providers for key computing services.” The article counts hospitals, airports, and “governments” as some of the worst impacted, alongside other troubling instances of tech failure such as the Australian news network Sky News, which was off the air temporarily as a result of the failed digital update. 

While going into specific examples of chaos around the world, the article also states clearly, “It was not the result of hacking or a cyberattack, according to CrowdStrike, which apologized and said a fix was on the way.”

Facebooktwitterpinterestmail

Join the discussion! For rules visit: https://kymkemp.com/commenting-rules

Comments system how-to: https://wpdiscuz.com/community/postid/10599/

Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

31 Please improve the conversation by disagreeing thoughtfully and backing your claims with facts
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Medical person
Guest
Medical person
1 year ago

Woooaaa!!! Reading your headline it sounds like the primary regional hospital is out of service. Computers are a mess but all services are in place. Computers are down, not medical service. Telling otherwise could cause fatal misunderstandings

Akasha
Guest
Akasha
1 year ago
Reply to  Medical person

Mad River Hospital is fully functional in case you didn’t read that.

Zipline
Guest
Zipline
1 year ago
Reply to  Akasha

MRCH has never been “fully functional.”

Zipline
Guest
Zipline
1 year ago
Reply to  Medical person

Talked to a provider who works at St. Joe and spent all day doing not much. The only computer that was functioning (one) was the one that was turned off during the “update”.

Apopa
Guest
Apopa
1 year ago

After this global event, it’s pretty certain that ‘crowdstrike” won’t be a leading cyber security provider to anyone. Hope they have good insurance.

Creosote
Guest
Creosote
1 year ago
Reply to  Apopa

The CrowdStrike update glitch was an incredibly simple and obvious coding mistake (attempting to overwrite data within protected memory space) and they have no excuses for not catching it in time. First, they should have automatic detection in place to catch this known issue (they didn’t) and second, they should never have deployed it globally without testing it first, locally. Doh!
Worse, the Crowdstrike remediation method requires a special boot sequence to a powershell environment to selectively delete certain .sys files that temporarily render Crowdstike penetration protection OFFLINE. Then a reboot happens, then another update, and then another reboot. During that time, the Windows server is WIDE OPEN to penetration attacks, as the Crowdstrike code is not fully active.
In other words, this Crowdstrike “bug” that took down infrastructure all over the world had the net effect of making potentially millions of servers DROP THEIR PROTECTION against cyber intrusions, at least temporarily.

Zipline
Guest
Zipline
1 year ago
Reply to  Creosote

Trained monkeys could do a better job.

Country Joe
Member
1 year ago
Reply to  Creosote

Thanks for your informative post…

c u 2morrow
Member
1 year ago
Reply to  Creosote

they’re hiring, if your interested.

Creosote
Guest
Creosote
1 year ago

Detailed explanationof the Crowdstrike update glitch by a Google engineer on X (warning: highly technical language)

https://threadreaderapp.com/thread/1814376668095754753.html

Ernie Branscomb
Guest
Ernie Branscomb
1 year ago
Reply to  Creosote

Thanks for the explanation.

Nothing is so foolproof that a sufficient fool can’t screw it up.

Maybe intentional sabotage?

Tangled Massocells
Guest
Tangled Massocells
1 year ago

My daughter tells me : “thanks for teaching me how to build a fire”. Another person said: “I looked up how to build a fire on Google”.

Mendocino Mamma
Guest
Mendocino Mamma
1 year ago

Perfect. Global links. Global connections. All on computer. No one capable of handwritten, personal services. NO PROBLEM!!! NOTHING TO SEE!!! UM…WE GOT A PROBLEM. Humanity has overlooked humanity in the name of “efficiency”Glitches are “not a big issue according to the team; simple code you non coadies!!!” Consider there is a lot more to life than codes and excuses for code failures. Keep a hard copy for your file!!! The next crash is a few clicks away.

Last edited 1 year ago
spamned
Guest
spamned
1 year ago

nah…we’ve overlooked ‘humanity’ for ‘capital’…
we are eating ourselves for money

Zipline
Guest
Zipline
1 year ago

You don’t need bullets, you don’t need bombs, you don’t need troops on the ground, you don’t need the military, which is no longer relative, if you want to destroy a nation all you need is a software engineer/hacker to shut down the internet for two weeks. Any nation/region that suffers this fate will cease to exist. We are addicted to our electronic way of life and when our machines stop working so do we.

Zipline
Guest
Zipline
1 year ago
Reply to  Zipline

Relevant.

melanopsin
Member
1 year ago
Reply to  Zipline

Bangladesh Is Experiencing a ‘Near-Total’ Internet Shutdown Amid Student Protests

https://tech.slashdot.org/story/24/07/19/2037213/bangladesh-is-experiencing-a-near-total-internet-shutdown-amid-student-protests

M Sills
Member
M Sills
1 year ago

This is a result of sending out a system wide update. YEARS AGO I was a gas station tech & SHELL oil got tired of paying for a tech to go to each site shut them down & update their POS system. SO one day, against the advice of the mfg, they set up a system wide update. As the station mgrs would close their END OF DAY on the POS (usually 11p or 12a) the update auto loaded & the Pc rebooted into the new software. Unfortunately, the update has a fatal bug and every station nationwide running this POS brand crashed. We techs were rolled out of bed in the night and had to rush to our local SHELL stations one by one & restore the POS sysytems. A VERY lessons learned situation.

(hey, I wonder if the mfg purposely put the bug in the new software to crash the stations so they could tell SHELL ‘told you so’?)

!

Tangled Massocells
Guest
Tangled Massocells
1 year ago
Reply to  M Sills

Can you get “the blue screen of death” on your Tesla?

spamned
Guest
spamned
1 year ago

my bank was unable to help me yesterday morning

glad I switched to linux moons ago

Bonnie
Guest
Bonnie
1 year ago

I am always amazed that people no longer know how to write like they used to when computers weren’t around. I am sure I am over simplifying this but if a patient needed care couldn’t they do it the old way and input it into the system when it is up and running again. I know it is time consuming but if everyone is just sitting around doing nothing at least it would be productive. Most folks know what meds they are on.

Yabut
Guest
Yabut
1 year ago
Reply to  Bonnie

They did mostly. Unfortunately they could, for example, take an xray but that xray is no long a film. It is digital and is sent for reading digitally. The xray machine probably still has the data but how would the radiologist review it? Maybe they can go to the machine’s display but maybe that is not good enough. Or maybe the radiologist is remote.
Or the patient’s history is stored digitally and the machines that let doctors and nurses look at it have died. Or laboratory readouts can not be viewed on the nurse’s stations computers. It just makes everything harder, if it is abpvailable at all.

Permanently on Monitoring
Guest
Permanently on Monitoring
1 year ago
Reply to  Yabut

Stuff can still be PRINTED and DELIVERED BY HAND to the Department…

My Daughter is a Software Engineer with an MS in Information Systems. I asked her about the causes of the “outage” and she said:

“Somebody got fired”…

CsMisadventures
Guest
CsMisadventures
1 year ago
Reply to  Bonnie

Part of the problem is Microsoft and it’s &%#$* constant and required updates you can only delay. As much as I like tech, we’re getting to a point that not only have we have such complex systems that are all constantly connected. We don’t have just one Achilles’s Heel, we have a thousand when systems break and IMO far too much computing power in things that really don’t need a chip of anything in them unless it’s a tortilla chip and salsa. There’s also millions of computers out there that might have this update still sitting and ready but haven’t been turned on just yet. A quick fix is to boot into safe mode or use a USB to boot from and roll back the update to a previous one. And of course, to get an update to the failed update, you have to be connected to the internet. Yay us!

Not this guys (Kurtz) first rodeo in global meltdowns. He used to be CTO of McAfee, who bought out his original security software when that meltdown in 2010 occurred. This outage cost him millions personally, and Cloudstrike stock took a big hit after almost doubling in value. I don’t like McAffee software that much either.

https://www.marketwatch.com/story/crowdstrike-ceo-george-kurtz-is-taking-a-32-million-personal-hit-from-stocks-drop-5bbaa944

He sure likes to make money though.
https://news.sky.com/story/from-wall-street-darling-to-firm-behind-the-worlds-worst-it-outage-who-are-crowdstrike-13181020

https://www.msn.com/en-us/news/technology/who-is-crowdstrike-ceo-george-kurtz/ar-BB1qiOBV

melanopsin
Member
1 year ago

Switch to Linux! Linux updates are not PUSHED. Users get notified of updates with a list. Admins can review the list for those that may affect their systems, before installing.

The Linux community is vast. Any update problems are quickly noticed. The benefit of such a large community is very fast posting of security fix updates, often within hours of discovery.

Bozo
Guest
Bozo
1 year ago
Reply to  melanopsin

Yeah… should have stayed with MS-DOS 3.1

melanopsin
Member
1 year ago
Reply to  Bozo

Or XP

CsMisadventures
Guest
CsMisadventures
1 year ago
Reply to  Bozo

Some code jockey friends of mine are laughing about this. How Southwest airlines system is so old, they couldn’t update it if they tried so they had zero problems. I heard that anyone still writing and using ancient COBOL language is getting their retirements well funded these days.

farfromputin
Member
1 year ago

God directs the sun to do these things when She gets bored

North westCertain license plate out of thousands c
Guest
North westCertain license plate out of thousands c
1 year ago

Mad River Hospital is a great place when you were injured.
I’ve been there twice.
They always treated me extra special.
I hated being there but glad I was in the hands of caring professionals.

Permanently on Monitoring
Guest
Permanently on Monitoring
1 year ago

Always remember:

MRH only hires the cheapest help they can find, and if a position is vacant, it may remain so, indefinitely…

MRH discriminates against elders, men, and anyone who wants competitive compensation…

Hell, they didn’t hire me, probably because I asked about the weather and wanted to know “where do people live around here?”