ArchiTECHt Daily: Risk and regulation are where the rubber meets the road for AI

Yesterday, I linked a Harvard Business Review story discussing the trade-off that AI companies need t
ARCHITECHT
ArchiTECHt Daily: Risk and regulation are where the rubber meets the road for AI
By ARCHITECHT • Issue #49 • View online
Yesterday, I linked a Harvard Business Review story discussing the trade-off that AI companies need to make between perfection and good-enough. It’s a good point, and one that struck me while reading a couple of health care press releases—one about a partnership between Philips and an AI startup called PathAI around breast cancer diagnosis, and another about a partnership between Samsung and an AI startup called MedyMatch around real-time stroke-and-brain-bleed diagnosis. 
There are a ton of research papers about using deep learning to analyze medical images and diagnose conditions, but that hypothetical “this-is-very-promising” feeling morphed into something resembling unease with the prospect of this stuff actually being applied in the wild. It was especially true with the stroke situation, where decisions need to be made in real time in order to prevent brain damage. It also did not escape me that the partnership between Samsung and MedyMatch is “pending regulatory approval” of the latter’s technology.
I’m assuming that regulators want to make sure the algorithms are accurate, which is a good thing to ensure. But per the HBR authors, where do they draw that line? Seventy-five percent? Ninety percent? One hundred percent? How this compares to the accuracy of humans and other technologies on the same task also seems relevant.
What worries me more than accuracy, though, are the externalities. What happens if, down the line, doctors start relying too much on the AI and either forget what they’ve learned or never really amass the kind of knowledge learned only through experience. Nick Carr wrote a whole book about topic, and countless others have weighed in on it, but we’re at the time now where automation is really kicking into high gear—including in professions such as health care, law and banking.
It’s also worth considering the level of blowback that will follow any high-profile mistakes or other issues caused by AI in a field like medicine. Take driverless cars as an example. Humans crash cars ALL THE TIME—I saw three separate accidents involving at least eight cars while driving my kid home from skating lessons last night—but it’s major news when an autonomous driving system does the same. Regulators and politicians need to so some serious thinking about what level of perfection we expect from AI systems—in automobiles and elsewhere—and where we’re willing to place the blame when something goes wrong.
The big question isn’t whether AI and automated systems will be better than humans at certain things—they will—but, rather, how logically and fairly human systems react when something goes wrong. If the risk of adopting AI is too high for either consumers or companies, then uptake might be slower than we’d all like to see.
I couldn’t find a good place to fit this news about about targeted phishing attacks on prominent GitHub developers, so I’m just including it up here. There are many scary things about the methods and the actual malware, but the scariest part might be the Dimnie trojan’s roots in espionage. Depending on who’s behind the attacks, the particular GitHub repos might not be the ultimate target, but rather the internal networks and IP of the large companies for which those developers work.

If you enjoy the newsletter, please help spread the word via Twitter, or however else you see fit.
If you’re interested in sponsoring the newsletter and Architecht Show podcast, please drop me a line.
You can get all Architecht content direct via Feedly here:
What's new on Architecht
How simplicity can help containers actually improve cybersecurity
Around the web: Artificial intelligence
Source: Instacart
Source: Instacart
Sponsor: Marshal.io
Sponsor: Marshal.io
Around the web: All things data
Around the web: Cloud and infrastructure
Did you enjoy this issue?
ARCHITECHT

ARCHITECHT delivers the most interesting news and information about the business impacts of cloud computing, artificial intelligence, and other trends reshaping enterprise IT. Curated by Derrick Harris.

Check out the Architecht site at https://architecht.io

Carefully curated by ARCHITECHT with Revue. If you were forwarded this newsletter and you like it, you can subscribe here. If you don't want these updates anymore, please unsubscribe here.