Ask HN: Speculate About a Hypothetical Cyber Exploit That Would Leverage AI
It seems kinda inevitable. Some modern-day equivalent of the latter-day Kevin Mitnick is bound to be out there somewhere. Wouldn't you think?
I was trying to imagine…
• What sort of AI-related exploit is more likely to be one of the first?
• What might be the nature of a cyberattack the black hat vibe coders might be vibing up for us?
Of course, I hope I'm wrong. I hope that all the MCP servers or whatever and the other AI network infrastructure is as secure as we're told they are. This is actually one area of research for me as a recently-minted DevSecOps engineer. Most cybersecurity attacks are relatively unsophisticated, and succeed by being scaled up so much they succeed on a few soft targets anyway - but a Ralph Wiggum loop on even a scaled up local edge model could make those kinds of techniques much, much more terrifyingly sophisticated for actors with that kind of hardware at their disposal. Abliterated models are of special interest here [1] because they make it even cheaper to do it at scale. It almost feels like we are seeing the digital analogue of the evolution of the flighted stinging insect, i.e. mosquitoes, bees, etc. They don't have to be very smart individually to absolutely decimate the population of megafauna. A tiny bit of economic intelligence goes a really long way here. Social engineering using AI generated content is likely already happening. AI just makes using existing script kiddie stuff easier. It's really funny that you said, "script kiddie". Before I edited my original draft of this post, I referred to them too :) > "…Social engineering…" I know Mitnick is synonymous with social engineering. This article in another post is right on the money with the kind of cyber attacks I had in mind, however: https://news.ycombinator.com/item?id=46605553