云端AI代理的安全与自由担忧

原话 · @匿名

Personification of AI is what’s going to get us in the end. I think we need to draw a hard line in the sand over this. An AI didn’t hack into a company, the engineer set an automated tool to. An AI didn’t make an egregious security mistake, the engineer did. We can’t blame the chisel for messing up our sculptures, when where just throwing the hammer!

原话 · @匿名

There's a number of science fiction scenarios where the public internet becomes so vile a place that it simply becomes unsafe to be there. The problem is that, in general, if you can get a bit from here to there, then you're going to be vulnerable to the possibilities of malicious communication. But we're going to want our AI agents to be able to get from here to there for a lot of "there"s; what's the value of an agent that can't speak to anyone? Much, much less than one locked away in a prison. There isn't going to be a solution where we just lock them away and we just try really, really hard to filter everything they're doing. They're too smart for that already and we only want them smarter.

原话 · @匿名

You don't need to do this on a cloud, you can get the same type of VM and network jail running on your own computer. The important parts are: 1. a VMM hypervisor 2. a network proxy / gateway. Use your favorite VMM / hypervisor (likbrun, smolvm, microsandbox, etc). They give you control over the network interface or let you inject your own network layer. The network proxy can handle all the ingress/egress rules, credential injection, etc. It's still not user friendly to do all this. I think the next version of operating systems will have each "agentic process" be a bundle of VM, files in the VM, and network rules.