Good piece on enterprise AI security. The good news, it’s all the same shit. The bad news news, it’s all the same shit. Yes, and:
That’s it! The magic sauce is that LLMs are amazingly good at taking this big chunk of text and using their vast training data to produce the most appropriate next chunk of text - and the vendors use complicated system prompts and extra hacks to make sure it largely works as desired.
Running your AI stuff in a locked down VM and locked down container is probably a really good idea. Running your AI stuff in a locked down container is probably a really good idea.
We’ve been doing that exact thing for 10+ years in the most security paranoid environments (and others who are bit more chill: TryTanzu.ai for 90 days.