From an article by my colleagues and me:
For generative AI (GenAI) apps to deliver real business value, they need access to your company’s proprietary data. Without it, models default to the public data they were trained on–meaning you get the same generic ideas as your competitors. If everyone is starting with the same new ideas, competitive advantage disappears. This is exactly like hiring an outside consultant and refusing to show them how your business actually operates.
APIs are the predominant way to give GenAI apps access to this crucial data. This is leading to a massive proliferation of custom endpoints that are skipping rigorous security checks, governance, and cost analysis. This phenomenon is not new. In fact, it’s the classic enterprise adoption pattern whereby teams prioritize features and speed over safety and oversight. This AI sprawl is introducing immediate and serious security problems. Thankfully, those problems can be solved with a proven approach and existing tools. But first, we must acknowledge the scale of the risk they pose.
Once you hook-up to your core business and your unique, secret data, then it’s time for shields up, eh? Here you go:
VMware Tanzu Platform, built on Cloud Foundry, benefits from a strong foundation of existingsecurity and compliance features. Enhancing this security, Tanzu Platform incorporates an enterprise-grade API gateway based on Spring. This gateway offers robust traffic filtering and routing, along with essential enterprise capabilities, such as integrated security (OAuth2/JWT, SSO, HMAC), advanced traffic control (multi-factor rate limiting and traffic replay), extensions for API standards (OpenAPI, gRPC, GraphQL), and request/response content transformation and removal.
We recently launched Tanzu Platform 10.3, which offers enhanced AI observability and control. By using the AI services tile within Tanzu Platform to run your AI models or coding assistants, you gain crucial capabilities like access control, rate limiting, and quota management. These features help you ensure that only authorized personnel have access and help prevent resource overspending.
In addition, platform engineers can centralize security intelligence and gain a detailed view of risk exposure through the newly introduced Vulnerability Insights Dashboard in Tanzu Hub. This dashboard provides vital information, including CVE criticality, patch levels, and environmental exposure for all Tanzu Platform components, enabling teams to rapidly triage, prioritize, and remediate security risks. The platform also allows teams to download the software bill of materials (SBOM) for all deployed Tanzu Platform components.
Check out the rest of the piece, and why not TryTanzu.ai?