The race to harness the power of AI is on, and with it, a new set of challenges for business security. As AI tools become integral to operations, the potential for data breaches and security vulnerabilities increases exponentially. This is particularly concerning given the rapid pace of AI adoption and the limited security measures in place.
The recent Vercel security breach, caused by an employee connecting a third-party AI tool to their corporate Google account, highlights the risks associated with under-managed AI software supply chains. This incident exposed a vast amount of sensitive data, including database credentials, API keys, and third-party integrations, simply because an AI tool was granted access to read software environment variables.
The issue extends beyond the use of unvetted AI tools. Many employees, including senior managers and executives, use unapproved AI tools on the job, often without the company's knowledge. These tools frequently rely on open-source components, which can contain significant security flaws. The flow of information between micro-services, LLMs, and database servers can be challenging to track, leading to potential connections and permissions vulnerabilities.
Moreover, the risk of intentional data poisoning by cyberattackers is a growing concern. By inserting false or misleading information into training data, attackers can manipulate AI models to provide incorrect answers, leak sensitive information, or exhibit biased behavior, even when the models appear to be functioning normally.
As agentic AI becomes more prevalent, the risks escalate. These AI agents, capable of performing complex tasks without oversight, can be exploited for sophisticated and devastating attacks if compromised. This is a critical issue for founders who are under pressure to scale their businesses quickly.
The current state of AI security is alarming. According to a report by cloud and AI security solutions provider Wiz, while 87% of security professionals use AI services, only 13% have an AI-specific security strategy. This disparity indicates a significant gap between the enthusiasm for AI adoption and the implementation of adequate security measures.
This lack of information and oversight creates a challenging environment for founders. As many as 80% of workers use unvetted AI tools, and the problem is not limited to lower-level employees. Senior managers and executives often have even higher rates of unapproved AI usage, further exacerbating the security risks.
To address these challenges, companies must take a proactive approach to AI security. This includes implementing robust security strategies specifically tailored to AI, ensuring that all AI tools are thoroughly vetted and approved, and providing comprehensive training to employees on AI security best practices. By doing so, businesses can harness the benefits of AI while mitigating the risks associated with under-managed AI software supply chains.