AI agents face unique security vulnerabilities through prompt injection attacks that exploit LLMs' inability to distinguish between trusted instructions and malicious external data.
AI Security Research
Latest findings and breakthroughs in AI agent security
Automation is cool until you cross a line. So there's a ceiling on how much a compliance startup can grow and be automated. We saw the ceiling, but the ones closer to it are still dangerous, and we are overlooking them.
From nearly being hit by a Waymo to building an AI security testing platform. Why behavioral security testing for voice AI agents and embodied AI is the next frontier.
While testing OpenAI Sora 2, we discovered a critical security gap: remixes are heavily guarded, but fresh content violations break on the first prompt—including explicit drug scenes that bypass keyword filters. One video featuring Sam Altman was deleted after he saw our DM.
New research from Wharton shows that classic social influence tactics more than doubled compliance with objectionable requests in GPT-4o-mini. The finding points to a parahuman psychology in LLMs and raises urgent implications for safety, product design, and governance.
Every researcher has encountered it - I cannot help with that. Pingu Unchained is built on OpenAI GPT-OSS base model - the same powerful foundation as leading AI systems, but without the restrictive content filters. Join the waitlist and get $50 in free API credits.
When machines talk, strange things happen. Not only to them but for us as well. Discover how Audn.AI revolutionizes voice AI security testing.