#United States #Austin #Keysight Technologies #NSS Labs #AI Protection Systems

Keysight Technologies Joins NSS Labs in Pioneering AI Security Testing

In an increasingly digital world, the need for robust security measures for artificial intelligence systems has never been more pressing. Recently, NSS Labs, a respected name in cybersecurity testing, announced an exciting partnership with Keysight Technologies. Keysight will serve as the lead partner in NSS Labs' groundbreaking new initiative, the AI Protection Systems (AIPS) security testing program.

The Significance of AI Security

As artificial intelligence (AI) continues to permeate various sectors—including finance, healthcare, government, and critical infrastructure—the security of these systems is becoming a priority for organizations worldwide. Despite the rapid deployment of AI models and applications, there has been a significant gap in independent validation of the technologies designed to secure these deployments. Known as AI guardrails, these technologies are essential for preventing misuse and protecting data integrity.

To address this critical need, NSS Labs is launching a comprehensive and independent evaluation program dedicated to these AI Protection Systems. The initiative is set to establish a transparent and rigorous methodology for assessing how effectively these systems can safeguard AI applications from real-world threats while ensuring operational integrity.

What Does the AIPS Testing Program Entail?

The AIPS testing program will assess security products across seven critical dimensions. This comprehensive evaluation includes:

• - Malicious Input Attacks: Testing how systems respond to adversarial inputs designed to exploit weaknesses.
• - Output Risks: Analyzing potential exposures of sensitive data through AI-generated outputs.
• - System Resilience: Measuring how well systems can withstand attempts to disrupt their operations.
• - Policy Enforcement Accuracy: Gauging the effectiveness of systems in enforcing security policies.
• - Agentic AI Security: Ensuring that AI systems effectively manage tools and capabilities without succumbing to manipulation.
• - Observability and Audit Capabilities: Verifying the transparency of AI systems in their operations and outcomes.
• - Performance and Scalability Impact: Understanding how security measures affect system performance under varying loads.

Each of these dimensions will involve running hundreds of thousands of individual test cases, with scenarios crafted to challenge and assess the efficiency of AI Protection Systems. These challenges will cover various techniques, including prompt injection attempts, sensitive data extraction endeavors, and more, designed to mimic real-world adversarial attacks.

Vision for a Secure AI Future

Vikram Phatak, CEO of NSS Labs, emphasized the urgency of this initiative by stating, "AI is rapidly becoming core infrastructure for the digital economy, and with that comes an urgent need for independent validation of the technologies designed to protect it." He conveyed optimism about the partnership with Keysight, suggesting it would pave the way for greater understanding of AI protection systems.

Ram Periakaruppan, Vice President and General Manager at Keysight, echoed this sentiment, highlighting the essential role of transparent, independent validation in building trust in AI technologies. He noted that Keysight's expertise in crafting scalable test environments positions them uniquely to contribute to this critical field of study.

Moving Forward with AIPS

As the initiative progresses, NSS Labs is welcoming feedback from both enterprises and security vendors. This collaborative approach will help refine the AIPS methodology, set to be published this April. By providing a credible benchmark for validating AI security solutions, NSS Labs aims to arm enterprises with the data needed to make informed choices about their AI investments.

In conclusion, the collaboration between NSS Labs and Keysight Technologies marks a significant step towards securing AI applications across various industries. Through rigorous testing and validation processes, this partnership seeks to enhance the resilience and reliability of AI systems, ensuring that organizations can confidently leverage these technologies in their operations.

For further information, please visit NSS Labs at their official website.