Amazon has its internal AI safety tests independently reviewed by nonprofit AVERI
Amazon partnered with the independent nonprofit AVERI to audit the quality of its own internal safety-evaluation datasets for its AI models, not just the models' outputs. AVERI reviewed a random, anonymized sample of safety-test prompts covering areas like harmful content, cybersecurity, privacy and copyright. The review confirmed strong topical coverage, diverse testing methods and low contamination risk, but flagged gaps in multilingual coverage and multistep adversarial testing. Amazon responded with four concrete changes to its evaluation process.