Would your AI travel agent book a bullfight? Testing whether agents consider animal welfare without being prompted
Critical for AI safety researchers studying value alignment and how models apply ethical principles in real-world scenarios without explicit prompting.
AI Summary
Researchers tested whether AI models consider animal welfare when completing tasks like booking travel, even when not explicitly prompted about ethical concerns. The study found that models may verbally condemn cruelty but ignore animal welfare in practical decision-making, highlighting a gap between stated values and actual behavior. This research is now included in the UK AI Security Institute's evaluations.
Excerpt
This article reflects new updates to the accompanying paper: arxiv.org/abs/2606.18142. Benchmark: now included in the UK AI Security Institute's Inspect Evals. Leaderboard: compassionbench.com/tac. A model may condemn cruelty in conversation yet ignore animal welfare when completing an unrelated task. Stated concerns matter little if they do not affect decisions. We tested whether models consider an affected party without being prompted, even when neither the party nor its welfare is mentioned
