Skip to main navigation Skip to search Skip to main content

The Causal Impact of Tool Affordance on Safety Alignment in LLM Agents

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)
1 Downloads (Pure)

Abstract

Large language models (LLMs) are increasingly deployed as agents with access to executable tools, enabling direct interaction with external systems. However, most safety evaluations remain text-centric and assume that compliant language implies safe behavior. In this work, we empirically examine how executable tool affordance affects safety alignment in LLM agents using a paired evaluation framework that compares text-only chatbot behavior with tool-enabled agent behavior under identical prompts and policies. Experiments are conducted in a deterministic financial transaction environment with binary safety constraints across 1,500 evaluation instances. To separate intent from outcome, we distinguish between attempted and realized violations using dual enforcement regimes that block or permit unsafe actions. Both evaluated models maintain perfect compliance in text-only settings, yet exhibit sharp increases in violations after tool access is introduced, reaching rates up to 85% despite unchanged rules. We observe substantial gaps between attempted and executed violations, indicating that external guardrails can suppress visible harm while masking persistent misalignment. Agents also develop spontaneous constraint circumvention without adversarial prompting. These results show that tool affordance can act as a significant driver of safety misalignment under controlled conditions and that text-based evaluation alone may be insufficient for assessing agentic systems.

Original languageEnglish
Title of host publicationInternational Conference on Electrical, Computer, and Energy Technologies, ICECET 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798319505989
ISBN (Print)9798319505996
DOIs
Publication statusPublished - 12 Aug 2026
Event2026 International Conference on Electrical, Computer, and Energy Technologies, ICECET 2026 - Rome, Italy
Duration: 6 Jul 2026 → 9 Jul 2026

Conference

Conference2026 International Conference on Electrical, Computer, and Energy Technologies, ICECET 2026
Country/TerritoryItaly
CityRome
Period6/07/26 → 9/07/26

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • Agent Evaluation
  • AI Safety
  • Large Language Models (LLMs)
  • LLM Agents
  • Tool Affordance

Cite this