Harel Lidar

Article summary · Oct 2024

Agency from a Causal Perspective

Mostly someone else’s words. I keep it as reading, not as my own writing.

Agency and its Importance

Key Dimensions of Agency

The source presents eight key dimensions of agency, each offering insights into the nature and extent of an AI system’s goal-directed behaviour:

Visualizing Agency: Mechanised Causal Graphs

The source employs mechanised causal graphs to represent the concepts of influence and adaptation. These graphs use:

These graphs help visualise how an agent’s actions influence the environment and how feedback from the environment affects the agent’s future decisions, highlighting the dynamic interplay between an agent and its surroundings.

Detecting and Measuring Agency

The source suggests that adaptation can be detected using causal discovery algorithms, opening up possibilities for identifying agents within complex systems. It also proposes quantitative measures for various dimensions of agency:

These measurements can contribute to evaluating the capabilities and potential risks associated with AI systems.

Far-Reaching Implications

The concepts presented in the source have significant implications for the future of AI development, safety, and our understanding of agency itself:

The insights offered by this source contribute to a more nuanced understanding of agency in AI, paving the way for the development of safer, more beneficial AI systems while addressing the ethical and societal challenges they present.