Agent Foundations 2025 at CMU

Agent Foundations for AI Alignment

March 3-7, 2025 in Pittsburgh, PA

Agent Foundations 2025 at CMU was a five-day gathering bringing together approximately 30 researchers in AI alignment to explore fundamental questions about Agent Foundations.

Topics included: 

  • Bounded decision-making and resource-limited reasoning

  • Reflective stability and fixed points in agency

  • Logical decision theory and updateless decision theory

  • Causal vs evidential vs logical decision theory

  • Embedded agency

  • Natural abstraction hypothesis

  • Abstraction boundaries

  • Infra-Bayesian learning theory

  • Inner alignment and mesa-optimization

  • Logical causality

  • Multi-level world models

  • Game theory and multi-agent systems

  • Logical inductors and reflective reasoning

  • Foundations of reasoning under uncertainty

  • Coordination problems and acausal trade

  • Logical counterfactuals

  • Ontological crises and reasoning across ontologies

About

Workshop Papers

We solicited paper submissions to be presented at Agent Foundations 2025 at CMU. Accepted workshop papers can be viewed here.

FAQs

  • This event has already taken place. We are no longer accepting applications for this event.

  • The event took place March 3-7, 2025 at Carnegie Mellon University in Pittsburgh, PA.

Contact Us

If you have any questions, please reach out to us through this form.