← Back to feed

Preface to the Computational Agent Theory and ASI Alignment Sequence

L5 · ResearcherResearchLessWrong AI· 10/15/2026

Provides theoretical foundation for researchers working on superintelligence safety and alignment problems.

AI Summary

Preface introduces computational agent theory framework for analyzing ASI risks and existential threats.

Excerpt

The idea of “artificial superintelligence [1] ” (ASI) has recently crossed from the realm of science fiction (in the mainstream perception) to the realm of near-term technological goals openly pursued by most leading commercial organizations in the field of AI. Unfortunately, ASI poses a grave existential risk to the human species. This was argued by Eliezer Yudkowsky since 2001 [2] , and by many others (see e.g., Omohundro 2009, Bostrom 2014, Armstrong 2014, Russell 2019, Be

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchAI Alignment Forum
Preface to the Computational Agent Theory and ASI Alignment Sequence

Introduces a theoretical framework for artificial superintelligence alignment while acknowledging ASI's existential risks as argued by Yudkowsky and others.

L5 · ResearcherResearchLessWrong AI
The user in the LLM might be a moral patient too (a strange implication of the PSM and simulators)

Researchers argue that LLM user personas may deserve moral consideration alongside assistant personas, based on philosophical implications of simulator frameworks.

L4 · DeveloperResearchTowards Data Science
How Many Guesses Does It Take to Crack an AI's "Random" Number?

A researcher analyzed logits from open models to measure their random number generation predictability by calculating bits of entropy and guesses-to-crack metrics.

L5 · ResearcherResearcharXiv
Price of Anarchy of First-Price Auctions in Agentic Markets

Researchers prove first-price auctions in AI agent markets can achieve near-optimal welfare under competitive floors and conditional independence assumptions.

L5 · ResearcherResearcharXiv
Your Transformer Is Secretly Elastic

Researchers introduce a retraining-free method to make transformers elastic, enabling on-the-fly adaptation across computational budgets by jointly ranking MLP neurons and attention heads.