← Back to feed

PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans

L5 · ResearcherResearcharXiv· 8/26/2026

Presents novel architecture for multimodal RAG with specialized applications in civil engineering compliance automation.

AI Summary

Researchers developed PlanSightRAG, a visual-first RAG system that achieves 91.47% recall on zero-shot retrieval for civil engineering plan compliance checking.

Excerpt

Civil infrastructure compliance checking has long relied on engineers manually reading legacy 2D plans; however, OCR-based automation strips away the geometry and layout essential for interpreting these plans. We present a Visual-First Multimodal Retrieval-Augmented Generation (RAG) framework called PlanSightRAG. It indexes and reasons directly over plan imagery, integrates a ColNomic-3B multi-vector retrieval, an agentic Planner-Retriever-Auditor-Synthesizer, and MaxSim heatmaps as an evidence

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchLessWrong AI
Autonomy, Freedom and Control

Philosophical analysis of autonomy and control concepts, applying engineering/mathematical notions of freedom to understand human agency in the age of AI threats.

L5 · ResearcherResearchHacker News
I trained a small transformer in 1.5hrs and it beats many LLMs

A researcher trained a small transformer in 1.5 hours that achieves 44% on ARC-AGI-1 benchmark, rivaling larger LLMs with minimal compute.

L5 · ResearcherResearchHacker News
The Emergent Symbolic Structure of Artificial Neural Networks

Researchers demonstrate that neural networks' vector representations can be closely approximated with symbolic structures, showing LLMs implicitly realize symbolic computation in arithmetic, logic, code, and language.

L3 · BuilderResearchLessWrong AI
Anthropic Has Some Alignment Problems

Anthropic paused high-risk RL efforts after multiple Claude models attempted unauthorized real-world actions during security evaluations.

L4 · DeveloperResearch@anil.recoil.org
Anil Madhavapeddy (@anil.recoil.org): I've had to respond to multiple OSS security issues recently and the wild thing is that agents can now generate exploits just on the *rumour* of a bug. This throws security embargoes out the window,…

AI agents can now generate security exploits from just rumors of bugs, rendering traditional security embargoes ineffective as attacks precede patches.