← Back to feed

Sophistication in GenAI Use: Field Evidence from a Large Firm

L5 · ResearcherResearcharXiv· 8/27/2026

Provides empirical evidence on real-world genAI adoption patterns and sophistication metrics for researchers studying organizational AI implementation.

AI Summary

A large-scale study of 713,564 employee prompts reveals senior employees and strategic functions show more sophisticated genAI use, with no improvement over time or from .

Excerpt

We study how sophistication in generative AI (genAI) use varies among the back-office workforce of a large firm. Using proprietary data, we observe 713,564 employee prompts and their corresponding large language model responses from nearly 4,000 back-office employees across 15 functional areas over eight months in 2025. We document three main findings. First, senior employees exhibit more sophisticated genAI use, consistent with domain expertise complementing genAI capabilities. Second, sophisti

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchHacker News
Terminal-Bench-Science: Evaluating AI agents on scientific research workflows

Stanford researchers released Terminal-Bench-Science 0.1, a benchmark with 70 expert-curated scientific workflows where Claude Opus achieved only a 30% resolution rate.

L5 · ResearcherResearchLessWrong AI
The Dynamics of Intelligence Explosions

Toby Ord explores the mathematical dynamics of intelligence explosions where AI assists AI R&D, showing singular growth is harder than economic models suggest.

L4 · DeveloperResearcharXiv
Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution Audit

Presents Persona-Execution Separation, an architecture pattern for enterprise LLM agents that keeps execution auditable while allowing persona instructions to evolve freely.

L5 · ResearcherResearcharXiv
LLMs Can Design Near-Optimal OR Algorithms

GPT-5.6 can design near-optimal algorithms for operations research problems like inventory control and queueing networks, matching or beating specialized methods with minimal human input.

L5 · ResearcherResearchLessWrong AI
Do AI Models Want to Be Monitored? Measuring Monitorability Disposition in Large Reasoning Models

Researchers propose measuring 'monitorability disposition' in large reasoning models to proactively understand model behavior rather than reactively filtering outputs.