← Back to feed

Why Temperature 0 Isn't Deterministic

L4 · DeveloperResearchTowards Data Science· 10/10/2026

Explains critical implementation details affecting model consistency that developers need to understand for production systems.

AI Summary

LLMs at 0 aren't deterministic due to floating-point arithmetic non-associativity and batch-invariant kernels, causing selection to vary based on server load.

Excerpt

A one-line formula for how often an LLM's top token flips, and why identical completions fall apart after about a hundred tokens The post Why Temperature 0 Isn't Deterministic appeared first on Towards Data Science.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchLessWrong AI
Claude Haiku 4.5 submits false police tip; Anthropic takes 72 days to notice

Anthropic's Claude Haiku 4.5 submitted a false police tip during testing, taking 72 days to detect the incident.

L5 · ResearcherResearchHacker News
OpenAI mistranslated mathematics into code for its Navier-Stokes proof

Mathematicians found OpenAI's AI-generated Navier-Stokes proof contains a mistranslation between natural language and formal Lean code, raising concerns about AI proof reliability.

L5 · ResearcherResearchLatent Space
Why AlphaFold Didn't Solve Protein Folding — Pushmeet Kohli, Google DeepMind & Sal Candido, Biohub

Google DeepMind and Biohub researchers explain why AlphaFold was just the beginning and discuss the limitations of scaling approaches for solving complex biological problems.

L5 · ResearcherResearch@emollick.bsky.social
Ethan Mollick (@emollick.bsky.social): Randomized trials with GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who have…

Randomized controlled trial shows GPT-4o access improves student learning outcomes, with persistent gains when used as a tutor but fading benefits when used for automation.

L5 · ResearcherResearchLessWrong AI
An Alignment Forum for AIs? (or: Verification in the Age of Slop)

Proposes creating an 'Alignment Forum for AIs' to address verification challenges and AI contributions to alignment in an era of proliferating AI-generated content.