← Back to feed

Microgpt in pure C hits 10M tps on Apple m5

L4 · DeveloperOpen SourceHacker News· 8/18/2026

Shows developers how to build high-performance minimalist transformer implementations with hardware-specific optimizations.

AI Summary

MicroGPT-C achieves 10M tokens/second speed on Apple M5 Pro using pure dependency-free C with NEON optimizations.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L4 · DeveloperOpen SourceTheSequence
The Sequence Robotics - Issue #922: Learning About LeRobot: The Transformers Moment for Robots

Hugging Face's LeRobot library has become the standard stack for robot learning, providing a unified protocol for datasets, teleoperation, and policies.

L4 · DeveloperOpen SourceTowards Data Science
AI Agents Don’t Need More Context — They Need Typed Context

A lightweight Python runtime introduces a context type system that enforces type safety on agent context objects before prompt serialization to prevent type confusion bugs.

L4 · DeveloperOpen SourceHacker News
Run 290B+ frontier MoE models locally on your gaming PC

FreeToken enables running 290B+ parameter MoE models locally on consumer hardware with optimized CPU-GPU co-execution and semantic caching.

L3 · BuilderOpen SourceHacker News
OCR It – pull text out of un-copyable documents for your LLM

OCR It is a Chrome extension that extracts text from un-copyable documents using offline Tesseract OCR for LLM processing.

L4 · DeveloperOpen SourceSimon Willison's Blog
llm-anthropic 0.27

LLM Anthropic plugin v0.27 released with compatibility for anthropic Python SDK v1.0.0 migration from httpx to httpx2.