← Back to feed

Janas: Run LLMs larger than RAM by streaming experts from SSD

L4 · DeveloperOpen SourceHacker News· 10/12/2026

Enables developers to run massive LLMs on consumer hardware through efficient SSD streaming techniques

AI Summary

Janas-LLM enables running large language models (up to 80B parameters) on hardware with limited RAM by experts from SSD, achieving 37 tok/s on Qwen3-Next-80B with 32GB RAM.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherOpen Source@ClementDelangue
clem 🤗 (@ClementDelangue): If you’re a researcher, please consider sharing your RL environments openly! Something you built for one experiment could help the entire field move forward. I know we’re in dark days for sharing fro

Hugging Face CEO advocates for researchers to share RL environments openly, citing recent conversion of OpenAI math problems into open-source training environments.

L3 · BuilderOpen SourceHacker News
open-slopware – Alternatives to FOSS projects choosing to use LLMs/AI

A GitHub repository tracks FOSS projects that have adopted LLMs/AI and provides alternatives, forking guides, and policy request templates.

L4 · DeveloperOpen SourceHacker News
Veda: The First Agentic Hobby Operating System

Veda is a Rust-based operating system with built-in AI agent capabilities that integrates directly with applications rather than relying on screen scraping.

L3 · BuilderOpen SourceHacker News
Talorys – A self-hosted personal AI agent on Cloudflare's free tier

Talorys is a free, open-source personal AI agent that runs entirely within your Cloudflare account with chat, memory, tasks, and automation features.