OpenAI says its Jalapeño chip can power faster AI responses than the competition
For developers designing systems that require high-speed, low-latency AI inference at scale, particularly for large models.
AI Summary
OpenAI announced its custom Jalapeño AI chip delivers 1.5-1.9x better performance per watt and 1.7-3.6x lower latency than Nvidia superchips in tests.
Excerpt
OpenAI says its new AI chip, Jalapeño, completes tasks more efficiently and returns responses faster than other AI systems, according to a blog post published on Tuesday. During a briefing with reporters, OpenAI hardware vice president Richard Ho said Jalapeño offers the "best of both worlds" with lower latency and higher throughput, as AI systems typically "have to make a trade-off between the two." First introduced in June, Jalapeño is an Application-Specific Integrated Circuit (ASIC) made in