Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
Continue reading at TechCrunch.
Openai’s Jalapeño Chip Is Built For Fast Inference At Scale, Benchm…
