Richard Ho
Head of chip operations at OpenAI, leading the development of the company's in-house inference chip, Jalapeño.
Timeline (last 90 days)
OpenAI's head of chips is Richard Ho.
Richard Ho stated that Jalapeño simultaneously achieves high throughput and low latency on the same chip, which is a first in the industry.
Performance per watt is regarded as a good proxy metric for measuring the cost per token, with higher performance corresponding to lower cost per token.
All Facts (3)
OpenAI's head of chips is Richard Ho.
50%UnverifiedRichard Ho stated that Jalapeño simultaneously achieves high throughput and low latency on the same chip, which is a first in the industry.
50%UnverifiedPerformance per watt is regarded as a good proxy metric for measuring the cost per token, with higher performance corresponding to lower cost per token.
50%