Exclusive: Paying for frontier AI models buys 4-month head start at 5x the cost
Ars previewed Mozilla’s report on how cheap open models caught up on capability.
The performance gap between frontier AI models from US tech companies and the best open-weights models from Chinese companies has closed to just 4.4 months, according to a Mozilla report. That explains why many companies are shifting to the significantly cheaper open models for routine work—and helps reveal a narrow band of workloads where frontier models are worth the cost.
Most organizations should ideally be using open models as the default for the majority of their work, according to the latest State of Open Source AI report from Mozilla, published on September 15 and shared with Ars prior to publication. The report highlights how a leading open model, Moonshot AI’s Kimi K3, achieves a composite AI performance score on the Artificial Analysis Intelligence Index that is just three points behind Anthropic’s Fable 5 closed frontier model, all while costing just 30 percent of the latter.
“[A Closed model] earns its premium in a few places: expert professional work, high-intensity retrieval, and long context,” Raffi Krikorian, chief technology officer at Mozilla, said in an email to Ars. “We see the decision to pay for closed [models] as workload-specific rather than organization-specific.”
Read full article
Comments
Source: Ars Technica
Related stories
Brentford hold off Reading to reach round four of Carabao Cup
Brentford emerged from a tense finish against Reading to book their place in the Carabao Cup fourth round with a 2-1 victory at Select Car Leasing Stadium.
Woods seen back on the range for first time since car accident
Tiger Woods has shared footage of him hitting balls for the first time since his car accident in March.
Brook, Buttler go berserk again as England thrash Sri Lanka in first T20
Harry Brook and Jos Buttler went berserk in a T20 at Southampton for the second time this summer as England smoked 254-4 against Sri Lanka during a 119-run win in the series opener - their first game since Kevin Pietersen's appointment as white-ball mentor.
Webb: VAR had 'tunnel vision' on Haaland which led to Enzo error
Pro Ref chief Howard Webb says VAR missed Enzo Fernandez being offside for Erling Haaland's winning goal in the Manchester derby due to "tunnel vision".