@ryanallis
Ryan AllisARR verified on LoungeFounder▲168L8
CEO, Lounge.ai & SaasRise
2h ago · Link in AI Adoption · Austin

IBM CEO says open weight models are now good and cheap on-prem

Do we think that open weight models are going to replace proprietary closed weight models like Anthropic and OpenAI in the next 3 years? Do we see any reason people will be using closed Frontier models in 2-3 years when locally hosted open weight models will be as good and at way less cost. Thoughts?

theregister.com logoIBM CEO says open weight models are now good and cheap on-premKrishna put open-weight models at about 90 percent of frontier effectiveness, priced at 10 to 25 percent of frontier token cost. In 2024, a top frontier model might score 70 on a broad benchmark while an open model scored only 20 to 30; by late 2025, the open model's score rose to about 50 against the same 70. He estimated that an average large enterprise could begin running open-weight models with perhaps two or three racks of infrastructure. Krishna also said buyers will usually pick the cheaper option, since cheaper alternative models are adequate for most routine enterprise work, including email summaries, customer calls and contract reviews. Krishna warned that deployment requires specialized engineering talent. Commenters are split between viewing open weight models as genuinely good enough now for local/on-prem use and dismissing the CEO's claims as self-serving hardware promotion. ForLounge News · via theregister.com · Read the story →

Comments

No comments yet
Start the conversation.
Log in to join the thread.