Featherless.ai pulls in $20M to scale serverless hosting for open-source AI models

Featherless.ai Inc., a serverless inference platform startup that hosts open-source artificial intelligence models, today ...
Business Wire

MangoBoost Launches Mango LLMBoost™: AI Inference Optimization Software with Up to 12.6x Relative Performance Improvement and 92% Cost Savings

BELLEVUE, Wash.--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions designed to maximize AI data center efficiency, is announcing the launch of Mango LLMBoost™, system ...
Blockonomi

Nebius (NBIS) Shares Surge 8.5% on $643M Eigen AI Acquisition Deal

Nebius (NBIS) stock surges 8.51% after announcing $643M acquisition of Eigen AI, gaining MIT inference expertise for its ...
VentureBeat

Together AI's ATLAS adaptive speculator delivers 400% inference speedup by learning from workloads in real-time

Enterprises expanding AI deployments are hitting an invisible performance wall. The culprit? Static speculators that can't keep up with shifting workloads. Speculators are smaller AI models that work ...
Forbes

The Inference Economy: How Sparse Computing And Model Optimization Are Reshaping Enterprise AI Deployment

The AI industry stands at an inflection point. While the previous era pursued larger models—GPT-3's 175 billion parameters to PaLM's 540 billion—focus has shifted toward efficiency and economic ...
Hosted on MSN

Nebius to buy Eigen AI for $643M, boosting U.S. presence

Nebius Group shares surged after announcing a $643 million cash-and-stock acquisition of U.S.-based Eigen AI, a specialist in AI inference and model optimization. The deal will integrate Eigen’s ...
Forbes

The Current And Future Path To AI Inference Data Center Optimization

Expertise from Forbes Councils members, operated under license. Opinions expressed are those of the author. We are still only at the beginning of this AI rollout, where the training of models is still ...
New Atlas

Next-level AI engine comes top in LLM speed showdown

Responses to AI chat prompts not snappy enough? California-based generative AI company Groq has a super quick solution in its LPU Inference Engine, which has recently outperformed all contenders in ...
EDN

The next AI frontier: AI inference for less than $0.002 per query

Inference is rapidly emerging as the next major frontier in artificial intelligence (AI). Historically, the AI development and deployment focus has been overwhelmingly on training with approximately ...