SDxCentral

Meta open-sources transport stack to scale AI training to over 100K GPUs

Meta has open-sourced CTran, the tech giant’s custom transport stack used to perform in-house optimizations. Detailed in a PyTorch blog post, first picked up by SemiAnalysis, CTran contains multiple ...
Business Insider

Inside Meta's secret experiments that improve its AI models

A legal case involving Meta revealed the company's secret experiments with training data. Meta used "ablation" to identify how specific data improved its Llama AI models. Some researchers say this ...
InfoQ

Meta Releases Llama 3 Open-Source LLM

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Vivek Yadav, an engineering manager from ...
TechCrunch

Meta unveils a new, more efficient Llama model

Meta has announced the newest addition to its Llama family of generative AI models: Llama 3.3 70B. In a post on X, Ahmad Al-Dahle, VP of generative AI at Meta, said that the text-only Llama 3.3 70B ...

Judge says Meta must defend claim it stripped copyright info from Llama's training fodder

A judge has found Meta must answer a claim it allegedly removed so-called copyright management information from material used ...
TweakTown

Meta's huge 16,384 NVIDIA H100 AI GPU cluster: HBM3 memory crashed half of Llama 3 training

Meta released a new study detailing its Llama 3 405B model training, which took 54 days with the 16,384 NVIDIA H100 AI GPU cluster. During that time, 419 unexpected component failures occurred, with ...

Yann LeCun: Meta ‘fudged a little bit’ when benchmark-testing Llama 4 model

Yann LeCun, Meta’s outgoing chief AI scientist, says his employer tested its latest Llama model in a way that may have made ...
InfoQ

Meta Releases Llama 3.1 405B, Largest Open-Source Model to Date

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
ZDNet

Snowflake says its new LLM outperforms Meta's Llama 3 on half the training

The world of open-source software continues to let companies distinguish themselves from generative AI giants like OpenAI and Google. On Wednesday, data warehousing cloud vendor Snowflake announced an ...
Yahoo

Meta Llama: Everything you need to know about the open generative AI model

Like every Big Tech company these days, Meta has its own flagship generative AI model, called Llama. Llama is somewhat unique among major models in that it's "open," meaning developers can download ...
Geeky Gadgets

Meta Finally Reveals The Truth About Llama 4 AI Models

The release of Llama 4 by Meta has ignited widespread discussion within the artificial intelligence community, bringing critical issues such as transparency, performance evaluation, and organizational ...