In an engaging presentation at Weights & Biases’ Fully Connected conference, Joe Spisak, Product Director of GenAI at Meta, unveiled the latest family of Llama models, Llama 3.

Highlighting a significant milestone in AI development, the Llama 3 models, including the impressive 8 billion and 70 billion parameter models released during the conference, along with a glimpse into the future with a 400 billion parameter model still in the works.

Joe shared insights into the training processes and alignment of Llama 3, which now ranks as the topperforming model in the open weights category on the MMLU, GSMK, HumanEval benchmarks.

Weights & Biases is proud to support our customers such as Meta as they push the boundaries of AI, to learn how to finetune your LLMs using torchtune and Weights & Biases, start here: https://wandb.me/torchtune

Timestamps:
00:00 Introduction
03:05 Overview of Llama at Meta
05:59 Introducing Meta Llama 3
7:04 Advancements in Llama 3: Training and Data Scale
10:02 Benchmarking Llama 3 Performance
14:01 Enhancing Model Safety and Red Teaming
16:23 Expanding the Ecosystem and Future Directions
23:00 Closing remarks: Future plans for Llama models, and an invitation to use Meta's Lama 3.

#MetaLlama #ArtificialIntelligence #AITrends #TechInnovation