Meta unveils training of Llama 3 with an impressive ensemble of 350,000 G-PUs, setting its sights on the Open Source AGI front.
Mark Zuckerberg has revealed that Meta’s AI team is currently training the Llama 3 model on a large-scale computer infrastructure. This infrastructure will include 350,000 NVIDIA H100 GPUs by the...