Engineering at Meta: Meta details Prometheus, its gigawatt-scale supercluster in Ohio, which will have ~1M GPUs at full scale and was used to train its Muse foundational models — - With the recent release of the Muse family of foundational models, we want to take you inside the infrastructure that has made it all possible.