Challenging Nvidia: ZAYA1, the first large-scale AI model trained entirely on AMD hardware, debuts.

AMD, in collaboration with IBM and AI startup Zyphra, has successfully trained its first large-scale hybrid expert (MoE) model, ZAYA1, using AMD hardware after more than a year of development. The model is entirely built on the AMD hardware ecosystem, with training conducted on the IBM Cloud using technologies such as the AMD Instinct MI300X GPU. The training cluster consists of 128 nodes, totaling 1024 GPUs, achieving a performance exceeding 750 PFLOPs.