Nvidia interconnects: Mellanox, NVLink and NVSwitch

By announcing the new ARM-based Grace CPU at GTC2022 (available in 2023), Nvidia will again provide fast links between CPU and GPU as they will be connected via their upgraded NVLink technology. Nvidia's fourth-generation NVLink technology provides 1.5x higher bandwidth compared to the previous generation, and improved scalability for multi-GPU system configurations. A single Nvidia H100 Tensor Core GPU supports up to 18 NVLink connections for a total bandwidth of 900 gigabytes per second (GB/s)—over 7x the bandwidth of PCIe Gen5 . 
Nvidia also announced in March 2019 that they had reached an agreement with  Mellanox Technologies to buy the company for USD 6.9 Billion \cite{billion}. The Israeli-American company is known for its InfiniBand technology used between by high-end servers. This has led Nvidia to develop their interconnected technology further.