Optical Interconnects
posted on
Sep 04, 2024 06:37PM
Optical interconnects refers to any system of transmitting signals from one part of an integrated circuit to another using light.
Along with getting faster and spanning greater distances, interconnects will dramatically increase in number. Chat GPT3 was trained on a cluster with approximately 1,000 accelerators that required 2,000 optical interconnects. Chat GPT4 was trained on a 25,000-accelerator cluster with about 75,000 optical interconnects.
“100K clusters will be available soon and that may require five layers of switching and 500,000 optical interconnects. People are talking about a million (accelerator) clusters, I can’t even imagine that, but those are the kind of numbers that people are talking about today and that may require millions of optical interconnects in a single AI cluster,” Nguyen added. “These numbers should only be used as a guide…(but) no matter how you look at it, the optical interconnects will grow faster than the accelerator growth in an AI cluster.”
https://www.marvell.com/blogs/scaling-ai-means-scaling-interconnects.html
Broadcom leads the industry in three core optical interconnect technologies essential to building large-scale AI networks.
AI server clusters are large and are only going to get larger. Optical links provide the connections needed to allow these clusters to scale at distance. Optical technology can support that growth in terms of both scale and cost.
There are three core optical interconnects: