Well, all this was deleted in the main forum (violation? Why?)...
"Dojo uses our own chips & a computer architecture optimized for neural net training, not a GPU cluster. Could be wrong, but I think it will be best in world."
— Elon Musk (@elonmusk) September 20, 2020
Custom ultra high speed bus & efficient cooling
— Elon Musk (@elonmusk) September 20, 2020
All this is putting a lot of pressure at NVIDIA. (see their keynotes 2021 of last Monday!). Their DGX Station supercomputer has a memory bandwith 8TB/sec! 20 x 400G! crazy!!!(45:00)
If Poet will not work with Tesla, I am sure NVIDIA will (have to): To go from Nvidia Orin to Atlan, with 1000 TOPS, 400G inside the car you have to go photonic!