RT @MacrocosmosAI: “Pretraining models in a distributed fashion is "like fighting gravity.” These were the words that sparked a salient mo…