machine learning RSS

Microsoft and Nvidia surpass OpenAI by creating "the world’s largest and most powerful generative language model,”Megatron-Turing Natural Language Generation model (MT-NLG). Just under a year and a half ago OpenAI announced completion of GPT-3, its natural language processing algorithm that was, at the time, the largest and most complex model of its type. This week, Microsoft and Nvidia introduced a new model they’re calling “the world’s largest and most powerful generative language model.” The Megatron-Turing Natural Language Generation model (MT-NLG) is more than triple the size of GPT-3 at 530 billion parameters. GPT-3’s 175 billion parameters was already a lot; its predecessor, GPT-2, had...