Digital Habitats site is for the private development of communities. Signup to this site to get an account and password for access to customized content.

machine learning RSS

machine learning -

Microsoft and Nvidia surpass OpenAI by creating "the worldโ€™s largest and most powerful generative language model,โ€Megatron-Turing Natural Language Generation model (MT-NLG). Just under a year and a half ago OpenAI announced completion ofย GPT-3, its natural language processing algorithm that was, at the time, the largest and most complex model of its type. This week, Microsoft and Nvidiaย introducedย a new model theyโ€™re calling โ€œthe worldโ€™s largest and most powerful generative language model.โ€ The Megatron-Turing Natural Language Generation model (MT-NLG) is more than triple the size of GPT-3 at 530 billion parameters. GPT-3โ€™s 175 billion parameters was already a lot; its predecessor,ย GPT-2, had...

Read more