Microsoft, NVIDIA test waters for a large-scale generative language model with promising results

Retrieved on: 2022-02-10 23:13:57

Tags for this article:

Click the tags to see associated articles and topics

Microsoft, NVIDIA test waters for a large-scale generative language model with promising results. View article details on hiswai:

Excerpt

As part of Microsoft's AI at sale effort, the DeepSpeed team has investigated model applications and optimisations for a mixture of experts (MoE) ...

Article found on: analyticsindiamag.com