Floating point numbers in machine learning: Less is more for Intel, Nvidia and ARM

Retrieved on: 2022-09-16 07:03:59

Tags for this article:

Click the tags to see associated articles and topics

Floating point numbers in machine learning: Less is more for Intel, Nvidia and ARM. View article details on hiswai:

Excerpt

It compares the use of 8-bit floating-point numbers (FP8) with that of FP16 values in the BERT and GPT-3 language and transformer models, ...

Article found on: voonze.com