Tag: Mixture of experts

Tag Visualization: Top 50 related tags by occurrence

Recent Related Articles to Mixture of experts

Mistral AI Introduces Mixtral 8x7B: a Sparse Mixture of Experts (SMoE) Language Model ...

Added to Collection on: 2024-01-14 18:17:42

Tags for this article:

Large language models
Artificial intelligence
Computational neuroscience
OpenAI
Deep learning
Llama
Mixture of experts
GPT-3
Mistral AI
Generative pre-trained transformer
Language model
Artificial general intelligence

Click the tags to see associated articles and topics

View Article Details
A Meme's Glimpse into the Pinnacle of Artificial Intelligence (AI) Progress in a Mamba Series

Added to Collection on: 2024-02-03 23:10:21

Tags for this article:

Deep learning
Natural language processing
Artificial intelligence
Large language models
Machine learning
Mamba
Transformer
Llama
Mixture of experts
Prompt engineering
Vision transformer
Language model

Click the tags to see associated articles and topics

View Article Details
Microsoft's Phi-3 shows the surprising power of small, locally run AI language models

Added to Collection on: 2024-04-24 00:01:51

Tags for this article:

Large language models
OpenAI
GPT-4
Generative pre-trained transformer
GPT-3
ChatGPT
Mixture of experts
Artificial intelligence
Mistral AI
DBRX
Microsoft

Click the tags to see associated articles and topics

View Article Details
MIXTRAL 8x22B large language model from Mistral AI - Geeky Gadgets

Added to Collection on: 2024-05-01 13:46:42

Tags for this article:

Artificial intelligence
Computational neuroscience
Natural language processing
Large language models
Mistral AI
Applications of artificial intelligence
ChatGPT
Mixture of experts
Artificial general intelligence
Mistral
Information retrieval

Click the tags to see associated articles and topics

View Article Details
Is the next frontier in generative AI transforming transformers? - VentureBeat

Added to Collection on: 2024-08-18 20:35:58

Tags for this article:

Large language models
Mamba
Jamba
Transformer
Mixture of experts
Generative pre-trained transformer
GPT-4
OpenAI
Foundation model
Artificial intelligence
Prompt engineering
AI21 Labs

Click the tags to see associated articles and topics

View Article Details
MLPerf Inference 4.1 results show gains as Nvidia Blackwell makes its testing debut

Added to Collection on: 2024-08-28 15:08:27

Tags for this article:

Deep learning
AI accelerator
Large language model
Generative artificial intelligence
Blackwell
Nvidia
Artificial intelligence
Llama
Benchmark
Mixture of experts

Click the tags to see associated articles and topics

View Article Details
IBM's New Granite 3.0 Generative AI Models Are Small, Yet Highly Accurate and Efficient

Added to Collection on: 2024-10-21 20:07:16

Tags for this article:

Large language models
Deep learning
Natural language processing
Generative artificial intelligence
Artificial neural networks
Llama
IBM Granite
Prompt engineering
Nvidia
Mixture of experts
Retrieval-augmented generation
IBM

Click the tags to see associated articles and topics

View Article Details
Tencent Releases Hunyuan-Large (Hunyuan-MoE-A52B) Model: A New Open ... - MarkTechPost

Added to Collection on: 2024-11-05 17:32:54

Tags for this article:

Computational neuroscience
Deep learning
Large language models
Natural language processing
Computational linguistics
Llama
Artificial intelligence
Mixture of experts
Artificial general intelligence
Transformer

Click the tags to see associated articles and topics

View Article Details
Llama 3 Meets MoE: Pioneering Low-Cost High-Performance AI | Synced

Added to Collection on: 2024-12-28 20:40:52

Tags for this article:

Deep learning
Natural language processing
Llama
Mixture of experts
Large language model
Transformer
Neural network
Upcycling
Language model

Click the tags to see associated articles and topics

View Article Details
Researchers from Tsinghua University Propose ReMoE: A Fully Differentiable MoE ... - MarkTechPost

Added to Collection on: 2024-12-29 14:06:07

Tags for this article:

Computational neuroscience
Artificial neural networks
Mixture of experts
Transformer
Neural network
Scalability
Artificial intelligence
Activation function
Rectifier

Click the tags to see associated articles and topics

View Article Details