Home » mixture-of-experts

mixture-of-experts

Revolutionizing LLM Acceleration on ROCm with AMD’s Open-Source Library AITER.

Posted byby
2 months ago
0 Comments

AMD has introduced the open-source AI Tensor Engine for ROCm (AITER), which integrates various commonly used AI functions to optimize on ROCm, specifically PyTorch favored by the LLM intelligence group....

Google Releases Gemini 1.5 Pro Model: Empowering Massive 1 Million Token Input, Equally Competing with Gemini Ultra

Posted byby
1 year ago
0 Comments

Google has recently introduced the Gemini Ultra, and now they have released the upgraded version, Gemini 1.5 Pro. This middle-level (Pro) model is just as capable as the Gemini 1.0...

Introducing Mixtral 8x7B: Unveiling Mistral AI’s LLM Open Source Hybrid Model, Nearing GPT-3.5’s Capabilities

Posted byby
1 year ago
0 Comments

Mistral AI, a French artificial intelligence company, has recently unveiled a new model called Mixtral 8x7B. This model leverages the architecture of mixture-of-experts (MoE), which combines outputs from sub-models within...