experts AI Tools

A strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.

Mixtral 8x7B, a high-quality sparse mixture of experts model (SMoE) with open weights. Mixtral outperforms Llama 2 70B on most benchmarks with 6x faster inference. It matches or outperforms GPT3.5 on most standard benchmarks. paper：https://arxiv.org/pdf/2401.04088.pdf news：https://mistral.ai/news/mixtral-of-experts/