Skip to main content
Mixtral of Experts

Mixtral of Experts

Albert Q. Jiang, et al.

00
2024-01-04
moellm

Abstract

This paper introduces and evaluates the idea described in “Mixtral of Experts”, and reports empirical results that helped shape subsequent work in moe, llm.