Opening article
Mistral News has published a brief update titled Cheaper, Better, Faster, Stronger. The full text of the article is currently unavailable. Therefore, readers must rely on the headline and excerpt provided by the source.
Mixtral 8x22B is our latest open model. It sets a new standard for performance and efficiency within the AI community. It is a sparse Mixture-of-Experts (SMoE) model that uses only 39B active parameters out of 141B, offering unparalleled cost efficiency for its size.
It is fluent in English, French, Italian, German, and Spanish
It is natively capable of function calling ; along with the constrained output mode implemented on la Plateforme, this enables application development and tech stack modernisation at scale
Figure 1: Measure of the performance (MMLU) versus inference budget tradeoff (number of active parameters). Mistral 7B, Mixtral 8x7B and Mixtral 8x22B all belong to a family of highly efficient models compared to the other open models.
Mixtral 8x22B is a natural continuation of our open model family. Its sparse activation patterns make it faster than any dense 70B model, while being more capable than any other open-weight model (distributed under permissive or restrictive licenses). The base model's availability makes it an excellent basis for fine-tuning use cases.
Its 64K tokens context window allows precise information recall from large documents
We believe in the power of openness and broad distribution to promote innovation and collaboration in AI.
We are, therefore, releasing Mixtral 8x22B under Apache 2.0, the most permissive open-source licence, allowing anyone to use the model anywhere without restrictions.
Because the full text is unavailable, the specific implications for the AI industry cannot be determined from this brief alone.