Overview
Mistral NeMo was developed by Mistral AI in collaboration with NVIDIA and released in July 2024 as a drop-in replacement for Mistral 7B with a larger context and better multilingual performance.
Highlights
- 12.2B parameters
- 128K-token context window
- Tekken tokenizer, efficient across many languages
- Trained with quantization awareness for FP8 inference
Typical uses
Multilingual assistants and local deployments on a single consumer GPU.
Things to consider
- Newer Mistral Small models offer more capability.
- Download sizes refer to the default 4-bit quantized versions in the Ollama library; full-precision weights are larger.
Specifications are taken from the model card on Hugging Face, the Ollama library and the provider’s announcement. Benchmark results depend on evaluation settings; see how AI benchmarks work.