Overview

Code Llama continued training Llama 2 on code-heavy data. It came in base, Python-specialized and instruct variants, and the smaller models support fill-in-the-middle for editor completion.

Highlights

  • 7B, 13B, 34B and 70B sizes
  • Base, Python and Instruct versions
  • Fill-in-the-middle code completion
  • Trained with 16K sequences, stable up to 100K tokens

Typical uses

Local code completion and explanation, research on code models.

Things to consider

  • Superseded by newer code models such as Qwen2.5-Coder.
  • Download sizes refer to the default quantized versions in the Ollama library; full-precision weights are larger.

Specifications are taken from the model card on Hugging Face, the Ollama library and the provider’s announcement. Benchmark results depend on evaluation settings; see how AI benchmarks work.