Llama & Open-Source Models
Llama is Meta's family of open-weight large language models, and it anchors the broader open-source AI ecosystem. 'Open-weight' means the trained parameters are published for download, so anyone can run, fine-tune, and deploy the model on their own hardware rather than only calling a vendor API. Llama 3.1 405B (July 2024) was the first open model to credibly match GPT-4-class quality, and Llama 4 (April 2025) moved the family to a Mixture-of-Experts design with context windows up to 10 million tokens. Llama sits alongside strong open models from Mistral, Alibaba (Qwen), DeepSeek, Z.ai (GLM), Google (Gemma), Moonshot (Kimi), and Xiaomi (MiMo).
The models you can download, run, fine-tune, and own.
Category: Flagship AI Models
Open-weight vs closed: what the difference actually means
A closed model (GPT-5.5, Claude, Gemini) lives behind an API — you send tokens and pay per token, and you never see the weights. An open-weight model publishes its parameters, so you can download it and run it yourself. That distinction drives almost every practical tradeoff between the two approaches.
| Dimension | Open-weight (e.g. Llama) | Closed API (e.g. GPT-5.5) |
|---|---|---|
| Hosting | Your hardware or any provider | Vendor only |
| Cost model | Pay for compute you run | Pay per token |
| Data privacy | Data never leaves your infra | Sent to the vendor |
| Customization | Full fine-tuning of weights | Limited (prompts, light tuning) |
| Frontier quality | Close, sometimes matching | Typically sets the frontier |
Open-weight is not the same as open-source: Most 'open' LLMs release weights under their own licenses, not classic open-source ones. Llama uses a community license with some restrictions; DeepSeek and many Chinese models use the permissive MIT or Apache 2.0 licenses. Always check the license before commercial use.
The Llama lineage: 1 to 4
| Model | Released | Notable for |
|---|---|---|
| Llama 1 | Feb 2023 | Research release; weights leaked and sparked the open era |
| Llama 2 | Jul 2023 | First with a commercial-use license |
| Llama 3 | Apr 2024 | 8B and 70B; strong quality for their size |
| Llama 3.1 405B | Jul 2024 | First open model to rival GPT-4 |
| Llama 4 Scout | Apr 2025 | MoE; 10M-token context window |
| Llama 4 Maverick | Apr 2025 | MoE; 1M context, multimodal |
Llama's arc mirrors the field: dense models early, then a shift to Mixture-of-Experts and very long context with Llama 4. Its biggest impact, though, has been ecosystem-wide — releasing capable weights for free pushed every other lab to compete on openness and price.
The open-source ecosystem in 2026
By mid-2026 the open frontier is crowded and genuinely competitive, with several models trading blows with closed systems on coding and reasoning:
- DeepSeek V4 — 1.6T MoE, 1M context, MIT-licensed, frontier-class coding at very low cost
- Qwen (Alibaba) — broad family of open and proprietary models, strong multilingual and coding
- GLM (Z.ai) — GLM 5.2 is MIT-licensed with 1M context and top-tier open coding scores
- Mistral — Mistral Large 3 is an Apache 2.0, 675B MoE model from France
- Gemma (Google), Kimi (Moonshot), and MiMo (Xiaomi) — additional capable open releases
How to run open models
Running an open model locally usually comes down to three choices: which serving tool, how much to quantize, and how much hardware you have. Quantization shrinks the weights (for example from 16-bit to 4-bit) so a model fits in less memory, trading a small amount of quality for a large drop in resource needs.
- Ollama — simplest local runner; one command to download and chat with a model
- LM Studio / Jan — desktop apps with a graphical interface for local models
- vLLM / SGLang — high-throughput servers for production and multi-user serving
- llama.cpp — runs quantized models efficiently on CPUs and consumer GPUs
Rule of thumb: A 4-bit quantized model needs roughly half a gigabyte of memory per billion parameters. A 7-8B model runs on most modern laptops; a 70B model needs a high-end GPU or heavy quantization; frontier MoE models in the hundreds of billions of parameters generally need a multi-GPU server.
The open frontier in 2026: benchmarks and licenses
| Model | Context | License | Notable result |
|---|---|---|---|
| Llama 4 Maverick | 1M | Llama Community | Multimodal MoE flagship |
| DeepSeek V4-Pro | 1M | MIT | ~80.6% SWE-bench Verified |
| GLM 5.2 | 1M | MIT | 62.1% SWE-bench Pro (top open coder) |
| Qwen 3.6 (open variants) | 256K-1M | Apache 2.0 | Strong multilingual and coding |
| Mistral Large 3 | 256K | Apache 2.0 | 675B MoE, fully self-hostable |
Check the license, not just the weights: 'Open' covers a range. MIT and Apache 2.0 (DeepSeek, GLM, Mistral, Qwen variants) allow unrestricted commercial use. Meta's Llama Community License permits commercial use but adds conditions. Always read the specific license before deploying.
Frequently asked questions
Is Llama free for commercial use? Mostly — the Llama Community License permits commercial use but adds some conditions (such as restrictions for the very largest platforms). For unrestricted terms, MIT or Apache 2.0 models like DeepSeek, GLM, or Mistral are cleaner choices.
Can open models match GPT-5.5 or Claude? On many coding and reasoning benchmarks, yes — DeepSeek V4 and GLM 5.2 trade blows with closed frontier models. The closed leaders still tend to edge ahead on the hardest general-reasoning tasks and on ecosystem maturity.
How do I run an open model locally? Use Ollama for the simplest setup, LM Studio or Jan for a desktop interface, or vLLM/SGLang for production serving. Quantization (e.g. 4-bit) shrinks memory needs so smaller models run on a laptop.
What is the difference between open-weight and open-source? Open-weight means the trained parameters are downloadable; open-source traditionally also implies an OSI-approved license and (ideally) training details. Most 'open' LLMs are open-weight under custom or permissive licenses.
LumiChats includes leading open-weight models in its lineup so you can compare them directly against closed frontier models like GPT-5.5 and Claude on the same task.