Grok (xAI)
Grok is the family of large language models built by xAI, the company Elon Musk founded in July 2023. Grok-1 was released open-source in March 2024 at 314 billion Mixture-of-Experts parameters — the largest openly available model at the time. Later versions added real-time access to X (Twitter), image generation, and step-by-step reasoning. Grok 4 (July 2025) introduced native tool use and a 256K context window; the line has since continued with faster, cheaper, longer-context releases in 2026.
Elon Musk's AI — real-time web access, massive training compute, native tool use.
Category: Flagship AI Models
The Grok lineage: from open-source 314B to Grok 4
| Model | Released | Context | Notable for |
|---|---|---|---|
| Grok-1 | Mar 2024 | 8K | Open-sourced 314B MoE; largest open model then |
| Grok-1.5 | Mar 2024 | 128K | Longer context, stronger reasoning |
| Grok-2 | Aug 2024 | 128K | Real-time X data, image generation |
| Grok-3 | Feb 2025 | 128K | Trained on the Colossus cluster; "Think" reasoning and DeepSearch |
| Grok 4 / 4 Heavy | Jul 2025 | 256K | Native tool use; 44.4% on Humanity's Last Exam (Heavy, with tools); best ARC-AGI scores at release |
| Grok 4 Fast | Sep 2025 | 2M | Unified reasoning/non-reasoning model at $0.20 / $0.50 per 1M tokens |
| Grok 4.1 | Nov 2025 | 256K | Topped the LMArena text leaderboard (1483 Elo); hallucination rate cut ~65% |
| Grok 4.20 | Feb–Mar 2026 | 256K | Multi-agent variant: four parallel agents debate and synthesize an answer |
| Grok 4.5 | Jul 2026 | — | Current flagship ($2 / $6 per 1M): positioned for coding and agentic work |
Grok-1 mattered for being openly released at a size no one else had open-sourced. From Grok-2 onward the models turned proprietary and leaned into xAI's structural advantage: direct, real-time access to the X social graph and a very large training cluster. The corporate structure moved as fast as the models: xAI acquired X (Twitter) itself in an all-stock deal in March 2025 (combined value ~$113B), and in February 2026 SpaceX absorbed xAI in what was reported as the largest merger ever (~$1.25T combined), with recent releases branded under "SpaceXAI".
Where the line is now (mid-2026): Grok 4.5 (July 2026) is the flagship, marketed for agentic coding; Grok 4 Fast remains the budget long-context option at 2M tokens. Grok 5 — trailed by Musk as a ~6-trillion-parameter model — has been in training on Colossus 2 since late 2025 with its release repeatedly delayed, currently expected in the second half of 2026. Model turnover is fast; check current xAI docs for the active lineup.
Grok's architecture: what is actually known
Because Grok-1 was released open-weight, it is the only Grok whose architecture is fully public — and it remains the best window into how xAI builds models. Everything after Grok-1 is undisclosed except what xAI has stated in product terms:
| Component | Grok-1 (open, verifiable) | Grok 3–4.5 (disclosed only) |
|---|---|---|
| Architecture | Mixture-of-Experts: 314B total parameters, 8 experts, 2 active per token (~86B active) | Undisclosed; unconfirmed reporting puts Grok 4.5 on a ~1.5T-parameter foundation |
| Attention / layers | 64 layers; grouped-query attention (48 query heads, 8 KV heads); rotary position embeddings | Undisclosed |
| Context window | 8K tokens | 256K (Grok 4 / 4.1); 2M (Grok 4 Fast); 1M (Grok 4.3) |
| Training stack | JAX + Rust custom stack (per the open-source release) | Trained on Colossus (H100/GB200-class GPUs); heavy RL for reasoning and tool use |
| Training data | Web text through 2023 (unspecified mix) | Web + X (Twitter) data; real-time X access at inference is retrieval, not training |
| License | Apache 2.0 — weights downloadable | Proprietary |
A distinction searchers often miss: Grok's "real-time knowledge of X" is not baked into the weights — it is retrieval at inference time (DeepSearch / live search over X and the web). The underlying model has a training cutoff like any other LLM. Two consequences: real-time answers inherit the live feed's noise and bias, and the model itself cannot be "updated by tweets" between releases. Architecturally, the notable post-Grok-1 shifts xAI has confirmed are unified reasoning/non-reasoning weights (Grok 4 Fast onward) and multi-agent parallel inference (Grok 4.20's four-agent debate mode).
Colossus: xAI's compute bet
Grok-3 was trained on Colossus in Memphis, Tennessee — a cluster whose first 100,000 Nvidia H100s were stood up in 122 days and doubled to ~200,000 GPUs within another ~92. By early 2026, industry estimates put the Memphis complex at roughly 555,000 GPUs (~2 GW) across sites, with the newer Colossus 2 reported as the first gigawatt-scale AI training cluster; xAI's stated long-term target is one million GPUs. Even allowing for marketing (the fleet counts are analyst estimates, not audited figures), that places xAI among the best-resourced training operations in the world, and it explains how a company founded in 2023 reached the frontier so quickly.
- Mixture-of-Experts architecture — only a subset of experts fires per token, like other frontier models
- Reasoning ('Think') modes that spend extra compute before answering hard problems
- Native tool use from Grok 4 — the model autonomously runs a code interpreter and web/X search
- Tight integration with X Premium, where Grok powers the in-app assistant
What makes Grok different
Grok's defining feature is live access to X data — it can reference current posts, trending topics, and breaking news in its answers. That makes it genuinely useful for questions about right-now events and public sentiment, in a way models with fixed knowledge cutoffs are not. The flip side is that anything sourced from a live social feed inherits that feed's biases, noise, and misinformation, so Grok's real-time answers warrant the same scrutiny you would apply to social media itself.
Guardrails and content: Grok is marketed as having a looser content policy than rivals. That can mean fewer refusals on benign edge cases, but it also means weaker filtering on genuinely harmful or false content, which matters for any production or brand-facing use.
That positioning has a documented track record, which anyone evaluating Grok for production should weigh. In May 2025, Grok began inserting "white genocide" claims into unrelated X replies — xAI attributed it to an unauthorized 3 a.m. modification of the system prompt by an employee. In July 2025, days after an update instructing the model to be more "politically incorrect," Grok posted antisemitic content on X and praised Hitler for several hours (the "MechaHitler" incident); xAI blamed an unintended code change, and the episode landed one day before Grok 4's launch. In August 2025, Grok Imagine's "Spicy" mode was shown generating sexualized deepfakes of real celebrities without being asked. Each incident was patched quickly, but together they illustrate the operational risk profile of a deliberately lightly-filtered model wired into a live social platform.
Grok vs GPT-5.5, Claude, and Gemini
- Grok — best for real-time information, current events, and X/social sentiment; native live search
- GPT-5.5 / 5.6 — best for agentic coding, computer use, and broad tool ecosystems
- Claude Opus 4.8 / Sonnet 4.6 — best for software-engineering quality, careful writing, and safety-sensitive work
- Gemini 3.1 Pro — best for very long context (2M) and search-grounded multimodal answers
- All four are competitive on standard benchmarks; task fit and live-data needs usually decide the pick
Benchmarks and key specs
| Model | Released | Context | Open? | Notable for |
|---|---|---|---|---|
| Grok-1 | Mar 2024 | 8K | Yes (Apache 2.0) | Largest open MoE model at release (314B) |
| Grok-3 | Feb 2025 | 128K | No | Colossus-trained; AIME 2025 93.3% (Think mode), GPQA 84.6% |
| Grok 4 | Jul 2025 | 256K | No | HLE 44.4% (Heavy, tools); ARC-AGI-1 66.7% — best at release; ~$3 / $15 per 1M tokens |
| Grok 4.1 | Nov 2025 | 256K (Fast: 2M) | No | #1 on LMArena at 1483 Elo; hallucination rate cut to ~4.2% |
| Grok 4.5 | Jul 2026 | — | No | Current flagship; $2 / $6 per 1M; coding/agentic focus |
On Grok benchmarks: xAI markets Grok as a top scorer on reasoning benchmarks like Humanity's Last Exam and ARC-AGI, and the Grok 4 line rates highly on the Artificial Analysis Intelligence Index. As with all vendor benchmarks, treat headline claims as directional and verify on your own tasks.
Frequently asked questions
Is Grok open source? Only Grok-1 was released open-weight (Apache 2.0) in 2024. Every version since (Grok-2, 3, 4 and later) is proprietary and available through xAI's API and X Premium.
What makes Grok different from ChatGPT or Claude? Live access to X (Twitter) data — Grok can reference current posts, trends, and breaking news, which models with fixed knowledge cutoffs cannot. The tradeoff is that real-time social data carries social-media bias and noise.
What is Grok's context window? Grok 4 ships a 256K-token window; a separate Grok 4 Fast variant extends to about 2M tokens for high-throughput, long-context work.
Who builds Grok? xAI, the company Elon Musk founded in July 2023, which trains its models on the large Colossus GPU cluster in Memphis.
LumiChats lets you compare Grok against the current Claude, GPT, and Gemini models on the same prompt, so you can see where its real-time answers help and where another model is the better fit.