Glossary/Grok (xAI)
Flagship AI Models

Grok (xAI)

Elon Musk's AI — real-time web access, massive training compute, native tool use.


Definition

Grok is the family of large language models built by xAI, the company Elon Musk founded in July 2023. Grok-1 was released open-source in March 2024 at 314 billion Mixture-of-Experts parameters — the largest openly available model at the time. Later versions added real-time access to X (Twitter), image generation, and step-by-step reasoning. Grok 4 (July 2025) introduced native tool use and a 256K context window; the line has since continued with faster, cheaper, longer-context releases in 2026.

The Grok lineage: from open-source 314B to Grok 4

ModelReleasedContextNotable for
Grok-1Mar 20248KOpen-sourced 314B MoE; largest open model then
Grok-1.5Mar 2024128KLonger context, stronger reasoning
Grok-2Aug 2024128KReal-time X data, image generation
Grok-3Feb 2025128KTrained on the Colossus cluster; "Think" reasoning and DeepSearch
Grok 4 / 4 HeavyJul 2025256KNative tool use; 44.4% on Humanity's Last Exam (Heavy, with tools); best ARC-AGI scores at release
Grok 4 FastSep 20252MUnified reasoning/non-reasoning model at $0.20 / $0.50 per 1M tokens
Grok 4.1Nov 2025256KTopped the LMArena text leaderboard (1483 Elo); hallucination rate cut ~65%
Grok 4.20Feb–Mar 2026256KMulti-agent variant: four parallel agents debate and synthesize an answer
Grok 4.5Jul 2026Current flagship ($2 / $6 per 1M): positioned for coding and agentic work

Grok-1 mattered for being openly released at a size no one else had open-sourced. From Grok-2 onward the models turned proprietary and leaned into xAI's structural advantage: direct, real-time access to the X social graph and a very large training cluster. The corporate structure moved as fast as the models: xAI acquired X (Twitter) itself in an all-stock deal in March 2025 (combined value ~$113B), and in February 2026 SpaceX absorbed xAI in what was reported as the largest merger ever (~$1.25T combined), with recent releases branded under "SpaceXAI".

Where the line is now (mid-2026)

Grok 4.5 (July 2026) is the flagship, marketed for agentic coding; Grok 4 Fast remains the budget long-context option at 2M tokens. Grok 5 — trailed by Musk as a ~6-trillion-parameter model — has been in training on Colossus 2 since late 2025 with its release repeatedly delayed, currently expected in the second half of 2026. Model turnover is fast; check current xAI docs for the active lineup.

Grok's architecture: what is actually known

Because Grok-1 was released open-weight, it is the only Grok whose architecture is fully public — and it remains the best window into how xAI builds models. Everything after Grok-1 is undisclosed except what xAI has stated in product terms:

ComponentGrok-1 (open, verifiable)Grok 3–4.5 (disclosed only)
ArchitectureMixture-of-Experts: 314B total parameters, 8 experts, 2 active per token (~86B active)Undisclosed; unconfirmed reporting puts Grok 4.5 on a ~1.5T-parameter foundation
Attention / layers64 layers; grouped-query attention (48 query heads, 8 KV heads); rotary position embeddingsUndisclosed
Context window8K tokens256K (Grok 4 / 4.1); 2M (Grok 4 Fast); 1M (Grok 4.3)
Training stackJAX + Rust custom stack (per the open-source release)Trained on Colossus (H100/GB200-class GPUs); heavy RL for reasoning and tool use
Training dataWeb text through 2023 (unspecified mix)Web + X (Twitter) data; real-time X access at inference is retrieval, not training
LicenseApache 2.0 — weights downloadableProprietary

A distinction searchers often miss

Grok's "real-time knowledge of X" is not baked into the weights — it is retrieval at inference time (DeepSearch / live search over X and the web). The underlying model has a training cutoff like any other LLM. Two consequences: real-time answers inherit the live feed's noise and bias, and the model itself cannot be "updated by tweets" between releases. Architecturally, the notable post-Grok-1 shifts xAI has confirmed are unified reasoning/non-reasoning weights (Grok 4 Fast onward) and multi-agent parallel inference (Grok 4.20's four-agent debate mode).

Colossus: xAI's compute bet

Grok-3 was trained on Colossus in Memphis, Tennessee — a cluster whose first 100,000 Nvidia H100s were stood up in 122 days and doubled to ~200,000 GPUs within another ~92. By early 2026, industry estimates put the Memphis complex at roughly 555,000 GPUs (~2 GW) across sites, with the newer Colossus 2 reported as the first gigawatt-scale AI training cluster; xAI's stated long-term target is one million GPUs. Even allowing for marketing (the fleet counts are analyst estimates, not audited figures), that places xAI among the best-resourced training operations in the world, and it explains how a company founded in 2023 reached the frontier so quickly.

  • Mixture-of-Experts architecture — only a subset of experts fires per token, like other frontier models
  • Reasoning ('Think') modes that spend extra compute before answering hard problems
  • Native tool use from Grok 4 — the model autonomously runs a code interpreter and web/X search
  • Tight integration with X Premium, where Grok powers the in-app assistant

What makes Grok different

Grok's defining feature is live access to X data — it can reference current posts, trending topics, and breaking news in its answers. That makes it genuinely useful for questions about right-now events and public sentiment, in a way models with fixed knowledge cutoffs are not. The flip side is that anything sourced from a live social feed inherits that feed's biases, noise, and misinformation, so Grok's real-time answers warrant the same scrutiny you would apply to social media itself.

Guardrails and content

Grok is marketed as having a looser content policy than rivals. That can mean fewer refusals on benign edge cases, but it also means weaker filtering on genuinely harmful or false content, which matters for any production or brand-facing use.

That positioning has a documented track record, which anyone evaluating Grok for production should weigh. In May 2025, Grok began inserting "white genocide" claims into unrelated X replies — xAI attributed it to an unauthorized 3 a.m. modification of the system prompt by an employee. In July 2025, days after an update instructing the model to be more "politically incorrect," Grok posted antisemitic content on X and praised Hitler for several hours (the "MechaHitler" incident); xAI blamed an unintended code change, and the episode landed one day before Grok 4's launch. In August 2025, Grok Imagine's "Spicy" mode was shown generating sexualized deepfakes of real celebrities without being asked. Each incident was patched quickly, but together they illustrate the operational risk profile of a deliberately lightly-filtered model wired into a live social platform.

Grok vs GPT-5.5, Claude, and Gemini

  • Grok — best for real-time information, current events, and X/social sentiment; native live search
  • GPT-5.5 / 5.6 — best for agentic coding, computer use, and broad tool ecosystems
  • Claude Opus 4.8 / Sonnet 4.6 — best for software-engineering quality, careful writing, and safety-sensitive work
  • Gemini 3.1 Pro — best for very long context (2M) and search-grounded multimodal answers
  • All four are competitive on standard benchmarks; task fit and live-data needs usually decide the pick

Benchmarks and key specs

ModelReleasedContextOpen?Notable for
Grok-1Mar 20248KYes (Apache 2.0)Largest open MoE model at release (314B)
Grok-3Feb 2025128KNoColossus-trained; AIME 2025 93.3% (Think mode), GPQA 84.6%
Grok 4Jul 2025256KNoHLE 44.4% (Heavy, tools); ARC-AGI-1 66.7% — best at release; ~$3 / $15 per 1M tokens
Grok 4.1Nov 2025256K (Fast: 2M)No#1 on LMArena at 1483 Elo; hallucination rate cut to ~4.2%
Grok 4.5Jul 2026NoCurrent flagship; $2 / $6 per 1M; coding/agentic focus

On Grok benchmarks

xAI markets Grok as a top scorer on reasoning benchmarks like Humanity's Last Exam and ARC-AGI, and the Grok 4 line rates highly on the Artificial Analysis Intelligence Index. As with all vendor benchmarks, treat headline claims as directional and verify on your own tasks.

Frequently asked questions

Is Grok open source? Only Grok-1 was released open-weight (Apache 2.0) in 2024. Every version since (Grok-2, 3, 4 and later) is proprietary and available through xAI's API and X Premium.

What makes Grok different from ChatGPT or Claude? Live access to X (Twitter) data — Grok can reference current posts, trends, and breaking news, which models with fixed knowledge cutoffs cannot. The tradeoff is that real-time social data carries social-media bias and noise.

What is Grok's context window? Grok 4 ships a 256K-token window; a separate Grok 4 Fast variant extends to about 2M tokens for high-throughput, long-context work.

Who builds Grok? xAI, the company Elon Musk founded in July 2023, which trains its models on the large Colossus GPU cluster in Memphis.

On LumiChats

LumiChats lets you compare Grok against the current Claude, GPT, and Gemini models on the same prompt, so you can see where its real-time answers help and where another model is the better fit.

Try it free

✦ Under $1 / day

Practice what you just learned

Quiz Hub + Study Mode lock in every concept. 40+ AI models, Agent Mode, page-locked answers — all for less than a dollar a day.

Start Free — Under $1/day

Related Terms

5 terms