AI Infrastructure

Best Mini PC for Local LLMs (2026): Strix Halo Boxes, DGX Spark-Class Systems, eGPU Minis and Jetson Compared

The six classes of mini PC that run language models locally in November 2026, with current models and prices checked on vendor stores: Ryzen AI Max+ 395 boxes with 64 to 128 GB, NVIDIA GB10 systems, the Mac mini, small PCs with OCuLink or a low-profile GPU, Intel Core Ultra minis and Jetson boards. What each one runs, estimated speeds, noise and power, and who should buy which.

The best mini PC for a local LLM in November 2026 is a Ryzen AI Max+ 395 box with 64 or 128 GB of unified memory, from $2,199.99, because it holds large models in a quiet 4-litre case. Choose an NVIDIA GB10 system if you need CUDA, a Mac mini from $899 for small models, an OCuLink mini with an external GPU for speed, and a Jetson for edge projects.

A mini PC is an appealing home for a local model: it sits on a shelf, draws little power and can stay on. But the category now covers machines that differ more than tenfold in price and far more than that in what they can run. The useful question is not which box is fastest but which class matches the models you want and the software you already use.

Prices in this guide are US list prices read from each vendor’s own store, and specifications come from the manufacturers’ product pages, on 14 and 15 November 2026. Prices in this category have moved several times this year, so treat every figure as a snapshot. Speeds are bandwidth-based estimates from our tokens-per-second calculator unless a source is named.

Quick picks: best mini PC for local AI by need

NeedClassExample and priceLargest model class
Large models, Windows or Linux, best valueRyzen AI Max+ 395 boxGMKtec EVO-X2, 64 GB, $2,199.99; 128 GB, $3,499.99120B mixture-of-experts at 128 GB
Same stack as NVIDIA serversGB10 system64 GB partner models from $4,999 per NVIDIA120B-class at 128 GB
Quiet, cheap, small modelsMac miniM6, 16 GB, from $8999B to 35B depending on memory
Fast tokens on a budgetOCuLink mini plus desktop GPUMinisforum X1 Lite barebone $311, DEG1 dock $119, plus a cardWhatever the card holds
Windows office mini that also runs modelsIntel Core Ultra miniASUS NUC 16 Pro, up to 128 GB DDR59B to 20B at usable speed
Edge and roboticsJetsonOrin Nano Super kit $399; AGX Thor kit $5,4992B to 4B on 8 GB; 120B-class on Thor

What makes a mini PC good for LLMs

Three numbers decide what a small machine can do, and none of them is the processor’s core count.

  1. Memory the GPU can reach. A model must fit in memory that the accelerator can address. In a unified-memory machine that is most of the system RAM. In a mini with a separate graphics card it is the card’s own memory. In a plain mini with integrated graphics it is system RAM, at system-RAM speed.
  2. Memory bandwidth. Generating a token means reading the model’s active weights once, so bandwidth caps speed. Ordinary dual-channel DDR5-5600 delivers 89.6 GB/s by arithmetic. The larger unified-memory chips in this guide deliver 256 to 307 GB/s. A desktop graphics card delivers several times more.
  3. Software stack. CUDA on NVIDIA, ROCm or Vulkan on AMD, Metal and MLX on Apple. This decides which tools work on day one and whether your set-up transfers to a server later.

Everything else, including NPU ratings, matters much less. Our laptop guide explains the bandwidth arithmetic in more detail.

AMD unified-memory mini PCs: models and prices

AMD’s Ryzen AI Max+ 395, known as Strix Halo, combines 16 Zen 5 cores, a 40-unit Radeon GPU and up to 128 GB of LPDDR5x-8000 on a 256-bit bus. AMD says a 128 GB system supports models of up to 200 billion parameters. Many vendors now build the same chip into small desktops, so the choice comes down to price, ports, cooling and support.

Mini PCConfigurationUS price, 15 Nov 2026What stands out
GMKtec EVO-X264 GB, 1 TB$2,199.99Cheapest route to 64 GB of unified memory
GMKtec EVO-X2128 GB, 1 TB or 2 TB$3,499.99 or $3,649.99Lowest 128 GB price we found
Minisforum MS-S1 MAX128 GB, 2 TB or 4 TB$3,959 or $4,199Full-length slot wired PCIe 4.0 x4, built-in 320 W supply, dual 10 GbE, USB4 v2, 2U rack support
Beelink GTR9 Pro128 GB, 2 TB$4,199Single 128 GB configuration
Corsair AI Workstation 300128 GB, 1 TB$4,399.99, listed down from $4,799.994.4-litre case, 300 W supply, two-year warranty
Framework Desktop32, 64, 128 or 192 GBNot shown in US dollars to us4.5 litres, 400 W supply, 28.8 dBA with the Noctua fan
HP Z2 Mini G1aUp to 128 GB, PRO chipConfigurator pricing300 W internal supply; up to 96 GB assignable to the GPU
AMD Ryzen AI Halo128 GB, or 192 GB with the PRO 495No price on AMD’s pageAMD’s own developer box, sold through Micro Center

A few buying notes:

  • 64 GB or 128 GB. The 64 GB EVO-X2 costs $1,300 less than the 128 GB one. It runs everything up to Qwen3.6-35B-A3B comfortably. Pay for 128 GB only if you want the 120B class.
  • A 192 GB tier now exists. Framework lists a Desktop with the Ryzen AI Max+ PRO 495 and 192 GB of LPDDR5x-8533, and AMD’s Halo page shows the same chip, which AMD rates for models of up to 300 billion parameters. Framework’s own table pairs it with DeepSeek V4.1 Flash at a 2-bit quantization using 163 GB.
  • Check GPU-addressable memory. HP states 96 GB of 128 GB; other vendors expose the setting in firmware. Ask before you size a model against the full 128 GB.
  • Memory is soldered. None of these can be upgraded later.

For set-up, drivers and measured behaviour on this chip, see our separate Strix Halo guide.

DGX Spark and GB10 partner systems

NVIDIA’s DGX Spark is a 150 mm square box, 50.5 mm tall and 1.2 kg, built on the GB10 chip: 128 GB of unified memory at 273 GB/s, up to 4 TB of self-encrypting storage and a 240 W supply. NVIDIA says it runs inference on models of up to 200 billion parameters and fine-tunes models of up to 70 billion.

Buying one is less simple than it was. NVIDIA’s product page lists no price for the 128 GB Founders Edition, and its Marketplace listing would not load for us on 15 November 2026. In October NVIDIA announced a 64 GB configuration “starting at $4,999”, sold only through partners from 23 October, and its scaling table rates that version for models of up to 100 billion parameters. Partner machines on the same chip include the Acer Veriton GN100, ASUS Ascent GX10, Dell Pro Max, Gigabyte AI TOP ATOM and HP ZGX Nano, with Lenovo and MSI also listed. Prices differ by retailer, so compare the listing on the day.

The reason to pay more than a Ryzen box costs is software. GB10 runs NVIDIA’s Linux with CUDA, so serving engines such as vLLM run as they do on data-centre GPUs, and NVIDIA’s scaling table goes up to four linked units. Our desk-side hardware comparison weighs it against the alternatives in detail, and NVIDIA’s Windows sibling is covered in the RTX Spark guide.

The Apple option, in brief

Apple’s US store lists the Mac mini with M6 and 16 GB from $899, and with M5 Pro and 24 GB from $1,699, configurable to 64 GB. Apple gives the M6 up to 170 GB/s of memory bandwidth and the M5 Pro 307 GB/s; our MacBook Pro M6 guide shows what the same chip holds at each memory size. It is the quietest and cheapest way into the category, with the limits that it runs macOS only and stops at 64 GB. Model picks for each configuration are in our guide to local models on Apple hardware.

Unified memory buys capacity. A graphics card buys speed. If the models you want fit in 16 to 32 GB, a cheap mini with a real GPU attached will generate tokens several times faster than any box above.

OCuLink and an external dock. OCuLink carries PCIe out of the case. Minisforum’s X1 Lite, with a Ryzen 7 255, two DDR5-5600 slots for up to 128 GB, OCuLink and USB4, is listed at $311 as a barebone or $743 with 32 GB and 1 TB, though every configuration showed as sold out on 15 November. The DEG1 dock is $119, provides a PCIe 4.0 four-lane link and takes a standard ATX or SFX power supply. Add a desktop card and you have a compact machine whose model memory is the card’s. The link is narrower than a desktop slot, which mainly lengthens model loading, because generation happens inside the card’s own memory.

A low-profile card inside. A few minis have a PCIe slot. The cards worth knowing are the 70 W workstation models:

CardMemoryPowerSize
NVIDIA RTX PRO 4000 Blackwell SFF Edition24 GB GDDR7, ECC70 W2.7 in high, 6.6 in long, dual slot
Intel Arc Pro B5016 GB GDDR6, 224 GB/s70 W, no power connector6.6 in by 2.7 in, dual slot

Intel specifies a 280 W minimum system supply for the Arc Pro B50. At 224 GB/s it should run gpt-oss-20b at about 37 tokens a second by our estimate. To choose a full-size card for a dock, use the GPU buyer’s guide and the model picks by graphics memory.

The trade-off is tidiness. A dock, a power supply and an exposed card are no longer a mini PC in any meaningful sense, and the fans on a desktop GPU are louder than any box in this guide.

Intel Core Ultra mini PCs

The ASUS NUC 16 Pro is the reference design for this class. ASUS lists it with Intel Core Ultra processors up to the X9 388H, Intel Arc integrated graphics, two Thunderbolt 4 ports and a 120 W or 150 W adapter, in a case of 144 by 117 by 42 mm. Memory is either two slots taking up to 128 GB of DDR5-7200 modules, or soldered LPDDR5x-8533 in 32 and 64 GB versions.

DDR5-7200 on two channels gives 115.2 GB/s by arithmetic, and LPDDR5x-8533 gives 136.5 GB/s. That is roughly half of a Strix Halo box, with a far smaller integrated GPU. In practice an Intel mini is an office PC that also runs models: fine for a 9B assistant or gpt-oss-20b at around 19 to 23 tokens a second by our estimate, slow for anything dense above 20B. The appeal is price, Windows manageability and slotted memory you can upgrade.

Jetson boards

NVIDIA’s Jetson line is built for devices rather than desks, but it is the smallest CUDA hardware you can buy. NVIDIA’s Jetson FAQ listed these developer kit prices on 15 November 2026, along with $3,499 for the older Jetson AGX Orin kit:

KitMemoryPowerPrice
Jetson Orin Nano Super Developer Kit8 GB, 102 GB/s7 to 25 W$399
Jetson AGX Thor Developer Kit128 GB, 273 GB/s40 to 130 W$5,499

The Orin Nano Super suits 2B to 4B models. Google’s LiteRT-LM card for Gemma 4 E2B reports 24.2 tokens a second on its GPU and 12.2 on its CPU. The Thor kit has the same memory and bandwidth as a GB10 desktop; NVIDIA announced it at $3,499 in August 2025 and its FAQ now lists $5,499. Buy a Jetson when the model has to live inside a product or at a site with a tight power budget. Our article on CPU and NPU inference at the edge covers that deployment pattern.

What each mini PC can run

File sizes are the GGUF downloads published by the llama.cpp project and LM Studio on Hugging Face. Speeds are estimates for one user from the calculator’s method, which assumes a runtime reaches 60% of peak bandwidth; they are not benchmarks.

Memory poolExample systemsModels that fit, with file sizeEstimated tokens per second
8 GBJetson Orin Nano SuperGemma 4 E2B, 2.59 GB (LiteRT)24.2, measured by Google
16 to 32 GB of DDR5Minisforum X1 Lite, ASUS NUC 16 ProQwen3.5-9B, 5.63 GB; gpt-oss-20b, 12.11 GBgpt-oss-20b: about 15 on DDR5-5600, 19 on DDR5-7200
16 to 32 GB, Apple M6Mac mini M6Qwen3.5-9B; gpt-oss-20b at 24 GB and upgpt-oss-20b: about 28 at 170 GB/s
64 GB unifiedGMKtec EVO-X2 64 GB, Mac mini M5 Pro, GB10 64 GBQwen3.6-35B-A3B, 20.54 GB; Gemma 4 26B A4B at 8-bit, 26.86 GBgpt-oss-20b: about 42 to 51
128 GB unifiedStrix Halo 128 GB, DGX Spark, Jetson AGX Thorgpt-oss-120b, 63.39 GBgpt-oss-120b: about 31 to 33; Llama 3.3 70B at 4-bit: about 4
192 GB unifiedFramework Desktop or Ryzen AI Halo with PRO 495DeepSeek V4.1 Flash at 2-bit, 163 GB, per FrameworkNot estimated

Two patterns matter more than any single number. Mixture-of-experts models are the right choice for every unified-memory box, because they read only a few billion parameters per token: gpt-oss-120b is about eight times faster than a dense 70B model on the same machine. And capacity without bandwidth disappoints: a 128 GB DDR5 mini can load the same file as a Strix Halo box and run it at a third of the speed. To test a specific model and window before buying, use the VRAM and KV cache calculator.

Mini PC for Ollama: what works

Ollama is the usual first install on any of these machines. From its documentation, as it applies here:

  • Acceleration. NVIDIA GPUs through CUDA, AMD through ROCm version 7 with the Ryzen AI Max+ 395 on the supported list, Apple silicon through Metal, and other GPUs on Windows and Linux through Vulkan. With none of those, it runs on the CPU.
  • Context. The default window follows GPU memory: 4K below 24 GiB, 32K from 24 to 48 GiB, 256K from 48 GiB. On a small mini, set it yourself.
  • Network. The server binds to 127.0.0.1 on port 11434. To use the mini from other devices you must change OLLAMA_HOST, and the API has no login of its own, as our Ollama security review explains.
ollama run gpt-oss:20b
OLLAMA_CONTEXT_LENGTH=32768 ollama serve
ollama ps

A mini PC makes a good always-on endpoint for one person or a household. For a team sharing one box, read what changes with several Ollama users first: requests queue, and every concurrent session needs its own context memory.

Noise and power

SystemPower figure from the vendorNoise figure
Jetson Orin Nano Super kit7 to 25 WNot published
ASUS NUC 16 Pro120 W or 150 W adapterNot published
AMD Ryzen AI Halo120 W chip TDPNot published
NVIDIA DGX Spark240 W supply, 140 W chip TDPNot published
Corsair AI Workstation 300300 W internal supplyDescribed as quiet; no figure
Minisforum MS-S1 MAX320 W internal supplyNot published
Framework Desktop400 W internal supply28.8 dBA with the Noctua fan; up to 34 dBA with the alternative fan

Supply ratings are ceilings, not typical draw. AMD’s own cost example for a Ryzen AI Max+ system assumes 150 W sustained as a worst case, which it prices at $16.20 a month at $0.15 per kWh running all day. Only Framework publishes a noise figure, so for a machine that will sit beside you, look for an independent review of the exact model. Smaller cases with smaller fans are generally louder under sustained load.

Who should buy what

  • A developer who wants large models locally: a 128 GB Ryzen AI Max+ 395 box, or 64 GB if 35B-class models are enough.
  • A team that will deploy on NVIDIA servers: a GB10 system, so the serving stack you test is the one you ship.
  • Someone who wants a silent always-on assistant: a Mac mini with 24 or 32 GB.
  • Someone who values speed over capacity: an OCuLink mini and a 16 to 24 GB graphics card.
  • An IT team standardising office hardware: an Intel Core Ultra mini with 32 GB or more, accepting small-model speeds.
  • A product or site with a power limit: a Jetson.

How VDF AI fits

VDF AI does not sell, resell or ship on any of the mini PCs in this guide, and it has no integration with a particular box. It is a platform for organisations that run governed AI on their own servers, private cloud or an air-gapped network. The honest link is the step after the purchase: a mini PC serves one person well, and a department needs to know who hosts the model, which models are approved, who can reach them and what is recorded.

VDF AI Router registers Ollama and custom on-premises deployments alongside any cloud models your policy allows, and its air-gap mode restricts routing to local models. The self-hosting requirements describe what the platform itself needs. To discuss a pilot, contact us.

Sources

Vendor stores and product pages as they stood on 14 and 15 November 2026.


Outgrowing one box under the desk? See how VDF AI Router routes across on-premises models, or book a demo.

Frequently asked questions

What is the best mini PC for running a local LLM?

For most buyers it is a Ryzen AI Max+ 395 box. The chip shares up to 128 GB of fast memory between the CPU and a large integrated GPU, so one small machine holds models up to the 120B class. On 15 November 2026 GMKtec listed the EVO-X2 at $2,199.99 with 64 GB and $3,499.99 with 128 GB. Teams that deploy on NVIDIA servers should look at GB10 systems instead for the CUDA stack, and a Mac mini is the low-cost, quiet choice for models up to about 35B.

How much RAM does a mini PC need for local AI?

Size the memory to the model file plus room for context. A 16 GB mini runs 4B to 9B models. With 32 GB, mixture-of-experts models such as gpt-oss-20b (12.11 GB) and Gemma 4 26B A4B (14.62 GB) fit. With 64 GB, Qwen3.6-35B-A3B fits with a long context window. Only 128 GB holds gpt-oss-120b, whose file is 63.39 GB. Memory in most of these machines is soldered, so buy the amount you will need for the life of the box.

Can a mini PC run Ollama?

Yes. Ollama installs on macOS, Linux and Windows and runs on the CPU when no supported GPU is present. Its hardware documentation lists NVIDIA GPUs through CUDA, AMD hardware through ROCm including the Ryzen AI Max+ 395, Apple silicon through Metal, and other GPUs on Windows and Linux through Vulkan. Two defaults matter on a mini PC: the server listens only on 127.0.0.1, and the context window defaults to 4K when the GPU has under 24 GiB, so set OLLAMA_CONTEXT_LENGTH yourself.

Can I add a graphics card to a mini PC for LLMs?

In two ways. Minis with an OCuLink port connect a desktop card through an external dock; Minisforum's DEG1 dock costs $119 and gives a PCIe 4.0 four-lane link, with a separate ATX or SFX power supply for the card. Minis with an internal slot, such as the Minisforum MS-S1 MAX, take low-profile cards: NVIDIA's RTX PRO 4000 Blackwell SFF has 24 GB at 70 W, and Intel's Arc Pro B50 has 16 GB at 70 W with no power connector. Check card length and slot power with the vendor.

How much does a mini PC for local AI cost in November 2026?

Prices in this category moved up during 2026. On the vendors' US stores on 15 November: a Jetson Orin Nano Super kit is $399; a Mac mini starts at $899 with M6 and $1,699 with M5 Pro; a 64 GB Ryzen AI Max+ 395 box is $2,199.99 from GMKtec; 128 GB versions run from $3,499.99 to $4,399.99 across GMKtec, Minisforum, Beelink and Corsair; NVIDIA says 64 GB GB10 partner systems start at $4,999; and the Jetson AGX Thor kit is $5,499.

Is a Jetson board good for running LLMs?

For embedded and edge projects, yes; as a desktop chat machine, less so. The Jetson Orin Nano Super kit has 8 GB of memory and draws 7 to 25 W, which suits 2B to 4B models: Google measured 24.2 tokens a second for Gemma 4 E2B on its GPU. The Jetson AGX Thor kit has 128 GB at 273 GB/s and runs the same large models as a GB10 desktop, but costs $5,499 and is built for robotics. Neither is sold as a ready-made desktop PC.

Filed under
local LLMlocal AI hardwaremini PCOllamaopen-weight modelson-premises AI
On-Prem AI

Plan your on-prem AI deployment

Book an architecture call and we will scope a private, on-prem AI deployment for your environment — integrations, hardware, and governance included.

Keep reading