A-TIER news
Qwen 3.8 27B — local agentic model that fits on one 24GB GPU
100k ft — What is this?
Qwen 3.8 27B — local agentic model that fits on one 24GB GPU
50k ft — Why care?
Alibaba's Qwen 3.8 27B quantizes to ~17GB at 4-bit, running on a single RTX 3090/4090, and Qwen's own benchmarks claim 84.3 on OSWorld plus wins on SWE-Bench Pro. Gated DeltaNet layers keep a compact running memory instead of full attention, and it preserves reasoning across tool-call steps, so pair it with an agent harness rather than chatting.
10k ft — Key takeaways
• A 4-bit 27B model leaves room for real context on a 24GB card
• Benchmarks are vendor-reported, wait for independent evals
• Use it as the brain of a local agent with scoped file/terminal/browser access
5k ft — Tools & techniques
Anthropic, Qwen, Unsloth
AI agents, Gated DeltaNet, code generation, quantization, tool use
1k ft — Deep-dive / try it
Alibaba just released a SUPERPOWERED Al model that’s small enough to run locally!
Qwen 3.8 27b released a few hours ago, and groups like Unsloth are already optimizing quantized versions.
This model is extraordinary with tool use, computer interaction, coding, and agentic worktlows.
This video will help explain why it’s so strong, what makes it different, and how you can start using it today!
#breakingnews #ai #localai #china #gigaqian
Transcript excerpt
While everyone is talking about the newly-revealed Epstein emails, China just released what might be the best local AI model on Earth. And if you're paying attention, you're about to get superpowers. If you're new, I'm Giga Chen. I do business in China, and I'm here to make sure that you all stay way ahead. Today, Alibaba released Quen 3.8 27b. The 27b stands for 27 billion parameters, and if you've been following, you know. Those are the learned numbers that essentially make up the model. Still sounds pretty big, but here's where it gets interesting. Using quantization, where we store those numbers with less precision to dramatically shrink the model, a roughly four-bit version can take up about 17 gigabytes. That means you can run it on a single 24-gigabyte GPU, like an RTX 3090 or 4090, with room for a practical context window. And according to Quen's own benchmarks, this model, which is tiny by frontier standards, scored 84.3 on OS World, which tests a model actually using a computer. Opus 4.6 Max scored more than 10 points below that in Quen's table. Opus also lost on SWE Bench Pro and their Long Horizon Office Work benchmark. These are Quen's evaluations, so independent testing has to catch up, but not the best day for Anthropic. But we know Anthropic makes amazing models, so how is Quen this good? Those numbers are ridiculous for a model this small. Part of it is something called gated delta net. Basically, instead of every layer constantly comparing every piece of…
Appears in
- Guide: Earned Autonomy — a three-tier router that demotes work to your own GPU
- Deeper dive: Earned Autonomy — a three-tier router that demotes work to your own GPU
- Guide: Offline AI Appliances — one job, one box, no cloud
- Deeper dive: Offline AI Appliances — one job, one box, no cloud
- Guide: The AI Capex Stack — reading it like a credit analyst
- Deeper dive: The AI Capex Stack — reading it like a credit analyst
More from @gigaqian
- B-TIER Xiaomi AI Cube — 80GB unified-memory box running 120B models locally
- B-TIER Moderna–Merck personalized mRNA cancer therapy — first positive Phase 3
- B-TIER Grok Bot — persistent AI workers sharing one cloud computer
- A-TIER Evo-designed bacteriophages — AI genomes that beat human gene swaps
- A-TIER DeepSeek V4 Flash re-post-training — big agentic gains, same model size