AR | Build Notes ری ٹویٹ کیا

14 AI models. One simple question about a Sherpa who made history.
13 wrong answers!!!
Hallucinated names, empty responses, or "I don't know."
The question: Who was the sherpa who climbed 7 Himalayan peaks in a few months?
These are all local models running on my own hardware — no API, no cloud, just raw inference on a Minisforum MS-S1 Max (96GB unified RAM) and a Mac Mini M4 (24GB RAM).
Here's who failed:
llama3.2:1b — deflected to Tenzing Norgay and Edmund Hillary
deepseek-coder-v2:16b — confidently fabricated a detailed biography of the wrong person
deepseek-v2:16b — named Apa Sherpa, then contradicted itself mid-sentence
gemma2:2b — gave Kami Rita Sherpa's Everest summit count instead
llama3.2:3b — mentioned Nirmal Purja (different feat, different person)
qwen2.5:3b — invented "Pasang Lhamu climbing 7+14 peaks in 2014–2015"
phi3:mini — said "no widely recognized record matches this description"
qwen3-coder:30b — guessed "Babu Chiri Sherpa", asked for more details
qwen3-coder:latest — empty response
qwen3.5:35b-a3b — empty response
glm-4.7-flash — empty response
deepseek-r1:14b — empty response
nemotron-3-super — timed out
nemotron-cascade-2 — timed out
One model answered correctly.
gemma3:27b, running locally on the Minisforum:
"You're likely referring to Gelje Sherpa. In the spring of 2023, Gelje Sherpa achieved a remarkable feat by summiting seven of the 14 highest peaks in the Himalayas (all over 8,000 meters) in just over three months! This included: Shishapangma (8,027m), Manaslu (8,163m), Dhaulagiri (8,167m), Annapurna I (8,091m) — particularly dangerous and rarely climbed — Makalu (8,485m), Lhotse (8,516m), and Everest (8,848m). This was an incredible accomplishment, and a record-breaking one for the speed of summiting so many 8,000-meter peaks in a single season."
One question.
One right answer.
From the 8th fastest model in the test.
The rest were confident, fluent, and wrong.

English















