Skip to content

Thinking Machines Announces Inkling 2 Mini

Thinking Machines introduces Inkling 2 Mini, a powerful and efficient model designed for local hardware.

Sources in the coveragePerformance and quality statements from a vendor are claims unless the coverage cites independent measurements.

Evidence & verification 3 statements

Specifications, source statements and editorial judgement have different scopes. A citation is not an independent performance test.

Total ParametersSource statement

26.4B

thinkingmachines.ai ↗Source observation date not recorded.
Memory FootprintSource statement

~20GB

thinkingmachines.ai ↗Source observation date not recorded.
DeepSWE v1.1 ScoreSource statement

48.2%

thinkingmachines.ai ↗Source observation date not recorded.

Thinking Machines has released Inkling 2 Mini, a looped transformer model designed to run on consumer laptops and desktop AI computers. It excels in tasks requiring reasoning and is optimized for speed and efficiency.

Key facts

Fact Detail The source says
Total Parameters 26.4B “Params (B) activated / total / 5.4/26.4”
Memory Footprint ~20GB “The total memory footprint of Inkling 2 Mini is ~20GB”
DeepSWE v1.1 Score 48.2% “Inkling 2 Mini leads every open-weights model with less than 100B total parameters on benchmarks such as DeepSWE v1.1 (48.2%)”

What happened

Thinking Machines has released Inkling 2 Mini, a looped transformer model designed to run on consumer laptops and desktop AI computers. It excels in tasks requiring reasoning and is optimized for speed and efficiency. Inkling 2 Mini is the first model with a looped architecture available to researchers, allowing for cleaner comparisons between different looping depths. The model is small enough to run on local devices, with a total memory footprint of ~20GB. It leads open-weights models of similar size on benchmarks such as DeepSWE v1.1 (48.2%) and Vals Index v2.2 (46.5%). Inkling 2 Mini is available for inference and customization on Tinker and supports various platforms for local inference.

What to weigh

  • Inkling 2 Mini is optimized for local hardware and runs efficiently on NVIDIA’s DGX Spark desktop AI computer.
  • The model is designed for tasks requiring reasoning and is the best among open-weights models of similar size on most tasks.

Source: thinkingmachines.ai

Keep following technology

Continue from here.

Explore more coverage or subscribe to Fathom Layer updates.

Back to the news desk ↗

Occasional verified technology updates. Unsubscribe anytime. See our privacy policy.