[History of Distillation] From Model Compression in 2006 to On-Policy Distillation in 2026

The DeepSeek-R1 paper reports that a 1.5B small model created via distillation achieved a score of 28.9 (pass@1) on the AIME 2024 math contest, surpassing the 9.3 achieved by GPT-4o (0513 version).
Pulse 2.0

Multiverse Computing: $215 Million Secured For Scaling Quantum AI Model Compression

Multiverse Computing, a quantum-inspired AI model compression company, has developed CompactifAI, a compression technology capable of reducing the size of LLMs (Large Language Models) by up to 95% ...
VentureBeat

Here are 3 critical LLM compression strategies to supercharge AI performance

In today’s fast-paced digital landscape, businesses relying on AI face new challenges: latency, memory usage and compute power costs to run an AI model. As AI advances rapidly, the models powering ...
Help Net Security

Google’s TurboQuant cuts AI memory use without losing accuracy

Large language models carry a persistent scaling problem. As context windows grow, the memory required to store key-value (KV) caches expands proportionally, consuming GPU memory and slowing inference ...
techtimes

AI Model Compression for $1,000: Ora Computing Uses Quantum Physics to Beat Hardware Lock-In

Vienna-based Ora Computing announced a €3.5 million seed round on June 24, 2026 — backed by Swiss venture firm Constructor Capital and Helsinki-based climate investor Greencode Ventures — around a ...