Blog

From Research to Reality: Fitting an 11B VLM on a Phone

Douglas Orr and Luke Ribar — Wed, 26 Aug 2026 08:00:00 GMT

It’s great to have a vision-language model (VLM) in your pocket. The combination of textual and visual intelligence is a perfect fit for personal devices like phones, laptops and wearables. However, such models can be memory-intensive and challenging to deploy on low-power devices. While demand continues to grow for large frontier models running in the cloud, AI for power constrained mobile devices and robotics is also growing fast.

A team of �ֲ��ý��Ƶ and Arm researchers recently took on a deliberately ambitious challenge: to fit a large 11B VLM, originally requiring more than 21 GB for its weights, into a storage budget of roughly 4 GB, to fit on an Android phone.

The result was a 3.7 GB implementation of Llama 3.2 Vision Instruct, which we achieved using a novel format codesigned with Arm CPUs in mind and a quantisation-aware training procedure that samples diverse prompts to retain the capabilities of the original model.

Welcome to �ֲ��ý��Ƶ Taipei

Meg Cheng — Mon, 03 Aug 2026 08:56:48 GMT

On 4 June, we officially opened a stunning new �ֲ��ý��Ƶ office and engineering lab in Taipei’s Nangang district, in addition to our existing facility in Hsinchu. This expansion demonstrates �ֲ��ý��Ƶ’s commitment to and continued investment in Taiwan, a strategically important location for the AI semiconductor industry, enabling us to deepen our strong relationships with our manufacturing and supply chain partners.

�ֲ��ý��Ƶ Co-Founder and Executive Chair, Nigel Toon, steps down

info@graphcore.ai (Nigel Toon) — Fri, 31 Jul 2026 11:30:04 GMT

With effect from Friday 31^st July 2026 I will step down from my role as Executive Chair at �ֲ��ý��Ƶ, the company I co-founded together with Simon Knowles back in July 2016.

Creativity in Engineering

Demitri Peynado — Thu, 02 Jul 2026 07:17:00 GMT

Many of the teams developing �ֲ��ý��Ƶ’s core technology work across disciplines to support the next generation of AI computing.

Why I chose �ֲ��ý��Ƶ: Where I could grow, not just succeed

Manojkumar Reddy Malipela — Thu, 18 Jun 2026 02:29:59 GMT

�ֲ��ý��Ƶ’s new AI Engineering Campus in Bengaluru marks a significant investment in the future of AI computing and in the engineers who will build it. As a wholly owned subsidiary of SoftBank Group, �ֲ��ý��Ƶ is scaling its end-to-end system capabilities to help shape the next generation of compute for artificial intelligence.

Blog

From Research to Reality: Fitting an 11B VLM on a Phone

Welcome to �ֲ���ý��Ƶ Taipei

�ֲ���ý��Ƶ Co-Founder and Executive Chair, Nigel Toon, steps down

Creativity in Engineering

Why I chose �ֲ���ý��Ƶ: Where I could grow, not just succeed

Welcome to �ֲ��ý��Ƶ Taipei

�ֲ��ý��Ƶ Co-Founder and Executive Chair, Nigel Toon, steps down

Why I chose �ֲ��ý��Ƶ: Where I could grow, not just succeed