Pocket AI Lab
  1. Home
  2. Models
  3. mlx-community

mlx-community/Qwen2.5-3B-Instruct-4bit

Qwen 2.5 3B on iPhone

  • MLX
  • 4bit
  • 3B params
  • 💬 text
  • 32K ctx

How fast does Qwen 2.5 3B run on iPhone?

On an iPhone Air (A19, iOS 26.6.1), Qwen 2.5 3B generated 26.3 tokens per second in Pocket AI Lab 1.1.0, averaged over 3 runs of 200 tokens (± 2.8).

On the standard llama-bench style probe it read a 512-token prompt at about 249 tok/s and generated 128 tokens at 22.4 tok/s. Cold load took 1.7 s and the process peaked at 2,360 MB.

How much memory and storage does Qwen 2.5 3B need?

The catalog budgets 2.2 GB of RAM and 2.0 GB of storage for the 4bit build of Qwen 2.5 3B. The measured peak footprint on iPhone Air was 2,360 MB.

Its backend copies weights into the app's memory, so the app checks it against the per-app limit iOS enforces. On a 6 GB iPhone that limit is much lower than 6 GB.

Which iPhones can run Qwen 2.5 3B?

Qwen 2.5 3B runs on iPhones with 6 GB of RAM or more.

RAMiPhonesPocket AI Lab
3–4 GBiPhone 11, 11 Pro, 12, 12 mini, 13, 13 mini, SE (2nd and 3rd gen)Not measured yet
6 GBiPhone 12 Pro, 13 Pro, 14, 14 Plus, 14 Pro, 15, 15 Plus✓ Runs
8 GBiPhone 15 Pro, 16, 16 Plus, 16 Pro, 16e, 17, 17e✓ Runs
12 GBiPhone 17 Pro, 17 Pro Max, iPhone Air✓ Runs

Based on the memory budgets the app measures on each class of iPhone (October 2026). Before downloading, the app checks your exact phone and only offers what fits.

What can Qwen 2.5 3B do in Pocket AI Lab?

It's a text model for chat, drafting, summaries and quick questions, fully offline once downloaded.

How did Qwen 2.5 3B score on the quality suite?

It passed 65 of 118 tasks, a score of 55.1 out of 100 on suite v3.

  • Math2/8
  • Instructions32/45
  • Knowledge24/57
  • Retrieval4/4
  • Multilingual3/4

Tasks are graded by deterministic checks (exact numbers, regex, word counts, valid JSON), with greedy decoding. See the method.

All runs of Qwen 2.5 3B

ModelGen tok/spp512 / tg128Load sPeak MBScoreDate
Qwen 2.5 3BMLX 24.5 ± 1.7 ~241 / 21.7 1.2 2,345 69.6 2026-09-03
Qwen 2.5 3BMLX 30.8 ± 2.3 ~239 / 29.4 0.7 2,332 69.6 2026-09-04
Qwen 2.5 3BMLX 26.3 ± 2.8 ~249 / 22.4 1.7 2,360 55.1 2026-10-22

How do I install Qwen 2.5 3B?

Open the Models tab in Pocket AI Lab and tap Qwen 2.5 3B. The app checks it against your phone's memory, downloads 2.0 GB from Hugging Face and it's ready for offline chat.