Top-ranked stack
Desktop applications for running local language models on consumer hardware.
Jan with Qwen2.5-7B-Instruct
71.9
overall
63
open
74.2
bench
7
non-open
Supply-chain graph
Jan with Qwen2.5-7B-Instruct
Local LLM Desktop stack options
15 options, 0 Pareto optimal
| Stack | Pref | Overall | Open | Bench | Popularity | Cost | Velocity | Prov | Sandbox | Non-open | Evidence |
|---|---|---|---|---|---|---|---|---|---|---|---|
| JanQwen2.5-7B-Instructchat, local-inference | 71.3 | 71.9 | 63 | 74.2 | 87 | 79.2 | 50 | 86.3 | 35 | 7 | 420,832 GitHub stars11,890,117 HF downloadsMMLU |
| GPT4AllMistral-7B-Instruct-v0.3chat, local-inference | 68.5 | 68.7 | 63 | 62.5 | 83 | 79.2 | 50 | 86.5 | 35 | 7 | 455,235 GitHub stars3,392,572 HF downloadsMMLU |
| JanMistral-7B-Instruct-v0.3chat, local-inference | 68.4 | 68.6 | 63 | 62.5 | 82.7 | 79.2 | 50 | 86.3 | 35 | 7 | 420,832 GitHub stars3,392,572 HF downloadsMMLU |
| GPT4AllGPT-J-6Bchat, local-inference | 67.9 | 67.8 | 64.6 | 58 | 80.1 | 81 | 50 | 87.5 | 35 | 7 | 455,235 GitHub stars253,867 HF downloadsLAMBADA |
| GPT4AllPhi-3-mini-4k-instructchat, local-inference | 50.4 | 49.4 | 51.9 | 0 | 76.2 | 75.4 | 50 | 67.3 | 35 | 7 | 193,153 GitHub stars610,575 HF downloadsSource-needed evaluation |
| JanMistralchat, local-inference | 48.9 | 47.8 | 49.3 | 0 | 73 | 73.2 | 50 | 64.5 | 35 | 8 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |
| JanMistral-7B-v0.1chat, local-inference | 48.9 | 47.8 | 49.3 | 0 | 73 | 73.2 | 50 | 64.5 | 35 | 8 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |
| JanAnthropic Claude familychat, local-inference | 48 | 46.2 | 43.2 | 0 | 73 | 67.6 | 50 | 73.4 | 35 | 7 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |
| GPT4AllGPT4All Snoozychat, local-inference | 47.6 | 46.6 | 44.6 | 0 | 74.2 | 71.5 | 50 | 61.9 | 35 | 8 | 193,153 GitHub stars0 HF downloadsSource-needed evaluation |
| GPT4AllLlama 3 Instructchat, local-inference | 47.6 | 46.6 | 44.6 | 0 | 74.2 | 71.5 | 50 | 61.9 | 35 | 8 | 193,153 GitHub stars0 HF downloadsSource-needed evaluation |
| GPT4AllMini Orca Smallchat, local-inference | 47.6 | 46.6 | 44.6 | 0 | 74.2 | 71.5 | 50 | 61.9 | 35 | 8 | 193,153 GitHub stars0 HF downloadsSource-needed evaluation |
| GPT4AllNous Hermes 2 Mistral DPOchat, local-inference | 47.6 | 46.6 | 44.6 | 0 | 74.2 | 71.5 | 50 | 61.9 | 35 | 8 | 193,153 GitHub stars0 HF downloadsSource-needed evaluation |
| JanGoogle Gemini familychat, local-inference | 47.3 | 46.1 | 43.8 | 0 | 73 | 67.8 | 50 | 64.5 | 35 | 8 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |
| JanGPT-4ochat, local-inference | 47.3 | 46.1 | 43.8 | 0 | 73 | 67.8 | 50 | 64.5 | 35 | 8 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |
| JanOpenAI o3chat, local-inference | 47.3 | 46.1 | 43.8 | 0 | 73 | 67.8 | 50 | 64.5 | 35 | 8 | 158,750 GitHub stars0 HF downloadsSource-needed evaluation |