1.8 LLM-based Model List#
Full-optimized models are fully fused model which currently support 4K context length
long-context models are not fully optimized, and currently supports longer context length <= 16K
hybrid models runs prefill phase on NPU and decode phase on GPU
No |
Model Name |
Model Type |
Variants |
|---|---|---|---|
1 |
Meta-Llama-3-8B |
LLM |
hybrid, full-optimized, long-context |
2 |
Llama-3.1-8B |
LLM |
hybrid, full-optimized, long-context |
3 |
Meta-Llama-3.1-8B-Instruct |
LLM |
hybrid, full-optimized, long-context |
4 |
Llama-3.2-1B |
LLM |
hybrid, full-optimized, long-context |
5 |
Llama-3.2-1B-Instruct |
LLM |
hybrid, full-optimized, long-context |
6 |
Llama-3.2-3B |
LLM |
hybrid, full-optimized, long-context |
7 |
Llama-3.2-3B-Instruct |
LLM |
hybrid, full-optimized, long-context |
8 |
Mistral-7B-Instruct-v0.2 |
LLM |
hybrid, full-optimized, long-context |
9 |
Mistral-7B-Instruct-v0.3 |
LLM |
hybrid, full-optimized, long-context |
10 |
Phi-3.5-mini-instruct |
LLM |
hybrid, full-optimized, long-context |
11 |
Phi-4-mini-instruct |
LLM |
hybrid, full-optimized, long-context |
12 |
Qwen2.5-0.5B-Instruct |
LLM |
hybrid, full-optimized, long-context |
13 |
Qwen2.5_1.5B_Instruct |
LLM |
hybrid, full-optimized, long-context |
14 |
Qwen2.5_3B_Instruct |
LLM |
hybrid, full-optimized, long-context |
15 |
Qwen2.5-7B-Instruct |
LLM |
hybrid, full-optimized, long-context |
16 |
Qwen2.5-Coder-1.5B-Instruct |
LLM |
hybrid, full-optimized, long-context |
17 |
Qwen2.5-Coder-7B-Instruct |
LLM |
hybrid, full-optimized, long-context |
18 |
Qwen3-1.7B |
LLM |
hybrid, full-optimized, long-context |
19 |
Qwen3-4B |
LLM |
hybrid, full-optimized, long-context |
20 |
Qwen3-8B |
LLM |
hybrid, full-optimized, long-context |
21 |
gemma-3-4b-it |
VLM |
long-context |
22 |
GPT-OSS-20B |
LLM-MoE |
long-context |
23 |
SmolLM2-135M-Instruct |
LLM |
hybrid, full-optimized, long-context |
24 |
Hunyuan-0.5B-Instruct (NEW) |
LLM |
full-optimized, long-context |
25 |
Hunyuan-1.8B-Instruct (NEW) |
LLM |
full-optimized, long-context |
26 |
Hunyuan-4B-Instruct (NEW) |
LLM |
full-optimized, long-context |
27 |
Hunyuan-7B-Instruct (NEW) |
LLM |
full-optimized, long-context |
28 |
HY-MT1.5-1.8B (NEW) |
LLM |
full-optimized, long-context |
29 |
HY-MT1.5-7B (NEW) |
LLM |
full-optimized, long-context |
30 |
embeddinggemma-300m (NEW) |
Embedding |
full-optimized |
31 |
translategemma-4b-it (NEW) |
Translation |
full-optimized |
32 |
neutts-air (NEW) |
TTS |
full-optimized |
33 |
neutts-nano (NEW) |
TTS |
full-optimized |
34 |
VideoChat-Flash-Qwen2_5-7B_InternVideo2-1B (NEW) |
VLM |
long-context |
35 |
Qwen3-VL-4B-Instruct (NEW) |
VLM |
long-context |