Qwen3-4B-Instruct-2507 for RK3588
This repository contains the optimized RKLLM (Language) models for running Qwen3-4B-Instruct-2507 on Rockchip RK3588 NPUs.
📦 Files
| File | Type | Description |
|---|---|---|
qwen3-4b-instruct-2507_w8a8_rk3588.rkllm |
RKLLM | Language Decoder (w8a8) |
⚙️ System Requirements
- NPU Driver:
≥ 0.9.8 - RKLLM Runtime:
v1.2.3 - RKNN-Toolkit2:
v2.3.0
💻 Tested Hardware
- Device: Orange Pi 5 Pro
- RAM: 16GB
- OS: Armbian OS
🙏 Acknowledgements
- Qwen Team for the base model architecture.
- Rockchip / airockchip for the RKLLM toolkit and runtime.
- Converted by Akmal Dira.
- Downloads last month
- 19
Model tree for thanhtantran/Qwen3-4B-Instruct-2507-RKLLM
Base model
Qwen/Qwen3-4B-Instruct-2507