taobao-mnn

/

Qwen3-VL-8B-Instruct-Eagle3

like 0

Follow

taobao-mnn 96

I tried to run it with vllm v0.11.0 and got the problem

AttributeError: 'Qwen3VLConfig' object has no attribute 'image_token_index'. Did you mean: 'image_token_id'?

my cli:

vllm serve Qwen/Qwen3-VL-8B-Instruct   --speculative-config '{
     "method": "eagle3",
     "model": "taobao-mnn/Qwen3-VL-8B-Instruct-Eagle3",
     "num_speculative_tokens": 5,
     "draft_tensor_parallel_size": 1
  }'

Do you have any ideas how to run it?