Production inference for encoder models with vLLM plugins.
colbert, colpali, GLiNER, GLiNER2 etc. — github.com/ddickmann/vllm-factory
Dennis PRO
doubledsbv
AI & ML interests
None yet
Recent Activity
updated a model 2 days ago
latence/privacy-filter-GLiNER-v0.1 published a model 2 days ago
latence/privacy-filter-GLiNER-v0.1 updated a collection 30 days ago
vLLM Factory — Encoder ServingOrganizations
models 25
doubledsbv/vllm-wheel
Updated
doubledsbv/latenceai-wheels
Updated
doubledsbv/docint-ocr-error
0.1B • Updated • 3
doubledsbv/KafkaLM-15B-GRPO_LoRA_Exp
Updated
doubledsbv/Llama-4-Scout-17B-16E-Text
Text Generation • 108B • Updated • 4
doubledsbv/KafkaLM-Llama-3.1-6B-NoDistil
Text Generation • 6B • Updated • 4
doubledsbv/KafkaLM-15B-NoDistil
Text Generation • 16B • Updated • 6
doubledsbv/Llama-3.1-8B-2of4-NO-KL
Updated
doubledsbv/Llama-3.1-70B-2of4-NO-KL
Updated
doubledsbv/Llama-3.1-405B-16of64
Updated
datasets 11
doubledsbv/pii_synthetic
Viewer • Updated • 900k • 5
doubledsbv/classifier_raw_hf
Viewer • Updated • 20.3M • 20
doubledsbv/router_GRPO
Viewer • Updated • 1.68M • 10
doubledsbv/test_sft
Viewer • Updated • 40.4k • 8
doubledsbv/kd_sample
Viewer • Updated • 10k • 10
doubledsbv/kafka_dpo_v2
Viewer • Updated • 59.9k • 14
doubledsbv/kafka_sft_refined
Viewer • Updated • 612k • 11
doubledsbv/wiki_ger_RAG_v0.1_2024_05_04
Viewer • Updated • 12.2k • 2
doubledsbv/booksum_ger_RAG_v0.1_2024_05_04
Viewer • Updated • 8.54k • 4
doubledsbv/llama-3-dataset
Viewer • Updated • 550k • 13