MPI-vLLM Test Models - a wenyiwang Collection

wenyiwang 's Collections

GGUF CPU Testing

MPI-vLLM Test Models

MPI-vLLM Test Models

updated Nov 6, 2025

deepseek-ai/deepseek-coder-33b-instruct

Text Generation • 33B • Updated Mar 7, 2024 • 56.1k • 556
meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Jun 18, 2025 • 1.53M • • 4.35k
meta-llama/Meta-Llama-3-8B

Text Generation • 8B • Updated Sep 27, 2024 • 1.98M • • 6.42k
Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 5.55M • • 1k
facebook/opt-1.3b

Text Generation • Updated Sep 15, 2023 • 461k • 181
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 307k • • 2.62k
Qwen/Qwen3-4B-Instruct-2507

Text Generation • 4B • Updated Sep 17, 2025 • 2.71M • • 620
deepseek-ai/DeepSeek-V3

Text Generation • 685B • Updated Mar 27, 2025 • 811k • • 4.01k
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • 31B • Updated Sep 17, 2025 • 737k • • 722
Qwen/Qwen3-235B-A22B-Instruct-2507

Text Generation • 235B • Updated Sep 17, 2025 • 101k • • 742
meta-llama/Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 17, 2024 • 210k • • 1.11k
tiiuae/falcon-40b

Text Generation • 42B • Updated Aug 9, 2024 • 9k • 2.43k