ibm-granite

/

granite-4.0-h-tiny

like 172

Follow

IBM Granite 3.69k

Generated the MoE config for this model for use with an RTX 5090 GPU. There's also a script so you can create your own for different GPUs.
https://github.com/MissionSquad/vllm-moe-configs