Llama-3.2-1B-Instruct-q4f16_1
gemma-2-2b-it-q4f16_1
Llama-3.2-3B-Instruct-q4f16_1
Qwen2.5-Coder-0.5B-Instruct-q4f16_1
Phi-3.5-mini-instruct-q4f16_1
Qwen1.5-MoE-A2.7B-Chat-q4f16_1
Qwen2.5-3B-Instruct-q4f16_1
internlm2_5-1_8b-chat-q4f16_1
TinyLlama-1.1B-Chat-v1.0-q4f16_1
Mistral-7B-Instruct-v0.3-q4f16_1