-
-
-
-
-
-
Inference Providers
Active filters:
gptq
Text Generation
•
12B
•
Updated
•
97
•
2
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
6.95k
•
17
JunHowie/Qwen3-14B-GPTQ-Int8
Text Generation
•
15B
•
Updated
•
129
•
1
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
440k
•
43
GaborMadarasz/Qwen3-0.6B-8bit-gptq_hungarian_news
Text Generation
•
0.6B
•
Updated
•
28
•
1
QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int8
Text Generation
•
36B
•
Updated
•
149
•
4
superjob/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
208
•
1
Kirim-ai/Kirim-V1-7B-Chat
Text Generation
•
5B
•
Updated
•
42
•
1
Text Generation
•
Updated
•
1
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
22
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
45
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
40
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
25
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
24
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
23
•
2
Text Generation
•
Updated
•
30
•
45
Text Generation
•
7B
•
Updated
•
123
•
31
Text Generation
•
Updated
•
2.44k
•
21
Text Generation
•
Updated
•
1.87k
•
41
Text Generation
•
13B
•
Updated
•
43
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
20
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
17
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
17
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
•
7B
•
Updated
•
32
•
15
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
24
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
14
•
3
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
•
33B
•
Updated
•
38
•
20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
•
13B
•
Updated
•
31
•
20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
•
65B
•
Updated
•
31
•
29
TheBloke/medalpaca-13B-GPTQ
Text Generation
•
13B
•
Updated
•
45
•
29