Edit Models filters

Inference status

Misc

arxiv: 2309.05516

4-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

42

Full-text search

Active filters: 2309.05516

Intel/neural-chat-7b-v3-1-int4-inc

Text Generation • Updated Aug 26 • 35 • 2

Intel/neural-chat-7b-v3-3-int4-inc

Text Generation • Updated Aug 26 • 39 • 3

Intel/Mistral-7B-v0.1-int4-inc

Text Generation • Updated May 31 • 44 • 4

Intel/falcon-7b-int4-inc

Text Generation • Updated Aug 26 • 58

Intel/chatglm2-6b-int4-inc

Intel/Qwen1.5-0.5B-Chat-int4-inc

Intel/Phi-3-mini-4k-instruct-int4-inc

Updated Jul 4 • 3

Intel/chatglm3-6b-int4-inc

Intel/Baichuan2-7B-Chat-int4-inc

Intel/Baichuan2-13B-Chat-int4-inc

Updated Jul 4 • 1

Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc

Updated Jul 4 • 1

Intel/gpt-j-6b-int4-inc

Intel/gpt-neox-20b-int4-inc

Intel/mpt-7b-chat-int4-inc

Intel/falcon-7b-instruct-int4-inc

Intel/bloom-7b1-int4-inc

Intel/opt-1.3b-int4-inc-recipe

Updated 4 days ago

Intel/opt-13b-int4-inc

Intel/Phi-3-mini-128k-instruct-int4-inc-recipe

Updated 1 day ago

Intel/Llama-2-7b-chat-hf-int4-inc

Intel/Meta-Llama-3-8B-Instruct-int4-inc

Intel/Qwen1.5-7B-Chat-int4-inc

Intel/Mistral-7B-Instruct-v0.2-int4-inc

Intel/gemma-7b-int4-inc

Intel/Mistral-7B-Instruct-v0.2-int2-inc

Intel/Qwen2-0.5B-Instuct-int4-inc

Text Generation • Updated Jun 6 • 7

Intel/Qwen2-1.5B-Instuct-int4-inc

Text Generation • Updated Jun 6 • 8

Intel/Qwen2-7B-int4-inc

Text Generation • Updated 17 days ago • 581 • 5

Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc-v0.2

Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc-v0.3

Updated Jun 28 • 1