Edit Models filters

Inference status

Misc

arxiv: 2310.05209

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

36

Full-text search

Active filters: 2310.05209

gradientai/Llama-3-70B-Instruct-Gradient-1048k

Text Generation • Updated 13 days ago • 328 • 120

cognitivecomputations/Llama-3-70B-Gradient-524k-adapter

Updated May 5 • 31

grimjim/cuckoo-starling-32k-7B-GGUF

Text Generation • Updated Aug 27 • 331 • 1

gradientai/Llama-3-70B-Instruct-Gradient-262k

Text Generation • Updated 13 days ago • 210 • 55

gradientai/Llama-3-70B-Instruct-Gradient-524k

Text Generation • Updated 13 days ago • 237 • 23

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-GGUF

Text Generation • Updated May 4 • 12 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.4bpw-h6-exl2

Text Generation • Updated May 4 • 8

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-3.5bpw-h6-exl2

Text Generation • Updated May 4 • 5

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-4.0bpw-h6-exl2

Text Generation • Updated May 4 • 6 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-4.65bpw-h6-exl2

Text Generation • Updated May 4 • 2

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-5.0bpw-h6-exl2

Text Generation • Updated May 4 • 2

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-6.0bpw-h6-exl2

Text Generation • Updated May 4 • 2

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-GGUF

Text Generation • Updated May 4 • 47 • 3

bullerwins/gradientai_Llama-3-70B-Instruct-Gradient-262k_exl2_8.0bpw

Text Generation • Updated May 4 • 3

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-2.4bpw-h6-exl2

Text Generation • Updated May 4 • 4 • 1

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-3.5bpw-h6-exl2

Text Generation • Updated May 4 • 7

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-4.0bpw-h6-exl2

Text Generation • Updated May 4 • 5

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-4.65bpw-h6-exl2

Text Generation • Updated May 4 • 3

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-5.0bpw-h6-exl2

Text Generation • Updated May 4 • 4

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-6.0bpw-h6-exl2

Text Generation • Updated May 4 • 2

LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.25bpw-h6-exl2

Text Generation • Updated May 6 • 4

vsevolodl/Llama-3-70B-Instruct-Gradient-1048k-GGUF

Text Generation • Updated May 10 • 279 • 3

starsy/Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation • Updated May 17 • 3

starsy/Llama-3-70B-Instruct-Gradient-1048k-AWQ

Text Generation • Updated May 17 • 3 • 1

grimjim/cuckoo-starling-32k-7B

Text Generation • Updated May 23 • 12 • 2

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-1048k-gguf

Updated May 29 • 35

jukofyork/miquplus-midnight-70b

Text Generation • Updated Jun 4 • 22 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_8.0bpw

Text Generation • Updated Jun 6 • 4

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.5bpw

Text Generation • Updated Jun 6 • 8

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6 • 5