Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

233

Full-text search

Active filters: int8

michaelfeil/ct2fast-codegen-16B-mono

Updated May 22, 2023 • 6 • 2

michaelfeil/ct2fast-stablelm-base-alpha-7b

Updated May 22, 2023 • 26

michaelfeil/ct2fast-codegen-16B-multi

Updated May 22, 2023 • 2

michaelfeil/ct2fast-codegen2-7B

Updated May 22, 2023 • 4 • 3

michaelfeil/ct2fast-codegen2-16B

Updated May 22, 2023 • 6 • 1

michaelfeil/ct2fast-gpt_bigcode-santacoder

Text Generation • Updated May 31, 2023 • 30 • 2

michaelfeil/ct2fast-starchat-alpha

Updated Jun 2, 2023 • 10 • 6

michaelfeil/ct2fast-starcoder

Text Generation • Updated Jun 27, 2023 • 19 • 12

michaelfeil/ct2fast-starcoderbase

Text Generation • Updated Jun 1, 2023 • 16

limcheekin/flan-t5-small-ct2

Updated May 24, 2023 • 8

limcheekin/flan-t5-xl-ct2

Updated Jun 3, 2023 • 3 • 1

Intel/deberta-v3-base-mrpc-int8-static-inc

Text Classification • Updated May 25, 2023 • 6

Intel/deberta-v3-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 7

limcheekin/flan-t5-xxl-ct2

Updated May 30, 2023 • 5 • 1

michaelfeil/ct2fast-mpt-7b

Text Generation • Updated Jun 27, 2023 • 17 • 1

michaelfeil/ct2fast-mpt-7b-instruct

Text Generation • Updated Jun 27, 2023 • 17

michaelfeil/ct2fast-mpt-7b-chat

Updated May 31, 2023 • 2 • 1

limcheekin/fastchat-t5-3b-ct2

Text2Text Generation • Updated Jun 28, 2023 • 6 • 2

limcheekin/flan-alpaca-gpt4-xl-ct2

Updated Jun 4, 2023 • 4

limcheekin/mpt-7b-storywriter-ct2

Updated Jun 27, 2023 • 2

michaelfeil/ct2fast-openalpaca_7b_700bt_preview

Updated Jun 2, 2023 • 1

ENOT-AutoDL/gpt2-tensorrt

Text Generation • Updated Jun 8, 2023 • 4

limcheekin/falcon-7b-instruct-ct2

Updated Jun 19, 2023 • 9 • 1

limcheekin/mpt-7b-instruct-ct2

Updated Jun 19, 2023 • 3

michaelfeil/ct2fast-falcon-7b-instruct

Updated Jun 7, 2023 • 5 • 1

michaelfeil/ct2fast-falcon-40b

Updated Jun 16, 2023 • 10 • 1

michaelfeil/ct2fast-falcon-40b-instruct

Updated Jun 26, 2023 • 6 • 2

michaelfeil/ct2fast-falcon-7b

Updated Jun 7, 2023 • 6 • 1

michaelfeil/ct2fast-RedPajama-INCITE-7B-Chat

Updated Jun 7, 2023 • 2

michaelfeil/ct2fast-falcon-7b-sft-top1-696

Text Generation • Updated Jun 16, 2023 • 14 • 3