Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

285

Full-text search

Active filters: ggml

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 57 • 8

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 71 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 72 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 30 • 6

rustformers/gpt-j-ggml

Text Generation • Updated Jun 9, 2023 • 40 • 2

rustformers/stablelm-ggml

Text Generation • Updated Jun 9, 2023 • 49 • 3

rustformers/dolly-v2-ggml

Text Generation • Updated Oct 19, 2023 • 35 • 2

rustformers/gpt4all-j-ggml

Text Generation • Updated Jun 9, 2023 • 45 • 11

rustformers/redpajama-7b-ggml

Text Generation • Updated Jun 9, 2023 • 33 • 3

rustformers/open-llama-ggml

Text Generation • Updated Jun 11, 2023 • 22 • 9

phi0112358/Zicklein-7B-german_Alpaca-ggml

Updated Jun 19, 2023 • 4

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 2

mukowaty/ggml-whisper

Updated Jul 15, 2024 • 4

Green-Sky/ggml_openai_clip-vit-base-patch32

Updated Jun 25, 2023

Araki/airoboros-33b-gpt4-1.4.1-PI-8192-GGML

Text Generation • Updated Jul 16, 2023 • 2

Araki/Luna-AI-Llama2-Uncensored-GGML

Text Generation • Updated Jul 23, 2023 • 3

richardr1126/spider-skeleton-wizard-coder-ggml

Updated Aug 20, 2023 • 4

jphme/Llama-2-13b-chat-german-GGML

Text Generation • Updated Jul 22, 2023 • 13

Araki/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML

Text Generation • Updated Jul 22, 2023 • 1

Trelis/Llama-2-7b-chat-hf-function-calling

Text Generation • Updated Aug 22, 2023 • 27 • 47

Trelis/Llama-2-13b-chat-hf-function-calling

Text Generation • Updated Aug 23, 2023 • 4

bornjre/btlm-3b-ggml

Updated Aug 21, 2023 • 7

gorkemgoknar/llama2-7f-moviechatbot-ggml-q4

Text Generation • Updated Oct 11, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GGML

Text Generation • Updated Aug 11, 2023 • 6

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 12, 2023 • 19 • 4

Trelis/Llama-2-13b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 14, 2023

Bluckr/llama-7B-ggml-q4_0-Pofi-Assistant

Text Generation • Updated Aug 13, 2023 • 2

Araki/Bacchus-22B-GGML

Text Generation • Updated Aug 14, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ-trained-adapters

Text Generation • Updated Aug 14, 2023