Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
AI-Engine
/
Meta-Llama-3.1-8B-Instruct-GGUF
like
1
GGUF
Inference Endpoints
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
4be8cfa
Meta-Llama-3.1-8B-Instruct-GGUF
1 contributor
History:
10 commits
AI-Engine
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
4be8cfa
verified
4 months ago
.gitattributes
1.98 kB
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct.bf16.gguf
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.bf16.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q2_k.gguf
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q2_k.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q8_0.gguf
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q8_0.gguf with huggingface_hub
4 months ago
README.md
1.03 kB
Update README.md
4 months ago