Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
AI-Engine
/
Meta-Llama-3.1-8B-Instruct-GGUF
like
1
GGUF
Inference Endpoints
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
fcf094d
Meta-Llama-3.1-8B-Instruct-GGUF
1 contributor
History:
15 commits
AI-Engine
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
fcf094d
verified
4 months ago
.gitattributes
Safe
2.23 kB
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
4 months ago
LICENSE
Safe
7.63 kB
Upload 2 files
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
Safe
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
Safe
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf
Safe
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf
Safe
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-new.bf16.gguf
Safe
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-new.bf16.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct.bf16.gguf
Safe
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.bf16.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q2_k.gguf
Safe
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q2_k.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf
Safe
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q8_0.gguf
Safe
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q8_0.gguf with huggingface_hub
4 months ago
README.md
Safe
1.27 kB
Update README.md
4 months ago
USE_POLICY.md
Safe
4.69 kB
Upload 2 files
4 months ago
