Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
AI-Engine
/
Meta-Llama-3.1-8B-Instruct-GGUF
like
1
GGUF
Inference Endpoints
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
d860f4f
Meta-Llama-3.1-8B-Instruct-GGUF
1 contributor
History:
21 commits
AI-Engine
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf with huggingface_hub
d860f4f
verified
about 1 month ago
.gitattributes
2.57 kB
Upload Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf with huggingface_hub
about 1 month ago
LICENSE
7.63 kB
Upload 2 files
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q2_k.gguf
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q2_k.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q5_k_m.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q8_0.gguf
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix-ropefix.q8_0.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q2_k.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q5_k_m.gguf with huggingface_hub
about 1 month ago
Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-imatrix.q8_0.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-new-ropefix.bf16.gguf
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-new-ropefix.bf16.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct-new.bf16.gguf
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct-new.bf16.gguf
4 months ago
Meta-Llama-3.1-8B-Instruct.bf16.gguf
16.1 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.bf16.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q2_k.gguf
3.18 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q2_k.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf
5.73 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q5_k_m.gguf with huggingface_hub
4 months ago
Meta-Llama-3.1-8B-Instruct.q8_0.gguf
8.54 GB
LFS
Upload Meta-Llama-3.1-8B-Instruct.q8_0.gguf with huggingface_hub
4 months ago
README.md
1.27 kB
Update README.md
4 months ago
USE_POLICY.md
4.69 kB
Upload 2 files
4 months ago