Hugging Face's logo

Slvcxc
/
Sekhmet_Bet-L3.1-8B-v0.2-8.0bpw-h8-exl2

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
exl2
Model card Files Community
3v324v23 commited on
Commit
2c8d668
•
1 Parent(s): c527eeb

yesh

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -6,6 +6,8 @@ base_model:
6
  - Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2
7
  ---
8
 
 
 
9
  ## **Sekhmet_Bet-L3.1-8B-v0.2**
10
  [exllamav2](https://github.com/turboderp/exllamav2) quant for [Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2](https://huggingface.co/Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2)
11
 
 
6
  - Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2
7
  ---
8
 
9
+ [NitralAI's measurement.json](https://huggingface.co/Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2-5bpw-exl2/blob/main/measurement.json) was used for quantization
10
+
11
  ## **Sekhmet_Bet-L3.1-8B-v0.2**
12
  [exllamav2](https://github.com/turboderp/exllamav2) quant for [Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2](https://huggingface.co/Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2)
13