Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
fbaldassarri
/
mistralai_Mistral-7B-v0.3-autoawq-int4-gs128-sym
like
0
Text Generation
Safetensors
PyTorch
English
French
mistral
causal-lm
autoround
auto-round
intel-autoround
awq
autoawq
auto-awq
woq
intel
mistralai
4-bit precision
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Use this model
main
mistralai_Mistral-7B-v0.3-autoawq-int4-gs128-sym
/
generation_config.json
fbaldassarri
Initial Upload
c4a3590
verified
3 days ago
raw
Copy download link
history
blame
contribute
delete
Safe
111 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.48.0"
}