Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ONS-AI-RESEARCH
/
ONS-SOLAR-10.7B-AWQ
like
0
Text Generation
Transformers
Safetensors
Korean
llama
SOLAR-10.7B
AWQ
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
ONS-SOLAR-10.7B-AWQ
Model Details
ONS-SOLAR-10.7B-AWQ
Model Details
Base Model:
ONS-AI-RESEARCH/ONS-SOLAR-10.7B
Quantization by AutoAWQ(
https://github.com/casper-hansen/AutoAWQ
)
Downloads last month
11
Safetensors
Model size
1.74B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.
Collection including
ONS-AI-RESEARCH/ONS-SOLAR-10.7B-AWQ
LLM
Collection
4 items
•
Updated
Jul 29