Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
nikravan
/
glm-4vq
like
23
Document Question Answering
Transformers
Safetensors
12 languages
chatglm
feature-extraction
text-generation-inference
custom_code
4-bit precision
bitsandbytes
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
May I ask how the quantification is achieved?
#2
by
alexwww94
- opened
Jul 23
Discussion
alexwww94
Jul 23
No description provided.
nikravan
Owner
Jul 25
It done by bitsandbytes package.
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
