Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
internlm
/
internlm2-chat-20b-4bits
like
6
Text Generation
Transformers
PyTorch
internlm
feature-extraction
conversational
custom_code
4-bit precision
awq
arxiv:
2306.00978
License:
apache-2.0
Model card
Files
Files and versions
Community
4
Train
Use this model
Lmdeploy是必须安装的吗?
#2
by
jiyintor
- opened
Jan 22
Discussion
jiyintor
Jan 22
如题。
如果不安装请问有参考代码或者指南吗?
如果模型是用AWQ量化的,理论上直接使用awq加载就行吧?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment