Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-2-7b-AQLM-2Bit-1x16-hf
like
5
Follow
IST Austria Distributed Algorithms and Systems Lab
58
Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
aqlm
arxiv:
2401.06118
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
5edaefc
Llama-2-7b-AQLM-2Bit-1x16-hf
/
modeling_llama.py
Commit History
depth 1
5edaefc
Andrei Panferov
commited on
Jan 18, 2024
correct import
c0d7cc2
Andrei Panferov
commited on
Jan 18, 2024
Custom config in modeling
c43662f
Andrei Panferov
commited on
Jan 18, 2024
inference and autoloading
5c0d7ef
Andrei Panferov
commited on
Jan 18, 2024