Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ai21labs
/
Jamba-v0.1
like
1.18k
Follow
AI21
214
Text Generation
Transformers
Safetensors
jamba
mamba
Mixture of Experts
custom_code
Inference Endpoints
arxiv:
2403.19887
License:
apache-2.0
Model card
Files
Files and versions
Community
50
Train
Deploy
Use this model
Update modeling_jamba.py - LoRA support in Mamba
#6
by
tomeras1
- opened
Mar 28, 2024
base:
refs/heads/main
←
from:
refs/pr/6
Discussion
Files changed
+12
-4
tomeras1
AI21 org
Mar 28, 2024
LoRA/QLoRA for Mamba layers should work now :)
@
winglian
@
jphme
See translation
Update modeling_jamba.py - LoRA support in Mamba
409c9049
tomeras1
changed pull request status to
merged
Mar 28, 2024
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
