RE-N-Y
/

logic2vision

Image-Text-to-Text

Inference Endpoints

Model card Files Files and versions Community

RE-N-Y commited on Jun 9, 2024

Commit

a311207

·

verified ·

1 Parent(s): 9f21b15

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -88,7 +88,7 @@ Hence, it may struggle to adopt to different prompt styles and code formats.
 ## Training / Evaluation Details
-The model has been finetuned using 2 A6000 GPUs on CMU LTI's Babel cluster using. The model has been finetuned using LoRA (`r=8, alpha=16, dropout=0.05, task_type="CAUSAL_LM"`).
 LoRA modules were attached to `["q_proj", "v_proj"]`. We use DDP for distributed training and BF16 to speed up training. For more details, check [our paper](https://arxiv.org/abs/2403.10534)!
 ### Results

 ## Training / Evaluation Details
+The model has been finetuned using 2 A6000 GPUs on CMU LTI's Babel cluster. The model has been finetuned using LoRA (`r=8, alpha=16, dropout=0.05, task_type="CAUSAL_LM"`).
 LoRA modules were attached to `["q_proj", "v_proj"]`. We use DDP for distributed training and BF16 to speed up training. For more details, check [our paper](https://arxiv.org/abs/2403.10534)!
 ### Results