beomi
/

llama-2-ko-7b

Text Generation

text-generation-inference

Model card Files Files and versions Community

beomi commited on Jul 24, 2023

Commit

e938116

•

1 Parent(s): 77aa647

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ Llama-2-Ko is an auto-regressive language model that uses an optimized transform
 ||Training Data|Params|Content Length|GQA|Tokens|LR|
 |---|---|---|---|---|---|---|
-|Llama 2|*A new mix of Korean online data*|7B|4k|&#10007;|160B|3.0 x 10<sup>-4</sup>|
 **Vocab Expansion**

 ||Training Data|Params|Content Length|GQA|Tokens|LR|
 |---|---|---|---|---|---|---|
+|Llama 2|*A new mix of Korean online data*|7B|4k|&#10007;|>20B|1e<sup>-5</sup>|
 **Vocab Expansion**