ctranslate2-4you
/

EXAONE-3.5-7.8B-Instruct-ct2-int8

Model card Files Files and versions Community

ctranslate2-4you commited on 5 days ago

Commit

be15a05

·

verified ·

1 Parent(s): e6a4a6d

Create README.md

Files changed (1) hide show

README.md +12 -0

README.md ADDED Viewed

	@@ -0,0 +1,12 @@

+---
+library_name: ctranslate2
+base_model:
+- LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct
+base_model_relation: quantized
+tags:
+  - ctranslate2
+  - chat
+---
+Ctranslate2 8-bit quantization of [original model](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct).
+However, this would not have been possible without the model first being converted to Llama format [from here](https://huggingface.co/datalama/EXAONE-3.5-7.8B-Instruct-Llamafied)