shahidul034
/

KUETLLM_zephyr_base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shahidul034 commited on Feb 21, 2024

Commit

db3ffc1

·

verified ·

1 Parent(s): 3f5a9a9

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -4,11 +4,11 @@ pipeline_tag: text-generation
 ---
 KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
 It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
-System architecture:
 datasets:
-- University information(collected from website)
-Below is the training configuarations for the finetuning process:
 ```
 LoraConfig:
 r=16,

 ---
 KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
 It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
 datasets:
+- University information (collected from website, https://kuet.ac.bd/)
+Below are the training configurations for the fine-tuning process:
 ```
 LoraConfig:
 r=16,