shahidul034
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -4,6 +4,9 @@ pipeline_tag: text-generation
|
|
4 |
---
|
5 |
KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
|
6 |
It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
|
|
|
|
|
|
|
7 |
|
8 |
Below is the training configuarations for the finetuning process:
|
9 |
```
|
|
|
4 |
---
|
5 |
KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
|
6 |
It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
|
7 |
+
System architecture:
|
8 |
+
datasets:
|
9 |
+
- University information(collected from website)
|
10 |
|
11 |
Below is the training configuarations for the finetuning process:
|
12 |
```
|