RedXeol commited on
Commit
a5fadbe
1 Parent(s): 1c71f33

Create README.md

Browse files

<strong><span style="font-size: larger;">bertin-gpt-j-6B-alpaca-4bit-128g 🤗</span></strong>


This is a 4-bit GPTQ version of the [bertin-project/bertin-gpt-j-6B-alpaca]([enlace](https://huggingface.co/bertin-project/bertin-gpt-j-6B-alpaca)).

this is the result of quantizing to 4 bits using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).

How to easily download and use this model in text-generation-webui (tutorial by [TheBloke](https://huggingface.co/TheBloke))
Open the text-generation-webui UI as normal.

Click the Model tab.
Under Download custom model or LoRA, enter RedXeol/bertin-gpt-j-6B-alpaca-4bit-128g.
Click Download.
Wait until it says it's finished downloading.
Click the Refresh icon next to Model in the top left.
In the Model drop-down: choose the model you just downloaded, WizardLM-7B-uncensored-GPTQ.
If you see an error in the bottom right, ignore it - it's temporary.
Fill out the GPTQ parameters on the right: Bits = 4, Groupsize = 128, model_type = gptj
Click Save settings for this model in the top right.
Click Reload the Model in the top right.
Once it says it's loaded, click the Text Generation tab and enter a prompt!

Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: openrail
3
+ datasets:
4
+ - bertin-project/alpaca-spanish
5
+ language:
6
+ - es
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - Transformers
10
+ - bertin-project/alpaca-spanish
11
+ - gptj
12
+ - PyTorch
13
+ - alpaca
14
+ - llm spanish
15
+ ---