File size: 2,308 Bytes
60192ee
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7e8cbad
60192ee
aac186c
60192ee
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
---
language:
- en
- es
---

# Model Card for Carpincho-13b

<!-- Provide a quick summary of what the model is/does. -->

This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language.
It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf).

## Model Details

The model is provided in ggml format, for use with the llama.cpp CPU-only LLM inference (https://github.com/ggerganov/llama.cpp)

## Usage

Clone the llama.cpp repository:

    git clone https://github.com/ggerganov/llama.cpp

Compile the tool:

    make

Download the file carpincho-13b-ggml-model-q4_0.bin into the llama.cpp directory and run this command:

    ./main -m ./carpincho-13b-ggml-model-q4_0.bin -i -ins -t 4

Change -t 4 to the number of physical CPU cores you have.

This model requires at least 8GB of free RAM. No GPU is needed to run llama.cpp.

### Model Description

<!-- Provide a longer summary of what this model is. -->

- **Developed by:** Alfredo Ortega (@ortegaalfredo)
- **Model type:** 13B LLM
- **Language(s):** (NLP): English and colloquial Argentine Spanish
- **License:** Free for non-commercial use, but I'm not the police.
- **Finetuned from model:** https://huggingface.co/decapoda-research/llama-13b-hf

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Repository:** https://huggingface.co/decapoda-research/llama-13b-hf
- **Paper [optional]:** https://arxiv.org/abs/2302.13971

## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
This is a generic LLM chatbot that can be used to interact directly with humans.

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->
This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material.


### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. 

## Model Card Contact

Contact the creator at @ortegaalfredo on twitter/github