File size: 937 Bytes
d0fc167
 
 
 
 
 
 
 
 
 
 
 
 
ca5b611
 
 
d0fc167
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
license: apache-2.0
tags:
- Solar
- Mistral
- Roleplay
---

# DaringLotus-10.7B 6bpw EXL2

## Description
EXL2 quant of [BlueNipples/DaringLotus-10.7B](https://huggingface.co/BlueNipples/DaringLotus-10.7B)

- 6bpw should be comfortable on 12 gb with 8k context
- 4bpw might just fit on 8gb of vram at 4k context
- if you have more ram get the 8bpw


## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/DaringLotus-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/DaringLotus-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/DaringLotus-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/DaringLotus-4bpw-exl2)


## Prompt Format
### Alpaca:
I am not entirely certain of this but i think alpaca is correct for this model

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Input:
{input}

### Response:

```

## Contact
Kooten on discord