File size: 382 Bytes
c856f4b
 
 
 
 
8ebd523
 
 
 
 
5843eaf
8ebd523
e5b57d5
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
---
license: apache-2.0
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
---

This model is fine-tuned for RAG for SEC filings, using synthetically created QA pairs with GPT-4-turbo. 

The format is as follows:

```
text = f"### Question: {question}, ### Context: {ctx}, ### Answer: {answer}"
```

**NOTE**: This model was fine-tuned using the full-model (bfloat16), and not adapters.