rishdotblog
commited on
Commit
•
e446d89
1
Parent(s):
bba43d8
Update README.md
Browse files
README.md
CHANGED
@@ -5,4 +5,44 @@ metrics:
|
|
5 |
pipeline_tag: text-generation
|
6 |
tags:
|
7 |
- code
|
8 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
pipeline_tag: text-generation
|
6 |
tags:
|
7 |
- code
|
8 |
+
---
|
9 |
+
|
10 |
+
A capable language model for text to SQL generation that is on-par with the most capable generalist frontier models.
|
11 |
+
|
12 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/603bbad3fd770a9997b57cb6/h52Z_OKYBaDDQMFZyU5pF.png)
|
13 |
+
|
14 |
+
## Model Description
|
15 |
+
|
16 |
+
Developed by: Defog, Inc
|
17 |
+
Model type: [Text to SQL]
|
18 |
+
License: [CC-by-SA-4.0]
|
19 |
+
Finetuned from model: [Meta-Llama-3-8B-Instruct]
|
20 |
+
|
21 |
+
## Demo Page
|
22 |
+
[https://defog.ai/sqlcoder-demo/](https://defog.ai/sqlcoder-demo/)
|
23 |
+
|
24 |
+
## Ideal prompt and inference parameters
|
25 |
+
Set temperature to 0, and do not do sampling.
|
26 |
+
|
27 |
+
### Prompt
|
28 |
+
```
|
29 |
+
<|begin_of_text|><|start_header_id|>user<|end_header_id|>
|
30 |
+
|
31 |
+
Generate a SQL query to answer this question: `{user_question}`
|
32 |
+
{instructions}
|
33 |
+
|
34 |
+
DDL statements:
|
35 |
+
{table_metadata_string}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
36 |
+
|
37 |
+
The following SQL query best answers the question `{user_question}`:
|
38 |
+
```sql
|
39 |
+
|
40 |
+
```
|
41 |
+
|
42 |
+
## Evaluation
|
43 |
+
This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities.
|
44 |
+
|
45 |
+
You can read more about the methodology behind SQLEval [here](https://defog.ai/blog/open-sourcing-sqleval/).
|
46 |
+
|
47 |
+
## Contact
|
48 |
+
Contact us on X at [@defogdata](https://twitter.com/defogdata), or on email at [email protected]
|