Deeokay commited on
Commit
63e407b
1 Parent(s): 5e705c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -7
README.md CHANGED
@@ -35,13 +35,33 @@ Please note this is not for the purpose of production, but result of Fine Tuning
35
 
36
  The llama3 Tokens where kept the same, however the format was slight customized using the available tokens
37
 
38
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  <|begin_of_text|> <|start_header_id|>user<|end_header_id|>
40
- {user_input}<|eot_id|><|start_header_id|>analysis<|end_header_id|>
41
- {analysis}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
42
- {response}<|eot_id|><|start_header_id|>classification<|end_header_id|>
43
- {classification}<|eot_id|><|start_header_id|>sentiment<|end_header_id|>
44
- {sentiment}<|eot_id|> <|start_header_id|>user<|end_header_id|>
45
- Thank you for your answer.<|eot_id|> <|start_header_id|>analysis<|end_header_id|>
46
  You're most welcome, what would like to know next?<|eot_id|>
47
  ```
 
 
 
 
 
 
 
35
 
36
  The llama3 Tokens where kept the same, however the format was slight customized using the available tokens
37
 
38
+ I have foregone the {{.System}} part as this would be updated when converting the llama3.
39
+
40
+ I wanted to test if the model would understand additional headers that I created such as what my datasets has
41
+ - Analaysis, Classification, Sentiment
42
+
43
+ First pass through my ~30K personalized customized dataset.
44
+
45
+ If would like to know how I started creating my dataset, you can check this link
46
+ [Crafting GPT2 for Personalized AI-Preparing Data the Long Way (Part1)](https://medium.com/@deeokay/the-soul-in-the-machine-crafting-gpt2-for-personalized-ai-9d38be3f635f)
47
+
48
+ As the data was getting created with custom special tokens, I had to convert that to the llama3 Template.
49
+
50
+ However I got creative again..
51
+
52
+ ```python
53
  <|begin_of_text|> <|start_header_id|>user<|end_header_id|>
54
+ {{.Prompt}}<|eot_id|><|start_header_id|>analysis<|end_header_id|>
55
+ {{.Analysis}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
56
+ {{.Response}P<|eot_id|><|start_header_id|>classification<|end_header_id|>
57
+ {{.Classification}}<|eot_id|><|start_header_id|>sentiment<|end_header_id|>
58
+ {{.Sentiment}}<|eot_id|> <|start_header_id|>user<|end_header_id|>
59
+ Thank you for your answer.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
60
  You're most welcome, what would like to know next?<|eot_id|>
61
  ```
62
+
63
+ For now, the llama3 standard template seems to hold, and can be created in Ollama through normal llama3 template
64
+
65
+ Will be updating this monthly.. as I have limited colab resources..
66
+
67
+