Andron00e commited on
Commit
232e793
1 Parent(s): 22e35cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +74 -1
README.md CHANGED
@@ -6,4 +6,77 @@ language:
6
  - en
7
  library_name: transformers
8
  pipeline_tag: question-answering
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - en
7
  library_name: transformers
8
  pipeline_tag: question-answering
9
+ metrics:
10
+ - accuracy
11
+ ---
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** Andron00e
21
+ - **Shared by [optional]:** Andron00e
22
+ - **Model type:**
23
+ - **Language(s) (NLP):** Python (transformers, peft)
24
+ - **License:** apache-2.0
25
+ - **Finetuned from model:** openlm-research/open_llama_3b
26
+
27
+ ### Model Sources [optional]
28
+
29
+ <!-- Provide the basic links for the model. -->
30
+
31
+ - **Repository:** https://github.com/Andron00e/Fine-Tuning-project
32
+
33
+ ### Training Data
34
+
35
+ <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
36
+ https://huggingface.co/datasets/Open-Orca/OpenOrca
37
+
38
+ ## Evaluation
39
+
40
+ <!-- This section describes the evaluation protocols and provides the results. -->
41
+ Evaluation of the model was carried out using EulerAI library, more precisely:
42
+ https://github.com/EleutherAI/lm-evaluation-harness/tree/e47e01beea79cfe87421e2dac49e64d499c240b4#task-versioning
43
+
44
+ #### Testing Data
45
+
46
+ <!-- This should link to a Data Card if possible. -->
47
+ hellaswag testing dataset
48
+
49
+ #### Metrics
50
+
51
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
52
+
53
+ Accuracy
54
+
55
+ ### Results and Model Examination
56
+
57
+ | Task |Version| Metric |Value | |Stderr|
58
+ |---------|------:|--------|-----:|---|-----:|
59
+ |hellaswag| 0|acc |0.4899|卤 |0.0050|
60
+ | | |acc_norm|0.6506|卤 |0.0048|
61
+
62
+
63
+
64
+
65
+
66
+ ## Citation
67
+
68
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
69
+ ```
70
+ @software{openlm2023openllama,
71
+ author = {Geng, Xinyang and Liu, Hao},
72
+ title = {OpenLLaMA: An Open Reproduction of LLaMA},
73
+ month = May,
74
+ year = 2023,
75
+ url = {https://github.com/openlm-research/open_llama}
76
+ }
77
+ ```
78
+
79
+
80
+ ## Model Card Authors and Contact
81
+
82
+ [Andron00e](https://github.com/Andron00e)