Adding Evaluation Results

README.md

@@ -1,29 +1,22 @@
 ---
+language:
+- nl
 license: apache-2.0
-base_model: Rijgersberg/GEITje-7B
 tags:
 - generated_from_trainer
 - GEITje
-- conversational
-model-index:
-- name: GEITje-7B-chat-v2
-  results: []
 datasets:
 - Rijgersberg/no_robots_nl
 - Rijgersberg/ultrachat_10k_nl
 - BramVanroy/dutch_chat_datasets
-language:
-- nl
-pipeline_tag: text-generation
+base_model: Rijgersberg/GEITje-7B
+pipeline_tag: conversational
+model-index:
+- name: GEITje-7B-chat-v2
+  results: []
 ---
 # GEITje-7B-chat-v2
 
-> [!CAUTION]
-> **⚠️ At the pressing request of Stichting BREIN, GEITje is no longer available, starting immediately. ⚠️**
-> 
-> All model files (the _weights_) and checkpoints have been deleted from this repo.
-> See my blog post ([Dutch](https://goingdutch.ai/nl/posts/geitje-takedown/), [English](https://goingdutch.ai/en/posts/geitje-takedown/)) for further clarification.
-
 **🤖️ Try the chat model in [🤗 Hugging Face Spaces](https://huggingface.co/spaces/Rijgersberg/GEITje-7B-chat)!**
 
 # GEITje-7B
@@ -54,11 +47,10 @@ Like Mistral, GEITje has a _context length_ of 8,192 tokens.
 As a demonstration of GEITje's capabilities for chat applications, two initial chat variants of GEITje have also been finetuned: GEITje-chat and GEITje-chat-v2.
 They can follow instructions, answer questions, and hold dialogues on a variety of topics.
 
+
 ## More info
 Read more about GEITje-chat in the [📄 README](https://github.com/Rijgersberg/GEITje/blob/main/README-en.md) on GitHub.
 
-## Checkpoints
-An intermediate checkpoint is available in the `checkpoints` branch.
 
 ## Training procedure
 
@@ -107,4 +99,17 @@ The following hyperparameters were used during training:
 - Transformers 4.36.0.dev0
 - Pytorch 2.1.1+cu121
 - Datasets 2.15.0
-- Tokenizers 0.15.0
+- Tokenizers 0.15.0
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Rijgersberg__GEITje-7B-chat-v2)
+
+|             Metric              |Value|
+|---------------------------------|----:|
+|Avg.                             |50.79|
+|AI2 Reasoning Challenge (25-Shot)|50.34|
+|HellaSwag (10-Shot)              |74.13|
+|MMLU (5-Shot)                    |49.00|
+|TruthfulQA (0-shot)              |43.55|
+|Winogrande (5-shot)              |71.51|
+|GSM8k (5-shot)                   |16.22|
+

checkpoint-12185/model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62fe5bb153098b41ef7fc06b72b6b1bd8e887e61ad33c9e2b033357655057713
+size 4943162336

checkpoint-12185/model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dca10b56bba30f9bb4fc5c3fcd02896368d22da08a52a39538f4dbf3c2ef71df
+size 4999819336

checkpoint-12185/model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c693a1e370b10f5c6393e43e9318ea0cd06dc2ee4aa9bafb9dd5d297d80716e
+size 4540516344

checkpoint-12185/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfa624e9702a749bbc16c4ab780b43698584b956a5ae5f31afe76efc7ad1c7da
+size 14512103560

model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62fe5bb153098b41ef7fc06b72b6b1bd8e887e61ad33c9e2b033357655057713
+size 4943162336

model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dca10b56bba30f9bb4fc5c3fcd02896368d22da08a52a39538f4dbf3c2ef71df
+size 4999819336

model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c693a1e370b10f5c6393e43e9318ea0cd06dc2ee4aa9bafb9dd5d297d80716e
+size 4540516344