Update README.md

README.md

@@ -1,41 +1,42 @@
----
-license: cc-by-nc-4.0
-library_name: transformers
-tags:
-- mergekit
-- merge
-- alpaca
-- mistral
-- not-for-all-audiences
-- nsfw
----
-# IceDrinkNameGoesHereRP-7b-Model_Stock
-
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-
-## Merge Details
-
-### Merge Method
-
-This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using mistralai\Mistral-7B-Instruct-v0.2 as a base.
-
-### Models Merged
-
-The following models were included in the merge:
-
-* icefog72\IceSomeDrinkNameHereRP-7b-Della
-* icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5
-
-### Configuration
-
-The following YAML configuration was used to produce this model:
-
-```yaml
-models:
-- model: mistralai\Mistral-7B-Instruct-v0.2
-- model: icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5
-- model: icefog72\IceSomeDrinkNameHereRP-7b-Della
-merge_method: model_stock
-base_model: icefog72\Mistral-7B-Instruct-v0.2
-dtype: bfloat16
-```
+---
+license: cc-by-nc-4.0
+library_name: transformers
+tags:
+- mergekit
+- merge
+- alpaca
+- mistral
+- not-for-all-audiences
+- nsfw
+---
+# IceDrinkNameGoesHereRP-7b-Model_Stock
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Updates:
+14.09.24 : "rope_theta": 1000000 -> 40000.0
+
+### Merge Method
+
+This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using mistralai\Mistral-7B-Instruct-v0.2 as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+
+* icefog72\IceSomeDrinkNameHereRP-7b-Della
+* icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+- model: mistralai\Mistral-7B-Instruct-v0.2
+- model: icefog72\IceTea21EnergyDrinkRPV13-DPOv3.5
+- model: icefog72\IceSomeDrinkNameHereRP-7b-Della
+merge_method: model_stock
+base_model: icefog72\Mistral-7B-Instruct-v0.2
+dtype: bfloat16
+```