Upload Q4_K_M and Q6_K, also add a README.md

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
+*.gguf-split* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,21 @@
+This repository contains `.gguf` files for:
+
+https://huggingface.co/grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16
+
+Made with `llama.cpp` commit e18f7345a300920e234f732077bda660cc6cda9c
+
+IMPORTANT: Linear Rope Scaling = 8 (IMPORTANT: use a factor of 8 even if you are not using the full 32K context length). The setting typically defaults to 1, so you need to change it.
+
+# md5sums
+
+* `aurelian-alpha0.1_Q4_K_M.gguf` 27ba8b8dc99776cc48d667d1766f8771
+* `aurelian-alpha0.1_Q6_K.gguf` ab36ed3f2cfd2f833cb814304a5cbe50
+
+The `aurelian-alpha0.1_Q6_K.gguf` is just barely over 50G, HuggingFace's file
+limit, so it is in two parts.
+
+On a UNIX-like system, you can use `cat` to piece it together:
+
+```shell
+cat aurelian-alpha0.1_Q6_K.gguf-split-a aurelian-alpha0.1_Q6_K.gguf-split-b > aurelian-alpha0.1_Q6_K.gguf
+```

aurelian-alpha0.1_Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:294417779406e249915395646d4ce64fb5af3019db21b6870791107ccdc56d43
+size 41422910528

aurelian-alpha0.1_Q6_K.gguf-split-a

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e58c7d93f12e760a9113022a812855f73aa2659034ebb0f2960d618e02e705c5
+size 30064771072

aurelian-alpha0.1_Q6_K.gguf-split-b

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d83c9d01cacae7b4be0831729fe8936667357093be9cb3f017572edfbaef9b5e
+size 26522596416