Upload folder using huggingface_hub (#1)

- d74053b79a45ae1c182dad751900e1bfa14514f7abb4f7e499e9d54adad35f15 (1c31dbff1f3ce991053f1091964db62b95c194b7)
- 35af3b892bf013f91d7678de1425d5ffb14ba1daf383dd540b63f8ee4dc57ab6 (935fe48efeb267dcbdcd7fa397d1d144b815b292)
- 46efa623ce96bc7273d6335a5eabdb515f65a47acee546dd8500dad1ee557604 (dda2e68e601abac28d957c3094f97983b5831044)
- 5af5f9954bbc1aee251ea35ed67bdc5b6306bf56f10b27217dfc0a9c0843773c (ee79c0c8895b516880acdfc9ce764ba4765eeb2a)
- 0af22d1687311225824c8a65f182801d5b8eef722a763733d6f97a720fad7c01 (10b15b272cb7a5ab0d76d842088dedbb65176898)
- 528c818cb2ddf2c41b508b7d0a61234457b4d07efd99c2daaafb2db57e095d67 (840441d51907a1f9d9e50180f439885a468b57f7)

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+Llama_3.1_8b_Dolermed_R1_V1.03-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text

Llama_3.1_8b_Dolermed_R1_V1.03-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ebe65dee65426e292b4d5ce45312e888669368b979cfa248e1fe6384648d328
+size 4988146

Llama_3.1_8b_Dolermed_R1_V1.03.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36e8d7ac0984fe69399790a9c5573bcaeee831b2b7f5633ff0093dd390479d19
+size 5733001440

Llama_3.1_8b_Dolermed_R1_V1.03.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:164d17584edfc5ddae047f36ab8452a219cc89410b2056dca7418c4474ea816f
+size 5599308000

Llama_3.1_8b_Dolermed_R1_V1.03.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01933755c98c4adfd04c6335ddce4c00954a2265b5a9605a4cfb5f8b13c2f0c2
+size 6596021536

Llama_3.1_8b_Dolermed_R1_V1.03.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e5ee01365c795a9e0fde545192dc70e634e9bfc0fbcd4e9608bebf0332d659ac
+size 8540789920

Llama_3.1_8b_Dolermed_R1_V1.03.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b31ffc5255a9734d496d511c18809fd056fb5cb413165425fb71b01e5477ac42
+size 16068925376

README.md

@@ -0,0 +1,45 @@
+---
+base_model: Nexesenex/Llama_3.1_8b_Dolermed_R1_V1.03
+inference: false
+model_creator: Nexesenex
+model_name: Llama_3.1_8b_Dolermed_R1_V1.03-GGUF
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+---
+# [MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.03-GGUF](https://huggingface.co/MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.03-GGUF)
+- Model creator: [Nexesenex](https://huggingface.co/Nexesenex)
+- Original model: [Nexesenex/Llama_3.1_8b_Dolermed_R1_V1.03](https://huggingface.co/Nexesenex/Llama_3.1_8b_Dolermed_R1_V1.03)
+
+## Description
+[MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.03-GGUF](https://huggingface.co/MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.03-GGUF) contains GGUF format model files for [Nexesenex/Llama_3.1_8b_Dolermed_R1_V1.03](https://huggingface.co/Nexesenex/Llama_3.1_8b_Dolermed_R1_V1.03).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.