Jobaar
/

c4ai-command-r-GGUF-fixed_pretokenizer

Inference Endpoints

Model card Files Files and versions Community

Jobaar commited on May 5

Commit

68d612f

•

1 Parent(s): a5cb9ac

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ Llama.cpp command-r pre-tokenizer gguf fixed
 main: build = 2789 (84250014)
 main: built with gcc (Ubuntu 13.2.0-4ubuntu3) 13.2.0 for x86_64-linux-gnu
 main: quantizing '/gguf/c4ai-commandr-v01_a.gguf' to '/gguf/c4ai-command-r-v01-Q5_K_M.gguf' as Q5_K_M
-llama_model_loader: loaded meta data with 26 key-value pairs and 322 tensors from /mnt/Orlando/gguf/c4ai-commandr-v01_a.gguf (version GGUF V3 (latest))
 llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
 llama_model_loader: - kv   0:                       general.architecture str              = command-r
 llama_model_loader: - kv   1:                      command-r.block_count u32              = 40

 main: build = 2789 (84250014)
 main: built with gcc (Ubuntu 13.2.0-4ubuntu3) 13.2.0 for x86_64-linux-gnu
 main: quantizing '/gguf/c4ai-commandr-v01_a.gguf' to '/gguf/c4ai-command-r-v01-Q5_K_M.gguf' as Q5_K_M
+llama_model_loader: loaded meta data with 26 key-value pairs and 322 tensors from c4ai-commandr-v01_a.gguf (version GGUF V3 (latest))
 llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
 llama_model_loader: - kv   0:                       general.architecture str              = command-r
 llama_model_loader: - kv   1:                      command-r.block_count u32              = 40