Severian
/

Jamba-13B

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Severian commited on Apr 8, 2024

Commit

3d60168

·

verified ·

1 Parent(s): b758fd5

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -50,7 +50,7 @@
     "llm_int8_threshold": 6.0,
     "load_in_4bit": false,
     "load_in_8bit": false,
-    "quant_method": "bitsandbytes"
   },
   "rms_norm_eps": 1e-06,
   "router_aux_loss_coef": 0.001,

     "llm_int8_threshold": 6.0,
     "load_in_4bit": false,
     "load_in_8bit": false,
+    "quant_method": ""
   },
   "rms_norm_eps": 1e-06,
   "router_aux_loss_coef": 0.001,