metadata
language:
- en
license: llama3.1
base_model: cognitivecomputations/Dolphin3.0-Llama3.1-8B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
3-bit OmniQuant quantized version of Dolphin3.0-Llama3.1-8B for inference with Private LLM.