README.md

metadata

license: gemma
library_name: transformers
pipeline_tag: text-generation
base_model: shenzhi-wang/Gemma-2-9B-Chinese-Chat
inference: false
model_creator: shenzhi-wang
model_name: Gemma-2-9B-Chinese-Chat
quantized_by: Second State Inc.
language:
  - en
  - zh

Gemma-2-9B-Chinese-Chat-GGUF

Original Model

shenzhi-wang/Gemma-2-9B-Chinese-Chat

Run with Gaianet

Prompt template:

prompt template: gemma-instruct

Context size:

chat_ctx_size: 8192

Run with GaiaNet:

• Quick start with Gemma-2-9b-it: https://github.com/GaiaNet-AI/node-configs/blob/main/gemma-2-9b-it/README.md

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b3259