Text Generation
Transformers
Safetensors
Telugu
mistral
conversational
text-generation-inference
Inference Endpoints
Edit model card

Model card for mistral7b_telugu (romanized)

mistralai/Mistral-7B-Instruct-v0.2 is finetuned on tranliterated telugu sentences.

usage

from transformers import pipeline

pipe = pipeline(
    "text-generation", 
    model="eswardivi/mistral7b_telugu", 
    device_map="auto"
)

def create_prompt(instruction: str, input: str = "") -> str:
    prompt = f"""
### Instruction:
{instruction}

### Response:
"""
    return prompt

prompt = create_prompt("Naku python Program 1 to 10 count cheyadaniki ivvu")

out = pipe(
    prompt, 
    num_return_sequences=1, 
    max_new_tokens=1024, 
    temperature=0.7, 
    top_p=0.9, 
    do_sample=True
)

print(out[0]['generated_text'])

Downloads last month
18
Safetensors
Model size
7.24B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Datasets used to train eswardivi/mistral7b_telugu