INo0121/qwen2.5_3b_instruction_tuning_241020

Qwen 2.5 3B Instruction-tuned Model

This model is a Instruction-tuned version of Qwen 2.5 3B for recipie recommandation.

Model Description

• Fine-tuned from: Qwen/Qwen2.5-3B
• Fine-tuning task: [Instruction-tuning]
• Training data: [kyujinpy/KOpen-platypus + Recipe data]
• Evaluation results: [Add your evaluation metrics]

Usage

from transformers import AutoTokenizer, AutoModelForCausalLM

base_model_path = "Qwen/Qwen2.5-3B"
adapter_model = "INo0121/qwen2.5_3b_instruction_tuning_241020"
base_model = AutoModelForCausalLM.from_pretrained(
    base_model_path,
    torch_dtype="auto",
    device_map="auto",
    temperature=0.1
)
model = PeftModel.from_pretrained(base_model, adapter_model)
tokenizer = AutoTokenizer.from_pretrained(adapter_model)


# Example usage
input_text = "Your input text here"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Limitations and Biases

[Describe any known limitations or biases of your model]

Training Details

• Training framework: Hugging Face Transformers
• Hyperparameters: [List your key hyperparameters]
• Training hardware: [Describe the hardware used]