Leonard Püttmann's picture

Leonard Püttmann PRO

puettmann

·

leonard-puettmann

AI & ML interests

None yet

Recent Activity

reacted to anakin87's post with 👍 3 days ago

𝐍𝐞𝐰 𝐈𝐭𝐚𝐥𝐢𝐚𝐧 𝐒𝐦𝐚𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐌𝐨𝐝𝐞𝐥𝐬: 𝐆𝐞𝐦𝐦𝐚 𝐍𝐞𝐨𝐠𝐞𝐧𝐞𝐬𝐢𝐬 𝐜𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧 💎🌍🇮🇹 I am happy to release two new language models for the Italian Language! 💪 Gemma 2 9B Neogenesis ITA https://huggingface.co/anakin87/gemma-2-9b-neogenesis-ita Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data. Using Spectrum, I trained 20% of model layers. 📊 Evaluated on the Open ITA LLM leaderboard (https://huggingface.co/spaces/mii-llm/open_ita_llm_leaderboard), this model achieves strong performance. To beat it on this benchmark, you'd need a 27B model 😎 🤏 Gemma 2 2B Neogenesis ITA https://huggingface.co/anakin87/gemma-2-2b-neogenesis-ita This smaller variant is fine-tuned from the original Gemma 2 2B it by Google. Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum. 📈 Compared to the original model, it shows improved Italian proficiency, good for its small size. Both models were developed during the recent #gemma competition on Kaggle. 📓 Training code: https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond 🙏 Thanks @FinancialSupport and mii-llm for the help during evaluation.

liked a model 7 days ago

anakin87/gemma-2-2b-neogenesis-ita

liked a model 7 days ago

anakin87/gemma-2-9b-neogenesis-ita

View all activity

Organizations

puettmann's activity

upvoted a paper 8 days ago

Registering Source Tokens to Target Language Spaces in Multilingual Neural Machine Translation

Paper • 2501.02979 • Published 18 days ago • 1

upvoted a collection 11 days ago

LLäMmlein Chat Preview 🐑

https://www.informatik.uni-wuerzburg.de/datascience/projects/nlp/llammlein/ • 8 items • Updated Nov 22, 2024 • 11

upvoted a paper 12 days ago

ChocoLlama: Lessons Learned From Teaching Llamas Dutch

Paper • 2412.07633 • Published Dec 10, 2024 • 1

upvoted a paper 14 days ago

Enhancing Human-Like Responses in Large Language Models

Paper • 2501.05032 • Published 16 days ago • 49

upvoted 2 papers about 1 month ago

AniDoc: Animation Creation Made Easier

Paper • 2412.14173 • Published Dec 18, 2024 • 51

Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimation

Paper • 2412.14015 • Published Dec 18, 2024 • 12

upvoted a collection about 1 month ago

🇮🇹 Italian NLP Resources

Collection of models, datasets and demos relevant to Italian NLP 🇮🇹 • 276 items • Updated about 9 hours ago • 24

upvoted a paper about 2 months ago

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training

Paper • 2411.15124 • Published Nov 22, 2024 • 58

upvoted a paper 9 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22, 2024 • 255

upvoted a paper over 1 year ago

A Survey on Evaluation of Large Language Models

Paper • 2307.03109 • Published Jul 6, 2023 • 42