罗杰斯's picture

罗杰斯

rojasdiego

·

https://rojasdiego.com

AI & ML interests

LLMs for Code Generation

Recent Activity

upvoted a paper 3 days ago

LLM as a Broken Telephone: Iterative Generation Distorts Information

upvoted a paper 3 days ago

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization

upvoted a paper 12 days ago

The Curse of Depth in Large Language Models

View all activity

Organizations

rojasdiego's activity

upvoted 2 papers 3 days ago

LLM as a Broken Telephone: Iterative Generation Distorts Information

Paper • 2502.20258 • Published 11 days ago • 18

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization

Paper • 2503.04598 • Published 4 days ago • 16

upvoted a paper 12 days ago

The Curse of Depth in Large Language Models

Paper • 2502.05795 • Published 29 days ago • 35

upvoted 2 papers about 1 month ago

Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs

Paper • 2501.18585 • Published Jan 30 • 56

SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training

Paper • 2501.17161 • Published Jan 28 • 108

upvoted a paper 4 months ago

WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning

Paper • 2411.02337 • Published Nov 4, 2024 • 35

upvoted 2 papers 5 months ago

Why Does the Effective Context Length of LLMs Fall Short?

Paper • 2410.18745 • Published Oct 24, 2024 • 18

SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration

Paper • 2410.02367 • Published Oct 3, 2024 • 48

upvoted a collection 5 months ago

Llama 3.2

This collection hosts the transformers and original repos of the Llama 3.2 and Llama Guard 3 • 15 items • Updated Dec 6, 2024 • 574

upvoted 3 papers 6 months ago

Attention Heads of Large Language Models: A Survey

Paper • 2409.03752 • Published Sep 5, 2024 • 89

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Paper • 2405.04324 • Published May 7, 2024 • 22

Scaling Granite Code Models to 128K Context

Paper • 2407.13739 • Published Jul 18, 2024 • 20

upvoted 3 collections 6 months ago

Code LLMs

6 items • Updated Jan 3 • 1

Arctic-embed

A collection of text embedding models optimized for retrieval accuracy and efficiency • 8 items • Updated Dec 5, 2024 • 20

MoEs papers reading list

60 items • Updated Nov 4, 2024 • 141

upvoted 2 papers 6 months ago

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling

Paper • 2408.16532 • Published Aug 29, 2024 • 49

CogVLM2: Visual Language Models for Image and Video Understanding

Paper • 2408.16500 • Published Aug 29, 2024 • 57

upvoted a paper 7 months ago

Controllable Text Generation for Large Language Models: A Survey

Paper • 2408.12599 • Published Aug 22, 2024 • 65

upvoted 2 papers 9 months ago

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22, 2024 • 46

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Paper • 2406.12793 • Published Jun 18, 2024 • 32