Nanotron Research

community

Activity Feed Request to join this org

AI & ML interests

Large scale distributed AI model training, model parallelisation, low-level GPU acceleration, make GPUs go brrrrr

Recent Activity

eliebak new activity about 7 hours ago

nanotron/ultrascale-playbook:Few Errors

eliebak new activity about 7 hours ago

nanotron/ultrascale-playbook:Typos

eliebak new activity about 7 hours ago

nanotron/ultrascale-playbook:Link to torchao is broken

View all activity

nanotron's activity

eliebak

in nanotron/ultrascale-playbook about 7 hours ago

Few Errors

#86 opened 3 days ago by

Typos

#80 opened 5 days ago by

Link to torchao is broken

#85 opened 3 days ago by

fix-typos

#88 opened about 8 hours ago by

eliebak

updated a Space about 7 hours ago

The Ultra-Scale Playbook

The ultimate guide to training LLM on large GPU Clusters

nouamanetazi

in nanotron/ultrascale-playbook 3 days ago

Typos

#81 opened 5 days ago by

How to download as pdf?

#74 opened 6 days ago by

ZeRO-3 vs FSDP 1 vs FSDP 2

#75 opened 6 days ago by

Fix typo

#76 opened 6 days ago by

Thanks for sharing. Was looking for similar research to get to know about compute(AI+GPU)

#79 opened 6 days ago by

Typos

#80 opened 5 days ago by

Questions?

#84 opened 3 days ago by

Make it easier to import into reader applications

#77 opened 6 days ago by

dark-mode

#82 opened 5 days ago by

More ressources

#73 opened 6 days ago by

thomwolf

in nanotron/ultrascale-playbook 4 days ago

final final final typos

#72 opened 6 days ago by

thomwolf

updated a Space 4 days ago

The Ultra-Scale Playbook

The ultimate guide to training LLM on large GPU Clusters

thomwolf

in nanotron/ultrascale-playbook 5 days ago

Typos

#80 opened 5 days ago by

Make it easier to import into reader applications

#77 opened 6 days ago by

How to download as pdf?

#74 opened 6 days ago by