Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
toshasΒ 
posted an update Dec 28, 2023
Post
Introducing Marigold 🌼 - a universal monocular depth estimator, delivering incredibly sharp predictions in the wild! Based on Stable Diffusion, it is trained with synthetic depth data only and excels in zero-shot adaptation to real-world imagery. Check it out:

πŸ€— Hugging Face Space: https://huggingface.co/spaces/toshas/marigold
πŸ€— Hugging Face Model: https://huggingface.co/Bingxin/Marigold
πŸ€— Hugging Face Paper: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation (2312.02145)
🌐 Website: https://marigoldmonodepth.github.io
πŸ‘Ύ Code: https://github.com/prs-eth/marigold
πŸ‘Ύ Code: pip install diffusers (check comments to this post for details!)
πŸ“„ Paper: https://arxiv.org/abs/2312.02145

Brought to you by the fantastic team from the Photogrammetry and Remote Sensing group of ETH Zurich: Bingxin Ke ( @Bingxin ), Anton Obukhov ( @toshas ), Shengyu Huang, Nando Metzger ( @nandometzger ), Rodrigo Caye Daudt, and Konrad Schindler.

Super cool that it comes with a Spaces demo πŸ”₯
Linking the HF paper page as well: https://huggingface.co/papers/2312.02145
Thank you for sharing!

Β·

Updated to include the paper!

Super cool work.

Anyone curious, you can try out Marigold in diffusers through a custom pipeline too. Check it out here: https://github.com/huggingface/diffusers/tree/main/examples/community#marigold-depth-estimation.