Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
Paper
•
2411.04996
•
Published
•
30
samusenps
samusenps
AI & ML interests
Foundational Architectures, Multi-Modality, Interpretability, Benchmarking w/ simulations, Robotics, Integration with Non envasive Open Source stack RISC-V BCI. Extremely high quality training data. Fully Open Source ML/AI.
Organizations
samusenps's activity
upvoted
5
papers
about 16 hours ago
DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion
Paper
•
2411.04928
•
Published
•
31
BitNet a4.8: 4-bit Activations for 1-bit LLMs
Paper
•
2411.04965
•
Published
•
50
ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning
Paper
•
2411.05003
•
Published
•
56
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models
Paper
•
2411.04905
•
Published
•
76
upvoted
15
papers
4 days ago
OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
Paper
•
2410.23218
•
Published
•
43
SALSA: Soup-based Alignment Learning for Stronger Adaptation in RLHF
Paper
•
2411.01798
•
Published
•
8
Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
Paper
•
2411.00743
•
Published
•
6
AutoVFX: Physically Realistic Video Editing from Natural Language Instructions
Paper
•
2411.02394
•
Published
•
14
LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models
Paper
•
2411.00918
•
Published
•
8
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance
Paper
•
2411.02327
•
Published
•
11
IGOR: Image-GOal Representations are the Atomic Control Units for Foundation Models in Embodied AI
Paper
•
2411.00785
•
Published
•
8
Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
Paper
•
2411.02335
•
Published
•
9
Adaptive Caching for Faster Video Generation with Diffusion Transformers
Paper
•
2411.02397
•
Published
•
17
DynaSaur: Large Language Agents Beyond Predefined Actions
Paper
•
2411.01747
•
Published
•
13
DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models
Paper
•
2411.00836
•
Published
•
14
GenXD: Generating Any 3D and 4D Scenes
Paper
•
2411.02319
•
Published
•
16
Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent
Paper
•
2411.02265
•
Published
•
22
How Far is Video Generation from World Model: A Physical Law Perspective
Paper
•
2411.02385
•
Published
•
27
Training-free Regional Prompting for Diffusion Transformers
Paper
•
2411.02395
•
Published
•
22