 Inspired by neuroscience, humans have perception systems and cognitive systems to process different information , we propose LUT, Listen-Understand-Translate,  a unified framework with triple supervision  to decouple the end-to-end speech-to-text translation task.
<meaning-changed>  Inspired by neuroscience, humans have perception systems and cognitive systems to process different information , we propose LUT, Listen-Understand-Translate,  a unified framework with triple supervision  to decouple the end-to-end speech-to-text translation task.
 Existing methods are limited by the amount of parallel corpus. Can we build a system to fully utilize signals in a parallel ST corpus? We are inspired by human understanding system which is composed of auditory perception and cognitive processing. In this paper , we propose LUT, Listen-Understand-Translate, a unified framework with triple supervision to decouple the end-to-end speech-to-text translation task.