Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets

ICLR 2021 Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Hayeon Lee, Eunyoung Hyung and Sung Ju Hwang  Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperfo...

Mutually-Constrained Monotonic Multihead Attention for Online ASR

ICASSP 2021 Mutually-Constrained Monotonic Multihead Attention for Online ASR  Jaeyun Song, Hajin Shim, Eunho Yang   Despite the feature of real-time decoding, Monotonic Multihead Attention (MMA) shows comparable performance to the state-of-the-art offline methods ...

Multi-domain Knowledge Distillation via Uncertainty-Matching for End-to-End ASR Models

INTERSPEECH 2021 Multi-domain Knowledge Distillation via Uncertainty-Matching for End-to-End ASR Models Ho-Gyeong Kim, Min-Joong Lee, Hoshik Lee, Tae Gyoon Kang, Jihyun Lee, Eunho Yang and Sung Ju Hwang  Knowledge Distillation basically matches predictive distributions of st...

Mini-Batch Consistent Slot Set Encoder for Scalable Set Encoding

NeurIPS 2021 Mini-Batch Consistent Slot Set Encoder for Scalable Set Encoding Bruno Andreis, Jeffrey Willette, Juho Lee and Sung Ju Hwang  Most existing set encoding algorithms operate under the assumption that all the elements of the set are accessible during training and infere...

Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generation

ICML 2021 Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generation Dongchan Min, Dong Bok Lee, Eunho Yang and Sung Ju Hwang  With rapid progress in neural text-to-speech (TTS) models, personalized speech generation is now in high demand for many applications. For pract...

Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning

ICLR 2021 Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning Dong Bok Lee, Dongchan Min, Seanie Lee and Sung Ju Hwang  Unsupervised learning aims to learn meaningful representations from unlabeled data which can captures its intrinsic structure, that can be transf...

Learning to Sample with Local and Global Contexts in Experience Replay Buffers

ICLR 2021 Learning to Sample with Local and Global Contexts in Experience Replay Buffers Youngmin Oh, Kimin Lee, Jinwoo Shin, Eunho Yang, Sung Ju Hwang  Experience replay, which enables the agents to remember and reuse experience from the past, has played a significant role in th...

Learning to Perturb Word Embeddings for Out-of-distribution QA

ACL 2021 Learning to Perturb Word Embeddings for Out-of-distribution QA Seanie Lee, Minki Kang, Juho Lee and Sung Ju Hwang  QA models based on pretrained language models have achieved remarkable performance on various benchmark datasets. However, QA models do not generalize well ...

Learning to Generate Noise for Multi-Attack Robustness

ICML 2021 Learning to Generate Noise for Multi-Attack Robustness Divyam Madaan, Jinwoo Shin and Sung Ju Hwang  Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the...

Learning How Long to Wait: Adaptively-Constrained Monotonic Multihead Attention for Streaming ASR

IEEE 2021 Learning How Long to Wait: Adaptively-Constrained Monotonic Multihead Attention for Streaming ASR Jaeyun Song; Hajin Shim; Eunho Yang  Monotonic Multihead Attention, which allows multiple heads to learn their own alignments per head, shows great performance on simultane...