메뉴 건너뛰기
Library Notice
Institutional Access
If you certify, you can access the articles for free.
Check out your institutions.
ex)Hankuk University, Nuri Motors
Log in Register Help KOR
Subject
Humanities
General Humanities History Philosophy Religious Studies Linguistics and Literature Other Humanities
Social science
General Social Science Business Management Tourism Education Military Science Library and Information Science Law Sociology Journalism and Media Studies Psychological Science Political Science and Diplomacy Geography Public Administration Economics International Trade Anthropology Other Social Science
Natural science
General Natural Science Physics Biology Life Sciences Mathematics/Statistics Astronomy Earth Science Chemistry Other Natural Science
Engineering
General Engineering Architectural Engineering Mechanical Engineering Industrial Engineering Material/Energy Engineering Electrical and Electronic Engineering Marine and Ocean Engineering Chemical Engineering Computer Science Other Engineering
Medical science
General Medical Science Nursing Science Veterinary Pharmacy Traditional Korean Medicine Basic Medicine Clinical Medicine Other Medicine
Agriculture and Fishery
General Agriculture and Fishery Agriculture Fishery Science Food Science Forestry Animal Husbandry Marine Transportation Studies Other Agriculture and Fishery
Art and Kinesiology
General Arts Design Fine Arts Cosmetology Photography Music Fashion Kinesiology Performing Media Arts Other Arts and Kinesiology
Interdisciplinary Studies
Interdisciplinary Research Science and Technology Studies Brain and Cognitive Science Technology Policy Other Interdisciplinary Studies

KOR

Neural Machine Translation with Word Embedding Transferred from Language Model
Recommendations
Search
Questions

논문 기본 정보

Type
Academic journal
Author
Chanung Jeong (Handong University) Heeyoul Choi (Handong University)
Journal
Digital Contents Society Journal of Digital Contents Society Vol.20 No.11 KCI Accredited Journals
Published
2019.11
Pages
2,211 - 2,216 (6page)
DOI
10.9728/dcs.2019.20.11.2211

Usage

cover
📌
Topic
📖
Background
🔬
Method
🏆
Result
Neural Machine Translation with Word Embedding Transferred from Language Model
Ask AI
Recommendations
Search
Questions

Abstract· Keywords

Report Errors
Since neural machine translation (NMT) has become a new paradigm in machine translation, it relies on large amounts of parallel corpora to train neural networks, while language models (LMs) are trained on abundant monolingual corpus. Thus, there have been a few approaches to use monolingual corpus in training NMT systems. In this paper, we propose to use pretrained LM for NMT. After training two LMs for source and target languages of NMT, we transfer the word embedding matrices from the LMs to the target NMT model. In the experiments with the task of En-De and En-Fi translation, the proposed method keeps the translation quality the same or slightly better (up to +0.57 BLEU) using only around 40% of the previous model size.
#지식 이전 #언어 모델 #기계번역 #인공신경망 #워드 임베딩 #Knowledge Transfer #Language Model #Neural Machine Translation #Neural Network #Word Embedding

Contents

[요약]
[Abstract]
Ⅰ. Introduction
Ⅱ. Background: LM and NMT
Ⅲ. Word Embedding Transfer
Ⅳ. Experiment
Ⅴ. Conclusion
References

References (22)

Add References
H. Choi / 2015 / Intelligent Information System; Introduction to deep learning and major issues / Korea Information Processing Society Review 22(1):7~21 google schola N. Kalchbrenner / 2013 / Recurrent continuous translation models / EMNLP :413 google schola I. Sutskever / 2014 / Sequence to Sequence Learning with Neural Networks / Advances in Neural Information Processing Systems google schola D. Bahdanau / 2015 / Neural Machine Translation by Jointly Learning to Align and Translate / Proc. Int’l Conf. on Learning Representations google schola R. Sennrich / 2016 / Edinburgh neural machine translation systems for wmt 16 / The First Conference on Statistical Machine Translation google schola

Recommendations

It is an article recommended by DBpia according to the article similarity. Check out the related articles!

Related Authors

Frequently Viewed Together

Utilizing Machine Translation Systems to Generate Word Lists for Learning Vocabulary in English
Jin-Ha Woo ,  Heeyoul Choi Journal of Digital Contents Society 2021 .01
Data augmentation to improve document-level machine translation performance
Dokyoung Kim ,  Changki Lee 한국정보과학회 학술발표논문집 2021 .12
Systematic Review for AI-based Language Learning Tools
Jin Ha Woo ,  Heeyoul Choi Journal of Digital Contents Society 2021 .11
A Method to Improve Machine Translation Accuracy of the Newly Coined Words Using Online Language Dictionary
SeoJeong Lee ,  YuRim Lee Proceedings of KIIT Conference 2021 .06
Exploring the Implications of Brain-Based Research on the Direction of Early Childhood Education
Su-Young Yang Korean Education Inquiry 2012 .06

Recently viewed articles

The Inter-territorialization of the Text Space －Focusing on the discussion of metallurgy between Deleuze and Guattari－
Kim Ye-Jin, Yeo Soo-Hyun, Kim Do-Namundefined2022.06
 느타리 및 팽이버섯 버섯추출물의 유산균 발효에 의한 GABA 생산
김재호, 정윤희, 홍경남 외 3명The korean Society of Food Science and Nutrition2014.10
 Changes in housing characteristics through residential mobility
The Korean Housing Association1992.06
 Doing Science, Technology, and Women Studies : ‘With the Body’ in-between New Material Feminism and STS
So-Yeon LEEMKorean Association Of Science And Technology Studies2019.11

Comments(0)

0

Write first comments.