新智元报道来源:Github
【新智元导读】2018年最后一天,清华大学NLP组总结了最近30年来机器翻译领域最重要的论文和学术文献目录清单,包括机器翻译必读论文Top10,在Github上公开放出。侧重于NMT领域的又精又全的论文资源,值得从事机器翻译研究的小伙伴们收藏!限于篇幅,此为上篇。
(资料图)
近日,清华大学NLP组总结了最近30年来机器翻译领域最重要的论文和学术文献目录,并在Github上公开放出。
此列表首先给出了30年来机器翻译领域必读的10篇最重要的论文,接下来的内容分为统计机器翻译和神经机器翻译两大部分。由于近年来取得重大突破几乎全在神经机器翻译领域,这份论文目录更为侧重神经机器翻译部分。
每篇论文资源均按作者、题目、发表年份、发表会议/期刊的顺序给出。
新智元在此将清单全文转录如下,由于原文较长,限于微信文章篇幅限制,分为两篇。
在此感谢此资源的主要维护者,Githubid:minicheshire、thudcsly和其他几位的贡献者的辛勤劳动。
资源地址:
机器翻译必读10篇论文
PeterE.Brown,StephenA.DellaPietra,VincentJ.DellaPietra,andRobertL.Mercer.1993.TheMathematicsofStatisticalMachineTranslation:ParameterEstimation.ComputationalLinguistics.
KishorePapineni,SalimRoukos,ToddWard,andWei-JingZhu.2002.BLEU:aMethodforAutomaticEvaluationofMachineTranslation.InProceedingsofACL2002.PhilippKoehn,FranzJ.Och,andDanielMarcu.2003.StatisticalPhrase-BasedTranslation.InProceedingsofNAACL2003.FranzJosefOch.2003.MinimumErrorRateTraininginStatisticalMachineTranslation.InProceedingsofACL2003.DavidChiang.2007.HierarchicalPhrase-BasedTranslation.ComputationalLinguistics.IlyaSutskever,OriolVinyals,andQuocV.Le.2014.SequencetoSequenceLearningwithNeuralNetworks.InProceedingsofNIPS2014.DzmitryBahdanau,KyunghyunCho,andYoshuaBengio.2015.NeuralMachineTranslationbyJointlyLearningtoAlignandTranslate.InProceedingsofICLR2015.DiederikP.Kingma,JimmyBa.2015.Adam:AMethodforStochasticOptimization.InProceedingsofICLR2015.RicoSennrich,BarryHaddow,andAlexandraBirch.2016.NeuralMachineTranslationofRareWordswithSubwordUnits.InProceedingsofACL2016.AshishVaswani,NoamShazeer,NikiParmar,JakobUszkoreit,LlionJones,AidanN.Gomez,LukaszKaiser,andIlliaPolosukhin.2017.AttentionisAllYouNeed.InProceedingsofNIPS2017.
统计机器翻译
教程
PhilippKoehn.2006.StatisticalMachineTranslation:theBasic,theNovel,andtheSpeculative.EACL2006Tutorial.AdamLopez.2008.Statisticalmachinetranslation.ACMComputingSurveys.词模型
PeterE.Brown,StephenA.DellaPietra,VincentJ.DellaPietra,andRobertL.Mercer.1993.TheMathematicsofStatisticalMachineTranslation:ParameterEstimation.ComputationalLinguistics.StephanVogel,HermannNey,andChristophTillmann.1996.HMM-BasedWordAlignmentinStatisticalTranslation.InProceedingsofCOLING1996.FranzJosefOchandHermannNey.2002.DiscriminativeTrainingandMaximumEntropyModelsforStatisticalMachineTranslation.InProceedingsofACL2002.FranzJosefOchandHermannNey.2003.ASystematicComparisonofVariousStatisticalAlignmentModels.ComputationalLinguistics.PercyLiang,BenTaskar,andDanKlein.2006.AlignmentbyAgreement.InProceedingsofNAACL2006.ChrisDyer,VictorChahuneau,andNoahA.Smith.2013.ASimple,Fast,andEffectiveReparameterizationofIBMModel2.InProceedingsofNAACL2013.
短语模型(Phrase-basedModels)
PhilippKoehn,FranzJ.Och,andDanielMarcu.2003.StatisticalPhrase-BasedTranslation.InProceedingsofNAACL2003.MichelGalleyandChristopherD.Manning.2008.ASimpleandEffectiveHierarchicalPhraseReorderingModel.InProceedingsofEMNLP2008.
语句模型(Syntax-basedModels)
DekaiWu.1997.StochasticInversionTransductionGrammarsandBilingualParsingofParallelCorpora.ComputationalLinguistics.MichelGalley,JonathanGraehl,KevinKnight,DanielMarcu,SteveDeNeefe,WeiWang,andIgnacioThayer.2006.ScalableInferenceandTrainingofContext-RichSyntacticTranslationModels.InProceedingsofCOLING/ACL2006YangLiu,QunLiu,andShouxunLin.2006.Tree-to-StringAlignmentTemplateforStatisticalMachineTranslation.InProceedingsofCOLING/ACL2006.DeyiXiong,QunLiu,andShouxunLin.2006.MaximumEntropyBasedPhraseReorderingModelforStatisticalMachineTranslation.InProceedingsofCOLING/ACL2006.DavidChiang.2007.HierarchicalPhrase-BasedTranslation.ComputationalLinguistics.LiangHuangandDavidChiang.2007.ForestRescoring:FasterDecodingwithIntegratedLanguageModels.InProceedingsofACL2007.HaitaoMi,LiangHuang,andQunLiu.2008.Forest-basedTranslation.InProceedingsofACL2008.MinZhang,HongfeiJiang,AitiAw,HaizhouLi,ChewLimTan,andShengLi.2008.ATreeSequenceAlignment-basedTree-to-TreeTranslationModel.InProceedingsofACL2008.LibinShen,JinxiXu,andRalphWeischedel.2008.ANewString-to-DependencyMachineTranslationAlgorithmwithaTargetDependencyLanguageModel.InProceedingsofACL2008.HaitaoMiandLiangHuang.2008.Forest-basedTranslationRuleExtraction.InProceedingsofEMNLP2008.YangLiu,YajuanLü,andQunLiu.2009.ImprovingTree-to-TreeTranslationwithPackedForests.InProceedingsofACL/IJNLP2009.
判别训练(DiscriminativeTraining)
FranzJosefOch.2003.MinimumErrorRateTraininginStatisticalMachineTranslation.InProceedingsofACL2003.TaroWatanabe,JunSuzuki,HajimeTsukada,andHidekiIsozaki.2007.OnlineLarge-MarginTrainingforStatisticalMachineTranslation.InProceedingsofEMNLP-CoNLL2007.DavidChiang,KevinKnight,andWeiWang.2009.11,001NewFeaturesforStatisticalMachineTranslation.InProceedingsofNAACL2009.
系统组合
Antti-VeikkoRosti,SpyrosMatsoukas,andRichardSchwartz.2007.ImprovedWord-LevelSystemCombinationforMachineTranslation.InProceedingsofACL2007.XiaodongHe,MeiYang,JianfengGao,PatrickNguyen,andRobertMoore.2008.Indirect-HMM-basedHypothesisAlignmentforCombiningOutputsfromMachineTranslationSystems.InProceedingsofEMNLP2008.评估
KishorePapineni,SalimRoukos,ToddWard,andWei-JingZhu.2002.BLEU:aMethodforAutomaticEvaluationofMachineTranslation.InProceedingsofACL2002.PhilippKoehn.2004.StatisticalSignificanceTestsforMachineTranslationEvaluation.InProceedingsofEMNLP2004.SatanjeevBanerjeeandAlonLavie.2005.METEOR:AnAutomaticMetricforMTEvaluationwithImprovedCorrelationwithHumanJudgments.InProceedingsoftheACLWorkshoponIntrinsicandExtrinsicEvaluationMeasuresforMachineTranslationand/orSummarization.MatthewSnoverandBonnieDorr,RichardSchwartz,LinneaMicciulla,andJohnMakhoul.2006.AStudyofTranslationEditRatewithTargetedHumanAnnotation.InProceedingsofAMTA2006.XinWang,WenhuChen,Yuan-FangWang,andWilliamYangWang.2018.NoMetricsArePerfect:AdversarialRewardLearningforVisualStorytelling.InProceedingsofACL2018.
神经机器翻译
教程
ThangLuong,KyunghyunCho,andChristopherManning.2016.NeuralMachineTranslation.ACL2016Tutorial.GrahamNeubig.2017.NeuralMachineTranslationandSequence-to-sequenceModels:ATutorial.arXiv:1703.01619.OriolVinyalsandNavdeepJaitly.2017.Seq2SeqICMLTutorial.ICML2017Tutorial.
模型架构
NalKalchbrennerandPhilBlunsom.2013.RecurrentContinuousTranslationModels.InProceedingsofEMNLP2013.IlyaSutskever,OriolVinyals,andQuocV.Le.2014.SequencetoSequenceLearningwithNeuralNetworks.InProceedingsofNIPS2014.DzmitryBahdanau,KyunghyunCho,andYoshuaBengio.2015.NeuralMachineTranslationbyJointlyLearningtoAlignandTranslate.InProceedingsofICLR2015.YonghuiWu,MikeSchuster,ZhifengChen,QuocV.Le,MohammadNorouzi,WolfgangMacherey,MaximKrikun,YuanCao,QinGao,KlausMacherey,JeffKlingner,ApurvaShah,MelvinJohnson,XiaobingLiu,ukaszKaiser,StephanGouws,YoshikiyoKato,TakuKudo,HidetoKazawa,KeithStevens,GeorgeKurian,NishantPatil,WeiWang,CliffYoung,JasonSmith,JasonRiesa,AlexRudnick,OriolVinyals,GregCorrado,MacduffHughes,andJeffreyDean.2016.Google|sNeuralMachineTranslationSystem:BridgingtheGapbetweenHumanandMachineTranslation.InProceedingsofNIPS2016.JieZhou,YingCao,XuguangWang,PengLi,andWeiXu.2016.DeepRecurrentModelswithFast-ForwardConnectionsforNeuralMachineTranslation.TransactionsoftheAssociationforComputationalLinguistics.EkaterinaGarmash,andChristofMonz.2016.EnsembleLearningforMulti-SourceNeuralMachineTranslation.InProceedingsofCOLING2016.BiaoZhang,DeyiXiong,JinsongSu,HongDuan,andMinZhang.2016.VariationalNeuralMachineTranslation.InProceedingsofEMNLP2016.JonasGehring,MichaelAuli,DavidGrangier,DenisYarats,andYannN.Dauphin.2017.ConvolutionalSequencetoSequenceLearning.InProceedingsofICML2017.JonasGehring,MichaelAuli,DavidGrangier,andYannDauphin.2017.AConvolutionalEncoderModelforNeuralMachineTranslation.InProceedingsofACL2017.MingxuanWang,ZhengdongLu,JieZhou,andQunLiu.2017.DeepNeuralMachineTranslationwithLinearAssociativeUnit.InProceedingsofACL2017.
LongZhou,WenpengHu,JiajunZhang,andChengqingZong.2017.NeuralSystemCombinationforMachineTranslation.InProceedingsofACL2017.MatthiasSperber,GrahamNeubig,JanNiehues,andAlexWaibel.2017.NeuralLattice-to-SequenceModelsforUncertainInputs.InProceedingsofEMNLP2017.DennyBritz,AnnaGoldie,Minh-ThangLuong,andQuocLe.2017.MassiveExplorationofNeuralMachineTranslationArchitectures.InProceedingsofEMNLP2017.AshishVaswani,NoamShazeer,NikiParmar,JakobUszkoreit,LlionJones,AidanN.Gomez,LukaszKaiser,andIlliaPolosukhin.2017.AttentionisAllYouNeed.InProceedingsofNIPS2017.LukaszKaiser,AidanN.Gomez,andFrancoisChollet.2018.DepthwiseSeparableConvolutionsforNeuralMachineTranslation.InProceedingsofICLR2018.YanyaoShen,XuTan,DiHe,TaoQin,andTie-YanLiu.2018.DenseInformationFlowforNeuralMachineTranslation.InProceedingsofNAACL2018.MiaXuChen,OrhanFirat,AnkurBapna,MelvinJohnson,WolfgangMacherey,GeorgeFoster,LlionJones,MikeSchuster,NoamShazeer,NikiParmar,AshishVaswani,JakobUszkoreit,LukaszKaiser,ZhifengChen,YonghuiWu,andMacduffHughes.2018.TheBestofBothWorlds:CombiningRecentAdvancesinNeuralMachineTranslation.InProceedingsofACL2018.WeiyueWang,DeruiZhu,TamerAlkhouli,ZixuanGan,andHermannNey.2018.NeuralHiddenMarkovModelforMachineTranslation.InProceedingsofACL2018.QiangWang,FuxueLi,TongXiao,YanyangLi,YinqiaoLi,andJingboZhu.2018.Multi-layerRepresentationFusionforNeuralMachineTranslation.InProceedingsofCOLING2018.YachaoLi,JunhuiLi,andMinZhang.2018.AdaptiveWeightingforNeuralMachineTranslation.InProceedingsofCOLING2018.Zi-YiDou,ZhaopengTu,XingWang,ShumingShi,andTongZhang.2018.ExploitingDeepRepresentationsforNeuralMachineTranslation.InProceedingsofEMNLP2018.BiaoZhang,DeyiXiong,JinsongSu,QianLin,andHuijiZhang.2018.SimplifyingNeuralMachineTranslationwithAddition-SubtractionTwin-GatedRecurrentNetworks.InProceedingsofEMNLP2018.GongboTang,MathiasMüller,AnnetteRios,andRicoSennrich.2018.WhySelf-Attention?ATargetedEvaluationofNeuralMachineTranslationArchitectures.InProceedingsofEMNLP2018.KeTran,AriannaBisazza,andChristofMonz.2018.TheImportanceofBeingRecurrentforModelingHierarchicalStructure.InProceedingsofEMNLP2018.ParniaBahar,ChristopherBrix,andHermannNey.2018.TowardsTwo-DimensionalSequencetoSequenceModelinNeuralMachineTranslation.InProceedingsofEMNLP2018.TianyuHe,XuTan,YingceXia,DiHe,TaoQin,ZhiboChen,andTie-YanLiu.2018.Layer-WiseCoordinationbetweenEncoderandDecoderforNeuralMachineTranslation.InProceedingsofNeurIPS2018.HanyHassan,AnthonyAue,ChangChen,VishalChowdhary,JonathanClark,ChristianFedermann,XuedongHuang,MarcinJunczys-Dowmunt,WilliamLewis,MuLi,ShujieLiu,Tie-YanLiu,RenqianLuo,ArulMenezes,TaoQin,FrankSeide,XuTan,FeiTian,LijunWu,ShuangzhiWu,YingceXia,DongdongZhang,ZhiruiZhang,andMingZhou.2018.AchievingHumanParityonAutomaticChinesetoEnglishNewsTranslation.Technicalreport.MicrosoftAI&Research.MostafaDehghani,StephanGouws,OriolVinyals,JakobUszkoreit,LukaszKaiser.2019.UniversalTransformers.InProceedingsofICLR2019.
注意力机制(AttentionMechanism)
DzmitryBahdanau,KyunghyunCho,andYoshuaBengio.2015.NeuralMachineTranslationbyJointlyLearningtoAlignandTranslate.InProceedingsofICLR2015.Minh-ThangLuong,HieuPham,andChristopherD.Manning.2015.EffectiveApproachestoAttention-basedNeuralMachineTranslation.InProceedingsofEMNLP2015.HaitaoMi,ZhiguoWang,andAbeIttycheriah.2016.SupervisedAttentionsforNeuralMachineTranslation.InProceedingsofEMNLP2016.ZhouhanLin,MinweiFeng,CiceroNogueiradosSantos,MoYu,BingXiang,BowenZhou,andYoshuaBengio.2017.Astructuredself-attentivesentenceembedding.InProceedingsofICLR2017.TaoShen,TianyiZhou,GuodongLong,JingJiang,ShiruiPan,andChengqiZhang.2018.DiSAN:DirectionalSelf-AttentionNetworkforRNN/CNN-FreeLanguageUnderstanding.InProceedingsofAAAI2018.TaoShen,TianyiZhou,GuodongLong,JingJiang,andChengqiZhang.2018.Bi-directionalblockself-attentionforfastandmemory-efficientsequencemodeling.InProceedingsofICLR2018.TaoShen,TianyiZhou,GuodongLong,JingJiang,SenWang,ChengqiZhang.2018.ReinforcedSelf-AttentionNetwork:aHybridofHardandSoftAttentionforSequenceModeling.InProceedingsofIJCAI2018.PeterShaw,JakobUszkorei,andAshishVaswani.2018.Self-AttentionwithRelativePositionRepresentations.InProceedingsofNAACL2018.LeslyMiculicichWerlen,NikolaosPappas,DhananjayRam,andAndreiPopescu-Belis.2018.Self-AttentiveResidualDecoderforNeuralMachineTranslation.InProceedingsofNAACL2018.XintongLi,LemaoLiu,ZhaopengTu,ShumingShi,andMaxMeng.2018.TargetForesightBasedAttentionforNeuralMachineTranslation.InProceedingsofNAACL2018.BiaoZhang,DeyiXiong,andJinsongSu.2018.AcceleratingNeuralTransformerviaanAverageAttentionNetwork.InProceedingsofACL2018.TobiasDomhan.2018.HowMuchAttentionDoYouNeed?AGranularAnalysisofNeuralMachineTranslationArchitectures.InProceedingsofACL2018.ShaohuiKuang,JunhuiLi,AntónioBranco,WeihuaLuo,andDeyiXiong.2018.AttentionFocusingforNeuralMachineTranslationbyBridgingSourceandTargetEmbeddings.InProceedingsofACL2018.ChaitanyaMalaviya,PedroFerreira,andAndréF.T.Martins.2018.SparseandConstrainedAttentionforNeuralMachineTranslation.InProceedingsofACL2018.JianLi,ZhaopengTu,BaosongYang,MichaelR.Lyu,andTongZhang.2018.Multi-HeadAttentionwithDisagreementRegularization.InProceedingsofEMNLP2018.WeiWu,HoufengWang,TianyuLiuandShumingMa.2018.Phrase-levelSelf-AttentionNetworksforUniversalSentenceEncoding.InProceedingsofEMNLP2018.BaosongYang,ZhaopengTu,DerekF.Wong,FandongMeng,LidiaS.Chao,andTongZhang.2018.ModelingLocalnessforSelf-AttentionNetworks.InProceedingsofEMNLP2018.JunyangLin,XuSun,XuanchengRen,MuyuLi,andQiSu.2018.LearningWhentoConcentrateorDivertAttention:Self-AdaptiveAttentionTemperatureforNeuralMachineTranslation.InProceedingsofEMNLP2018.AnkurBapna,MiaChen,OrhanFirat,YuanCao,andYonghuiWu.2018.TrainingDeeperNeuralMachineTranslationModelswithTransparentAttention.InProceedingsofEMNLP2018.MahaElbayad,LaurentBesacier,andJakobVerbeek.2018.PervasiveAttention:{2D}ConvolutionalNeuralNetworksforSequence-to-SequencePrediction.InProceedingsofCoNLL2018.
基于开放词汇和字符的神经机器翻译
FelixHill,KyunghyunCho,SebastienJean,ColineDevin,andYoshuaBengio.2015.EmbeddingWordSimilaritywithNeuralMachineTranslation.InProceedingsofICLR2015.ThangLuong,IlyaSutskever,QuocLe,OriolVinyals,andWojciechZaremba.2015.AddressingtheRareWordProbleminNeuralMachineTranslation.InProceedingsofACL2015.SébastienJean,KyunghyunCho,RolandMemisevic,andYoshuaBengio.2015.OnUsingVeryLargeTargetVocabularyforNeuralMachineTranslation.InProceedingsofACL2015.RicoSennrich,BarryHaddow,andAlexandraBirch.2016.NeuralMachineTranslationofRareWordswithSubwordUnits.InProceedingsofACL2016.Minh-ThangLuongandChristopherD.Manning.2016.AchievingOpenVocabularyNeuralMachineTranslationwithHybridWord-CharacterModels.InProceedingsofACL2016.JunyoungChung,KyunghyunCho,andYoshuaBengio.2016.ACharacter-levelDecoderwithoutExplicitSegmentationforNeuralMachineTranslation.InProceedingsofACL2016.JasonLee,KyunghyunCho,andThomasHofmann.2017.FullyCharacter-LevelNeuralMachineTranslationwithoutExplicitSegmentation.TransactionsoftheAssociationforComputationalLinguistics.YangFeng,ShiyueZhang,AndiZhang,DongWang,andAndrewAbel.2017.Memory-augmentedNeuralMachineTranslation.InProceedingsofEMNLP2017.BaosongYang,DerekF.Wong,TongXiao,LidiaS.Chao,andJingboZhu.2017.TowardsBidirectionalHierarchicalRepresentationsforAttention-basedNeuralMachineTranslation.InProceedingsofEMNLP2017.PeymanPassban,QunLiu,andAndyWay.2018.ImprovingCharacter-BasedDecodingUsingTarget-SideMorphologicalInformationforNeuralMachineTranslation.InProceedingsofNAACL2018.HuadongChen,ShujianHuang,DavidChiang,XinyuDai,andJiajunChen.2018.CombiningCharacterandWordInformationinNeuralMachineTranslationUsingaMulti-LevelAttention.InProceedingsofNAACL2018.FrederickLiu,HanLu,andGrahamNeubig.2018.HandlingHomographsinNeuralMachineTranslation.InProceedingsofNAACL2018.TakuKudo.2018.SubwordRegularization:ImprovingNeuralNetworkTranslationModelswithMultipleSubwordCandidates.InProceedingsofACL2018.MakotoMorishita,JunSuzuki,andMasaakiNagata.2018.ImprovingNeuralMachineTranslationbyIncorporatingHierarchicalSubwordFeatures.InProceedingsofCOLING2018.YangZhao,JiajunZhang,ZhongjunHe,ChengqingZong,andHuaWu.2018.AddressingTroublesomeWordsinNeuralMachineTranslation.InProceedingsofEMNLP2018.ColinCherry,GeorgeFoster,AnkurBapna,OrhanFirat,andWolfgangMacherey.2018.RevisitingCharacter-BasedNeuralMachineTranslationwithCapacityandCompression.InProceedingsofEMNLP2018.RebeccaKnowlesandPhilippKoehn.2018.ContextandCopyinginNeuralMachineTranslation.InProceedingsofEMNLP2018.
训练目标与框架
Marc|AurelioRanzato,SumitChopra,MichaelAuli,andWojciechZaremba.2016.SequenceLevelTrainingwithRecurrentNeuralNetworks.InProceedingsofICLR2016.Minh-ThangLuong,QuocV.Le,IlyaSutskever,OriolVinyals,andLukaszKaiser.2016.Multi-taskSequencetoSequenceLearning.InProceedingsofICLR2016.ShiqiShen,YongCheng,ZhongjunHe,WeiHe,HuaWu,MaosongSun,andYangLiu.2016.MinimumRiskTrainingforNeuralMachineTranslation.InProceedingsofACL2016.SamWisemanandAlexanderM.Rush.2016.Sequence-to-SequenceLearningasBeam-SearchOptimization.InProceedingsofEMNLP2016.DiHe,YingceXia,TaoQin,LiweiWang,NenghaiYu,Tie-YanLiu,Wei-YingMa.2016.DualLearningforMachineTranslation.InProceedingsofNIPS2016.DzmitryBahdanau,PhilemonBrakel,KelvinXu,AnirudhGoyal,RyanLowe,JoellePineau,AaronCourville,andYoshuaBengio.2017.AnActor-CriticAlgorithmforSequencePrediction.InProceedingsofICLR2017.KhanhNguyen,HalDauméIII,andJordanBoyd-Graber.2017.ReinforcementLearningforBanditNeuralMachineTranslationwithSimulatedHumanFeedback.InProceedingsofEMNLP2017.NimaPourdamghaniandKevinKnight.2017.DecipheringRelatedLanguages.InProceedingsofEMNLP2017.DiHe,HanqingLu,YingceXia,TaoQin,LiweiWang,andTieyanLiu.2017.DecodingwithValueNetworksforNeuralMachineTranslation.InProceedingsofNIPS2017.SergeyEdunov,MyleOtt,MichaelAuli,DavidGrangier,andMarc’AurelioRanzato.2018.ClassicalStructuredPredictionLossesforSequencetoSequenceLearning.InProceedingsofNAACL2018.ZhenYang,WeiChen,FengWang,andBoXu.2018.ImprovingNeuralMachineTranslationwithConditionalSequenceGenerativeAdversarialNets.InProceedingsofNAACL2018.PavelPetrushkov,ShahramKhadiviandEvgenyMatusov.2018.LearningfromChunk-basedFeedbackinNeuralMachineTranslation.InProceedingsofACL2018.LijunWu,FeiTian,TaoQin,JianhuangLai,andTie-YanLiu.2018.AStudyofReinforcementLearningforNeuralMachineTranslation.InProceedingsofEMNLP2018.JiataoGu,YongWang,YunChen,KyunghyunCho,andVictorO.K.Li.2018.Meta-LearningforLow-ResourceNeuralMachineTranslation.InProceedingsofEMNLP2018.HarshilShahandDavidBarber.2018.GenerativeNeuralMachineTranslation.InProceedingsofNeurIPS2018.LijunWu,FeiTian,YingceXia,YangFan,TaoQin,JianhuangLai,andTie-YanLiu.2018.LearningtoTeachwithDynamicLossFunctions.InProceedingsofNeurIPS2018.YirenWang,YingceXia,TianyuHe,FeiTian,TaoQin,ChengXiangZhai,andTie-YanLiu.2019.Multi-AgentDualLearning.InProceedingsofICLR2019.
解码
MingxuanWang,ZhengdongLu,HangLi,andQunLiu.2016.Memory-enhancedDecoderforNeuralMachineTranslation.InProceedingsofEMNLP2016.ShonosukeIshiwatari,JingtaoYao,ShujieLiu,MuLi,MingZhou,NaokiYoshinaga,MasaruKitsuregawa,andWeijiaJia.2017.Chunk-basedDecoderforNeuralMachineTranslation.InProceedingsofACL2017.HaoZhou,ZhaopengTu,ShujianHuang,XiaohuaLiu,HangLi,andJiajunChen.2017.Chunk-BasedBi-ScaleDecoderforNeuralMachineTranslation.InProceedingsofACL2017.ZichaoYang,ZhitingHu,YuntianDeng,ChrisDyer,andAlexSmola.2017.NeuralMachineTranslationwithRecurrentAttentionModeling.InProceedingsofEACL2017.CongDuyVuHoang,GholamrezaHaffari,andTrevorCohn.2017.TowardsDecodingasContinuousOptimisationinNeuralMachineTranslation.InProceedingsofEMNLP2017.Yin-WenChangandMichaelCollins.2017.Source-SideLeft-to-RightorTarget-SideLeft-to-Right?AnEmpiricalComparisonofTwoPhrase-BasedDecodingAlgorithms.InProceedingsofEMNLP2017.JiataoGu,KyunghyunCho,andVictorO.K.Li.2017.TrainableGreedyDecodingforNeuralMachineTranslation.InProceedingsofEMNLP2017.JiataoGu,JamesBradbury,CaimingXiong,VictorO.K.Li,andRichardSocher.2018.Non-AutoregressiveNeuralMachineTranslation.InProceedingsofICLR2018.XiangwenZhang,JinsongSu,YueQin,YangLiu,RongrongJi,andHongjiWang.2018.AsynchronousBidirectionalDecodingforNeuralMachineTranslation.InProceedingsofAAAI2018.PhilipSchulz,WilkerAziz,andTrevorCohn.2018.AStochasticDecoderforNeuralMachineTranslation.InProceedingsofACL2018.RaphaelShuandHidekiNakayama.2018.ImprovingBeamSearchbyRemovingMonotonicConstraintforNeuralMachineTranslation.InProceedingsofACL2018.JunyangLin,XuSun,XuanchengRen,ShumingMa,JinsongSu,andQiSu.2018.Deconvolution-BasedGlobalDecodingforNeuralMachineTranslation.InProceedingsofCOLING2018.ChunqiWang,JiZhang,andHaiqingChen.2018.Semi-AutoregressiveNeuralMachineTranslation.InProceedingsofEMNLP2018.XinweiGeng,XiaochengFeng,BingQin,andTingLiu.2018.AdaptiveMulti-passDecoderforNeuralMachineTranslation.InProceedingsofEMNLP2018.WenZhang,LiangHuang,YangFeng,LeiShen,andQunLiu.2018.SpeedingUpNeuralMachineTranslationDecodingbyCubePruning.InProceedingsofEMNLP2018.XinyiWang,HieuPham,PengchengYin,andGrahamNeubig.2018.ATree-basedDecoderforNeuralMachineTranslation.InProceedingsofEMNLP2018.ChenzeShao,XilinChen,andYangFeng.2018.GreedySearchwithProbabilisticN-gramMatchingforNeuralMachineTranslation.InProceedingsofEMNLP2018.ZhisongZhang,RuiWang,MasaoUtiyama,EiichiroSumita,andHaiZhao.2018.ExploringRecombinationforEfficientDecodingofNeuralMachineTranslation.InProceedingsofEMNLP2018.JeticGū,HassanS.Shavarani,andAnoopSarkar.2018.Top-downTreeStructuredDecodingwithSyntacticConnectionsforNeuralMachineTranslationandParsing.InProceedingsofEMNLP2018.YilinYang,LiangHuang,andMingboMa.2018.BreakingtheBeamSearchCurse:AStudyof(Re-)ScoringMethodsandStoppingCriteriaforNeuralMachineTranslation.InProceedingsofEMNLP2018.
资源稀缺语言的翻译
半监督方法
RicoSennrich,BarryHaddow,andAlexandraBirch.2016.ImprovingNeuralMachineTranslationModelswithMonolingualData.InProceedingsofACL2016.YongCheng,WeiXu,ZhongjunHe,WeiHe,HuaWu,MaosongSun,andYangLiu.2016.Semi-SupervisedLearningforNeuralMachineTranslation.InProceedingsofACL2016.TobiasDomhanandFelixHieber.2017.UsingTarget-sideMonolingualDataforNeuralMachineTranslationthroughMulti-taskLearning.InProceedingsofEMNLP2017.AnnaCurrey,AntonioValerioMiceliBarone,andKennethHeafield.2017.CopiedMonolingualDataImprovesLow-ResourceNeuralMachineTranslation.InProceedingsoftheSecondConferenceonMachineTranslation.
无监督方法
NimaPourdamghaniandKevinKnight.2017.DecipheringRelatedLanguages.InProceedingsofEMNLP2017.MikelArtetxe,GorkaLabaka,EnekoAgirre,andKyunghyunCho.2018.UnsupervisedNeuralMachineTranslation.InProceedingsofICLR2018.GuillaumeLample,AlexisConneau,LudovicDenoyer,andMarc|AurelioRanzato.2018.UnsupervisedMachineTranslationUsingMonolingualCorporaOnly.InProceedingsofICLR2018.ZhenYang,WeiChen,FengWang,andBoXu.2018.UnsupervisedNeuralMachineTranslationwithWeightSharing.InProceedingsofACL2018.GuillaumeLample,MyleOtt,AlexisConneau,LudovicDenoyer,andMarc|AurelioRanzato.2018.Phrase-Based&NeuralUnsupervisedMachineTranslation.InProceedingsofEMNLP2018.IftekharNaim,ParkerRiley,andDanielGildea.2018.Feature-BasedDeciphermentforMachineTranslation.ComputationalLinguistics.
基于Pivot的方法
OrhanFirat,BaskaranSankaran,YaserAl-Onaizan,FatosT.YarmanVural,andKyunghyunCho.2016.Zero-ResourceTranslationwithMulti-LingualNeuralMachineTranslation.InProceedingsofEMNLP2016.HaoZheng,YongCheng,andYangLiu.2017.MaximumExpectedLikelihoodEstimationforZero-resourceNeuralMachineTranslation.InProceedingsofIJCAI2017.YunChen,YangLiu,YongChengandVictorO.K.Li.2017.ATeacher-StudentFrameworkforZero-resourceNeuralMachineTranslation.InProceedingsofACL2017.YongCheng,QianYang,YangLiu,MaosongSun,andWeiXu.2017.JointTrainingforPivot-basedNeuralMachineTranslation.InProceedingsofIJCAI2017.YunChen,YangLiu,andVictorO.K.Li.2018.Zero-ResourceNeuralMachineTranslationwithMulti-AgentCommunicationGame.InProceedingsofAAAI2018.ShuoRen,WenhuChen,ShujieLiu,MuLi,MingZhou,andShuaiMa.2018.TriangularArchitectureforRareLanguageTranslation.InProceedingsofACL2018.
数据增强方法
MarziehFadaee,AriannaBisazza,andChristofMonz.2017.DataAugmentationforLow-ResourceNeuralMachineTranslation.InProceedingsofACL2017.MarziehFadaeeandChristofMonz.2018.Back-TranslationSamplingbyTargetingDifficultWordsinNeuralMachineTranslation.InProceedingsofEMNLP2018.SergeyEdunov,MyleOtt,MichaelAuli,andDavidGrangier.2018.UnderstandingBack-TranslationatScale.InProceedingsofEMNLP2018.XinyiWang,HieuPham,ZihangDai,andGrahamNeubig.2018.SwitchOut:anEfficientDataAugmentationAlgorithmforNeuralMachineTranslation.InProceedingsofEMNLP2018.
数据选择方法
MarliesvanderWees,AriannaBisazzaandChristofMonz.2017.DynamicDataSelectionforNeuralMachineTranslation.InProceedingsofEMNLP2017.
迁移学习和多任务学习方法
BarretZoph,DenizYuret,JonathanMay,andKevinKnight.2016.TransferLearningforLow-ResourceNeuralMachineTranslation.InProceedingsofEMNLP2016.JiataoGu,HanyHassan,JacobDevlin,andVictorO.K.Li.2018.UniversalNeuralMachineTranslationforExtremelyLowResourceLanguages.InProceedingsofNAACL2018.PooryaZaremoodiandGholamrezaHaffari.2018.NeuralMachineTranslationforBilinguallyScarceScenarios:aDeepMulti-TaskLearningApproach.InProceedingsofNAACL2018.PooryaZaremoodi,WrayBuntine,andGholamrezaHaffari.2018.AdaptiveKnowledgeSharinginMulti-TaskLearning:ImprovingLow-ResourceNeuralMachineTranslation.InProceedingsofACL2018.TomKocmiandOndejBojar.2018.TrivialTransferLearningforLow-ResourceNeuralMachineTranslation.InProceedingsoftheThirdConferenceonMachineTranslation:ResearchPapers.
元学习方法
JiataoGu,YongWang,YunChen,KyunghyunCho,andVictorO.K.Li.2018.Meta-LearningforLow-ResourceNeuralMachineTranslation.InProceedingsofEMNLP2018.
多语言翻译
DaxiangDong,HuaWu,WeiHe,DianhaiYu,andHaifengWang.2015.Multi-TaskLearningforMultipleLanguageTranslation.InProceedingsofACL2015.OrhanFirat,KyunghyunChoandYoshuaBengio.2016.Multi-way,multilingualneuralmachinetranslationwithaSharedAttentionMechanism.InProceedingsofNAACL2016.BarretZophandKevinKnight.2016.Multi-SourceNeuralTranslation.InProceedingsofNAACL2016.OrhanFirat,BaskaranSanKaran,YaserAl-Onaizan,FatosT.YarmanVural,KyunghyunCho.2016.Zero-ResourceTranslationwithMulti-LingualNeuralMachineTranslation.InProceedingsofEMNLP2016.MelvinJohnson,MikeSchuster,QuocV.Le,MaximKrikun,YonghuiWu,ZhifengChen,NikhilThorat,FernandaViégas,MartinWattenberg,GregCorrado,MacduffHughes,andJeffreyDean.2017.Google|sMultilingualNeuralMachineTranslationSystem:EnablingZero-ShotTranslation.TransactionsoftheAssociationforComputationalLinguistics.SurafelMelakuLakew,MauroCettolo,andMarcelloFederico.2018.AComparisonofTransformerandRecurrentNeuralNetworksonMultilingualNeuralMachineTranslation.InProceedingsofCOLING2018.GraemeBlackwood,MiguelBallesteros,andToddWard.2018.MultilingualNeuralMachineTranslationwithTask-SpecificAttention.InProceedingsofCOLING2018.EmmanouilAntoniosPlatanios,MrinmayaSachan,GrahamNeubig,andTomMitchell.2018.ContextualParameterGenerationforUniversalNeuralMachineTranslation.InProceedingsofEMNLP2018.YiningWang,JiajunZhang,FeifeiZhai,JingfangXu,andChengqingZong.2018.ThreeStrategiestoImproveOne-to-ManyMultilingualTranslation.InProceedingsofEMNLP2018.XuTan,YiRen,DiHe,TaoQin,ZhouZhao,andTie-YanLiu.2019.MultilingualNeuralMachineTranslationwithKnowledgeDistillation.InProceedingsofICLR2019.XinyiWang,HieuPham,PhilipArthur,andGrahamNeubig.2019.MultilingualNeuralMachineTranslationWithSoftDecoupledEncoding.InProceedingsofICLR2019.
(未完待续)
Github链接:
新智元AI技术+产业社群招募中,欢迎对AI技术+产业落地感兴趣的同学,加小助手_2入群;通过审核后我们将邀请进群,加入社群后务必修改群备注(姓名-公司-职位;专业群审核较严,敬请谅解)。
返回搜狐,查看更多
责任编辑:
标签: 机器翻译
相关新闻