# Deep Learning for Natural Language Processing — ICLR 2017 Discoveries

- Canonical URL: https://amund.blog/archive-amundtveit-iclr-2017-nlp/
- Author: Amund Tveit (https://amund.blog/about/)
- Published: 2016-11-12
- Tags: Deep Learning, NLP, Archive
- Original Source: amundtveit.com (https://amundtveit.com/2016/11/12/deep-learning-for-natural-language-processing-iclr-2017-discoveries/)

---

The [5th International Conference on Learning Representation (ICLR 2017)](<http://www.iclr.cc/doku.php?id=ICLR2017:main&redirect=1>) is coming to [Toulon, France](<http://toulontourisme.com/palais-congres-toulon/en/>) (April 24-26 2017), and there is large amount of Deep Learning papers submitted to the conference, looks like it will be a great event (see word cloud below for most frequent words used in submitted paper titles).

![](./figure-1.png)

 

This blog post gives an overview of **Natural Language Processing** related papers submitted to ICLR 2017, see underneath for the list of papers. If you want to learn about Deep Learning with NLP check out Stanford’s [CS224d: Deep Learning for Natural Language Processing](<http://cs224d.stanford.edu/>)

Best regards,

[Amund Tveit](<https://amundtveit.com/about/>)

## ICLR 2017 – NLP PAPERs

**Character/Word/Sentence Representation**

  1. [Character-aware Attention Residual Network for Sentence Representation](<http://openreview.net/pdf?id=H1Go7Koex>) – Authors: Xin Zheng, Zhenzhou Wu
  2. [Program Synthesis for Character Level Language Modeling](<http://openreview.net/pdf?id=ry_sjFqgx>) – Authors: Pavol Bielik, Veselin Raychev, Martin Vechev
  3. [Words or Characters? Fine-grained Gating for Reading Comprehension](<http://openreview.net/pdf?id=B1hdzd5lg>) – Authors: Zhilin Yang, Bhuwan Dhingra, Ye Yuan, Junjie Hu, William W. Cohen, Ruslan Salakhutdinov
  4. [Deep Character-Level Neural Machine Translation By Learning Morphology](<http://openreview.net/pdf?id=rJq_YBqxx>) – Authors: Shenjian Zhao, Zhihua Zhang
  5. [Opening the vocabulary of neural language models with character-level word representations](<http://openreview.net/pdf?id=SygGlIBcel>) – Authors: Matthieu Labeau, Alexandre Allauzen
  6. [Unsupervised sentence representation learning with adversarial auto-encoder](<http://openreview.net/pdf?id=Hy7xUFqlg>) – Authors: Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang
  7. [Offline Bilingual Word Vectors Without a Dictionary](<http://openreview.net/pdf?id=r1Aab85gg>) – Authors: Samuel L. Smith, David H. P. Turban, Nils Y. Hammerla, Steven Hamblin
  8. [Learning Word-Like Units from Joint Audio-Visual Analylsis](<http://openreview.net/pdf?id=Bkbc-Vqeg>) – Authors: David Harwath, James R. Glass
  9. [Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling](<http://openreview.net/pdf?id=r1aPbsFle>) – Authors: Hakan Inan, Khashayar Khosravi, Richard Socher
  10. [Sentence Ordering using Recurrent Neural Networks](<http://openreview.net/pdf?id=S1AG8zYeg>) – Authors: Lajanugen Logeswaran, Honglak Lee, Dragomir Radev

**Search/Question-Answer/Recommender Systems******

  1. [Learning to Query, Reason, and Answer Questions On Ambiguous Texts](<http://openreview.net/pdf?id=rJ0-tY5xe>) – Authors: Xiaoxiao Guo, Tim Klinger, Clemens Rosenbaum, Joseph P. Bigus, Murray Campbell, Ban Kawas, Kartik Talamadupula, Gerry Tesauro, Satinder Singh
  2. [Group Sparse CNNs for Question Sentence Classification with Answer Sets](<http://openreview.net/pdf?id=BJFG8Yqxl>) – Authors: Mingbo Ma, Liang Huang, Bing Xiang, Bowen Zhou
  3. [CONTENT2VEC: Specializing Joint Representations of Product Images and Text for the task of Product Recommendation](<http://openreview.net/pdf?id=ryTYxh5ll>) – Authors: Thomas Nedelec, Elena Smirnova, Flavian Vasile
  4. [Is a picture worth a thousand words? A Deep Multi-Modal Fusion Architecture for Product Classification in e-commerce](<http://openreview.net/pdf?id=rJJ3YU5ge>) – Authors: Tom Zahavy, Alessandro Magnani, Abhinandan Krishnan, Shie Mannor

**Word/Sentence Embedding**

  1. [A Simple but Tough-to-Beat Baseline for Sentence Embeddings](<http://openreview.net/pdf?id=SyK00v5xx>) – Authors: Sanjeev Arora, Yingyu Liang, Tengyu Ma
  2. [Investigating Different Context Types and Representations for Learning Word Embeddings](<http://openreview.net/pdf?id=Bkfwyw5xg>) – Authors: Bofang Li, Tao Liu, Zhe Zhao, Xiaoyong Du
  3. [Multi-view Recurrent Neural Acoustic Word Embeddings](<http://openreview.net/pdf?id=rJxDkvqee>) – Authors: Wanjia He, Weiran Wang, Karen Livescu
  4. [A Self-Attentive Sentence Embedding](<http://openreview.net/pdf?id=BJC_jUqxe>) – Authors: Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, Yoshua Bengio
  5. [Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks](<http://openreview.net/pdf?id=BJh6Ztuxl>) – Authors: Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, Yoav Goldberg

**Multilingual/Translation/Sentiment**

  1. [Neural Machine Translation with Latent Semantic of Image and Text](<http://openreview.net/pdf?id=B1G9tvcgx>) – Authors: Joji Toyama, Masanori Misono, Masahiro Suzuki, Kotaro Nakayama, Yutaka Matsuo
  2. [Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context](<http://openreview.net/pdf?id=HJSCGD9ex>) – Authors: Shyam Upadhyay, Kai-Wei Chang, James Zhou, Matt Taddy, Adam Kalai
  3. [Learning to Understand: Incorporating Local Contexts with Global Attention for Sentiment Classification](<http://openreview.net/pdf?id=HJlgm-B9lx>) – Authors: Zhigang Yuan, Yuting Hu, Yongfeng Huang
  4. [Adaptive Feature Abstraction for Translating Video to Language](<http://openreview.net/pdf?id=ByG4hz5le>) – Authors: Yunchen Pu, Martin Renqiang Min, Zhe Gan, Lawrence Carin
  5. [A Convolutional Encoder Model for Neural Machine Translation](<http://openreview.net/pdf?id=BJAA4wKxg>) – Authors: Jonas Gehring, Michael Auli, David Grangier, Yann N. Dauphin
  6. [Fuzzy paraphrases in learning word representations with a corpus and a lexicon](<http://openreview.net/pdf?id=r1osyr_xg>) – Authors: Yuanzhi Ke, Masafumi Hagiwara
  7. [Iterative Refinement for Machine Translation](<http://openreview.net/pdf?id=r1y1aawlg>) – Authors: Roman Novak, Michael Auli, David Grangier
  8. [Vocabulary Selection Strategies for Neural Machine Translation](<http://openreview.net/pdf?id=Bk8N0RLxx>) – Authors: Gurvan L’Hostis, David Grangier, Michael Auli

**Language Models/Text Comprehension/Matching/Compression/Classification/++**

  1. [A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks](<http://openreview.net/pdf?id=SJZAb5cel>) – Authors: Kazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, Richard Socher
  2. [Gated-Attention Readers for Text Comprehension](<http://openreview.net/pdf?id=HkcdHtqlx>) – Authors: Bhuwan Dhingra, Hanxiao Liu, Zhilin Yang, William W. Cohen, Ruslan Salakhutdinov
  3. [A Compare-Aggregate Model for Matching Text Sequences](<http://openreview.net/pdf?id=HJTzHtqee>) – Authors: Shuohang Wang, Jing Jiang
  4. [A Context-aware Attention Network for Interactive Question Answering](<http://openreview.net/pdf?id=SkyQWDcex>) – Authors: Huayu Li, Martin Renqiang Min, Yong Ge, Asim Kadav
  5. [FastText.zip: Compressing text classification models](<http://openreview.net/pdf?id=SJc1hL5ee>) – Authors: Armand Joulin, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Herve Jegou, Tomas Mikolov
  6. [Multi-Agent Cooperation and the Emergence of (Natural) Language](<http://openreview.net/pdf?id=Hk8N3Sclg>) – Authors: Angeliki Lazaridou, Alexander Peysakhovich, Marco Baroni
  7. [Learning a Natural Language Interface with Neural Programmer](<http://openreview.net/pdf?id=ry2YOrcge>) – Authors: Arvind Neelakantan, Quoc V. Le, Martin Abadi, Andrew McCallum, Dario Amodei
  8. [Learning similarity preserving representations with neural similarity and context encoders](<http://openreview.net/pdf?id=SkBsEQYll>) – Authors: Franziska Horn, Klaus-Robert Müller
  9. [Adversarial Training Methods for Semi-Supervised Text Classification](<http://openreview.net/pdf?id=r1X3g2_xl>) – Authors: Takeru Miyato, Andrew M. Dai, Ian Goodfellow
  10. [Multi-Label Learning using Tensor Decomposition for Large Text Corpora](<http://openreview.net/pdf?id=BkyQ7ssge>) – Authors: Sayantan Dasgupta
