Welcome I am a postdoctoral researcher at the Paul G. Allen School of Computer Science & Engineering department of the University of Washington working with Professor Noah Smith. My current research on improving the sample and computational efficiency of language models is funded by SNSF. Previously, I did a postdoc with Doctor James Henderson at the Idiap Research Institute's natural language understanding group and earned my doctoral degree at EPFL with Professor Andrei Popescu-Belis. I have also interned at Columbia University and received my master's and engineer's degrees from the University of the Aegean.

News  Show more

• Mar 2021 — Preprint on Finetuning Pretrained Transformers into RNNs is available on arXiv.
• Feb 2021 — Serving as review commitee member of ICML 2021, IJCAI 2021 and ACL-IJCNLP 2021.
• Jan 2021 — Our paper on Random Feature Attention got a spotlight at ICLR 2021! ↴
  → Congrats to Hao for leading the project!
• Jan 2021 — Two papers on Deep-Shallow Models and Random Feature Attention accepted at ICLR 2021.↴
  → Congrats to Jungo and Hao for leading each project respectively!
• Oct 2020 — Serving as review commitee member of ICLR 2021 and NAACL-HLT 2021.
• Sep 2020 — Three papers on Grounded LMs, Multilevel Text Alignment, and PnP Autoencoders accepted at EMNLP 2020.↴
  → Congrats to Xuhui and Florian for leading two of the projects!
• Sep 2020 — Ranked among the top-33% reviewers for my service at ICML 2020.
Jul 2020 — Serving as review commitee member of EMNLP 2020, AACL 2020 and COLING 2020.
Jun 2020 — Paper on Fast Autoregressive Transformers with Linear Attention to appear at ICML 2020. ↴
→ Congrats to Angelos for leading the project!
Jun 2020 — Preprints on speeding-up transformers with Linear Attention and Deep-Shallow Models are now available.
Apr 2020 — Serving as review commitee member of ICML 2020, ACL 2020 and AAAI 2021.
Sep 2019 — Joined Noah's ARK group and the NLP group at the University of Washington.
May 2019 — Papers on Generalized Zero-Shot Learning and Sense-Aware NMT will be presented at ACL 2019.
Apr 2019 — Paper on Deep Residual Output Layers for Neural Language Generation was accepted at ICML 2019.
Jan 2019 — Paper on A Generalized Input-Label Embedding for Text Classification to appear in TACL.
Dec 2018 — Won a two-year postdoc fellowship by SNSF to work with prof. Noah Smith at the University of Washington!
Oct 2018 — Paper on Integrating Weakly Supervised Word Sense Disambiguation into Neural MT to appear in TACL.↴
→ Congrats to Xiao for leading the project!
Aug 2018 — Paper on Document-Level Neural MT with Hierarchical Attention Networks was accepted at EMNLP 2018.↴
→ Congrats to Lesly for leading the project!
Aug 2018 — Paper on Joint Input-Output Embeddings for Neural MT was accepted at WMT 2018.
Jun 2018 — Gave an invited talk on Basics and (Modern) Methods for NLP at the Digital School of UnternehmerTUM.
Feb 2018 — Paper on Self-attentive Residual Decoder for Neural MT was accepted at NAACL 2018.↴
→ Congrats to Lesly for leading the project!
Nov 2017 — Won the best paper award at IJCNLP 2017!
Sep 2017 — Paper on Multilingual Hierarchical Attention Networks was accepted at IJCNLP 2017.
Jun 2017 — Paper on Sense-aware Statistical Machine Translation was accepted at WMT 2017.↴
→ Congrats to Xiao for leading the project!
Feb 2017 — Journal paper on Explicit Document Modeling through Multiple-Instance Learning was accepted at JAIR.
Dec 2016 — Gave a lecture on Multilingual Word Sequence Learning for the HLT course at EPFL.
Nov 2016 — Attended EMNLP 2016 conference in Austin, Texas.
Oct 2016 — Gave a lecture on Word Representation Learning for the HLT course at EPFL.

Present

2019

2016

2014

2011

Contact me at: npappas@cs.washington.edu
Scholar / Github / Twitter