Publications

For the complete list of papers, see my Google scholar profile.

2023

  • Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing, Shufan Wang, Sebastien Jean, Sailik Sengupta, James Gung, Nikolaos Pappas, Yi Zhang. Conference on Empirical Methods in Natural Language Processing (EMNLP Findings).
    PDF Bibtex
  • Pre-training Intent-Aware Encoders for Zero-and Few-Shot Intent Classification, Mujeen Sung, James Gung, Elman Mansimov, Nikolaos Pappas, Raphael Shu, Salvatore Romeo, Yi Zhang, Vittorio Castelli. Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex
  • Vcc: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens, Zhanpeng Zeng, Cole Hawkins, Mingyi Hong, Aston Zhang, Nikolaos Pappas, Vikas Singh, Shuai Zheng. Conference on Neural Information Processing Systems (NeurIPS).
    PDF Bibtex
  • Conversation style transfer using few-shot learning, Shamik Roy, Raphael Shu, Nikolaos Pappas, Elman Mansimov, Yi Zhang, Saab Mansour, Dan Roth. Joint Conference on Natural Language Processing and Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL).
    PDF Bibtex
  • Backward compatibility during data updates by weight interpolation , Raphael Schumann, Elman Mansimov, Yi-An Lai, Nikolaos Pappas, Xibin Gao, Yi Zhang. Conference of the European Chapter of the Association for Computational Linguistics (EACL Findings).
    PDF Bibtex

2022

  • Dialog2API: Task-Oriented Dialogue with API Description and Example Programs, Raphael Shu, Elman Mansimov, Tamer Alkhouli, Nikolaos Pappas, Salvatore Romeo, Arshit Gupta, Saab Mansour, Yi Zhang, Dan Roth. arXiv preprint.
    PDF Bibtex
  • Modeling Context With Linear Attention for Scalable Document-Level Translation, Zhaofeng Wu, Hao Peng, Nikolaos Pappas, Noah A. Smith. In Findings of the Conference on Empirical Methods in Natural Language Processing (EMNLP Findings).
    PDF Bibtex Poster
  • ABC: Attention with Bounded-memory Control, Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith. In proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL).
    PDF Bibtex Video

2021

  • Sentence Bottleneck Autoencoders from Pretrained Transformer Models, Ivan Montero, Nikolaos Pappas, Noah A. Smith. In proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code by IM Slides
  • Finetuning Pretrained Transformers into RNNs, Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith. In proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code by JK
  • Random Feature Attention, Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong. In Proceedings of the International Conference on Learning Representations (ICLR).
    PDF Bibtex Code by HP Slides
  • Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation, Jungo Kasai, Nikolaos Pappas, Hao Peng, James Cross, Noah Smith. In Proceedings of the International Conference on Learning Representations (ICLR).
    PDF Bibtex Code by JK Slides

2020

  • Grounded Compositional Outputs for Adaptive Language Modeling, Nikolaos Pappas, Phoebe Mulcaire, Noah A. Smith. In proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code Slides
  • Multilevel Text Alignment with Cross-Document Attention, Xuhui Zhou, Nikolaos Pappas, Noah A. Smith. In proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code by XZ Slides
  • Plug and Play Autoencoders for Conditional Text Generation, Florian Mai, Nikolaos Pappas, Ivan Montero, Noah A. Smith, James Henderson. In proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code by FM Slides
  • Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention, Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, Francois Fleuret. In Proceedings of the 37th International Conference on Machine Learning
    (ICML).
    PDF Bibtex Code by AK/AV Slides

2019

  • Deep Residual Output Layers for Neural Language Generation, Nikolaos Pappas and James Henderson. In Proceedings of the 36th International Conference on Machine Learning (ICML).
    PDF Bibtex Code Slides Poster
  • GILE: A Generalized Input-Label Embedding for Text Classification, Nikolaos Pappas and James Henderson. In Transactions of the Association for Computational Linguistics (TACL). To be presented at ACL 2019.
    PDF Bibtex Code Poster

2018

  • Integrating Weakly Supervised Word Disambiguation into Neural Machine Translation, Xiao Pu, Nikolaos Pappas, James Henderson, Andrei Popescu-Belis. In Transactions of the Association for Computational Linguistics (TACL). To be presented at ACL 2019.
    PDF Bibtex Code by XP Poster
  • Document-Level Neural Machine Translation with Hierarchical Attention Networks, Lesly Miculicich Werlen, Dhananjay Ram, Nikolaos Pappas, James Henderson. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code by LM Poster
  • Beyond Weight Tying: Learning Joint Input-Output Embeddings for Neural Machine Translation, Nikolaos Pappas, Lesly Miculicich Werlen, James Henderson. In Proceedings of the 3rd Conference on Machine Translation (WMT).
    PDF Bibtex Code Slides
  • Self-attentive Residual Decoder for Neural Machine Translation, Lesly Miculicich Werlen, Nikolaos Pappas, Dhananjay Ram, Andrei Popescu-Belis. In Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT).
    PDF Bibtex Code by LM Poster

2017

  • Multilingual Hierarchical Attention Networks for Document Classification, Nikolaos Pappas and Andrei Popescu-Belis. In Proceedings of the 8th International Joint Conference on Natural Language Processing (IJCNLP).
    PDF Bibtex Code & data Slides
  • Sense-Aware Statistical Machine Translation using Adaptive Context-Dependent Clustering, Xiao Pu, Nikolaos Pappas, Andrei Popescu-Belis. In Proceedings of the 2nd Conference on Machine Translation (WMT).
    PDF Bibtex
  • Explicit Document Modeling through Weighted Multiple-Instance Learning, Nikolaos Pappas and Andrei Popescu-Belis. In Journal of Artificial Intelligence Research (JAIR).
    PDF Bibtex Code
  • Multilingual Visual Sentiment Concept Clustering and Analysis, Nikolaos Pappas, Mercan Topkara, Miriam Redi, Hongyi Liu, Brendan Jou, Tao Chen, Shih-Fu Chang. In International Journal of Multimedia Information Retrieval (IJMIR).
    PDF Bibtex

2016

  • Human versus Machine Attention in Document Classification: A Dataset with Crowdsourced Annotations, Nikolaos Pappas and Andrei Popescu-Belis. In Proceedings of the International Workshop on Natural Language Processing for Social Media (SocialNLP@EMNLP).
    PDF Bibtex Code & Data Slides
  • Multilingual Visual Sentiment Concept Matching, Nikolaos Pappas, Mercan Topkara, Miriam Redi, Brendan Jou, Tao Chen, Hongyi Liu, Shih-Fu Chang. In Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR).
    PDF Bibtex Slides
  • Adaptive Sentiment-Aware One-Class Collaborative Filtering, Nikolaos Pappas and Andrei Popescu-Belis. In Expert Systems with Applications (ESWA).
    PDF Bibtex

2015

  • Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology Brendan Jou, Tao Chen, Nikolaos Pappas, Miriam Redi, Mercan Topkara, Shih-Fu Chang. In Proceedings of ACM International Conference on Multimedia (MM).
    PDF Bibtex Data Poster
  • Combining Content with User Preferences for Non-Fiction Multimedia Recommendation: A Study on TED Lectures, Nikolaos Pappas and Andrei Popescu-Belis. In Multimedia Tools and Applications (MTAP)
    PDF Bibtex

2014

  • Explaining the Stars: Weighted Multiple-Instance Learning for Aspect-Based Sentiment Analysis, Nikolaos Pappas and Andrei Popescu-Belis. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).
    PDF Bibtex Code & Data Slides
  • Multimodal Reranking of Content-based Recommendations for Hyperlinking Video Snippets, Chidansh A. Bhatt, Nikolaos Pappas, Maryam Habibi, Andrei Popescu-Belis. In Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR).
    PDF Bibtex Data

2013

  • Sentiment Analysis of User Comments for One-Class Collaborative Filtering over TED Talks, Nikolaos Pappas and Andrei Popescu-Belis. In Proceedings of the 36th ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR).
    PDF Bibtex Poster
  • Combining Content with User Preferences for TED Lecture Recommendation, Nikolaos Pappas and Andrei Popescu-Belis. In Proceedings of the 11th International Workshop on Content Based Multimedia Indexing (CBMI)
    PDF Bibtex Data Slides
  • Distinguishing the Popularity Between Topics: A System for Up-to-date Opinion Retrieval and Mining in the Web, Nikolaos Pappas, Georgios Katsimpras, Efstathios Stamatatos. In Proceedings of the 14th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing).
    PDF Bibtex Code Slides
Location