publications

publications by categories in reversed chronological order. generated by jekyll-scholar.

2025

  1. NAACL Submission
    CoRAG: Collaborative Retrieval-Augmented Generation
    Aashiq Muhamed, Mona T. Diab, and Virginia Smith
    In 2025 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Apr 2025
  2. NAACL Submission
    Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
    Aashiq Muhamed, Mona Diab, and Virginia Smith
    In 2025 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Apr 2025

2024

  1. CVPR
    Adversarial Text to Continuous Image Generation
    Kilichbek Haydarov, Aashiq Muhamed, Jovana Lazarevic, and 4 more authors
    In The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024, Apr 2024
  2. EMNLP
    Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
    Aashiq Muhamed, Oscar Li, David Woodruff, and 2 more authors
    In The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP) , Apr 2024
  3. NeurIPS ENLSP
    Inducing Elasticity in Foundation Models: Post-Training Techniques for Adaptable Inference
    Aashiq Muhamed, Jiarui Liu, Mona Diab, and 1 more author
    In The 4th Workshop on Efficient Natural Language and Speech Processing, Dec 2024
  4. NeurIPS ATTRIB
    Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in LLMs
    Aashiq Muhamed, Jake Mendel, Lucius Bushnaq, and 2 more authors
    In Second NeurIPS Workshop on Attributing Model Behavior at Scale (ATTRIB 2024), Dec 2024
  5. EMNLP CustomNLP4U
    Less is Fed More: Sparsity Reduces Feature Distortion in Federated Learning
    Aashiq Muhamed, Harshita Diddee, and Abhinav Rao
    In Workshop on Customizable NLP (CustomNLP4U) at EMNLP 2024, Nov 2024
  6. ICML ES-FoMo
    Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
    Aashiq Muhamed, Oscar Li, David Woodruff, and 2 more authors
    In Efficient Systems for Foundation Models, Workshop at the International Conference on Machine Learning (ICML), Nov 2024
  7. ICLR Private ML
    Fed Up with Complexity: Simplifying Many-Task Federated Learning with NTKFedAvg
    Aashiq Muhamed, Meher Mankikar, and Virginia Smith
    In Privacy Regulation and Protection in Machine Learning, Workshop at ICLR, Nov 2024
  8. ICLR Private ML
    Cache Me If You Can: The Case For Retrieval Augmentation in Federated Learning
    Aashiq Muhamed, Pratiksha Thaker, Mona T. Diab, and 1 more author
    In Privacy Regulation and Protection in Machine Learning, Workshop at ICLR, Nov 2024
  9. EACL MOOMIN
    Less is Fed More: Sparsity Reduces Feature Distortion in Federated Learning
    Aashiq Muhamed, Harshita Diddee, and Abhinav Rao
    In The First Workshop on Modular and Open Multilingual NLP, EACL, Mar 2024
  10. Preprint
    NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA
    Marlon Tobaben, Mohamed Ali Souibgui, Rubèn Tito, and 24 more authors
    In , Mar 2024

2023

  1. PAKDD
    Web-scale semantic product search with large language models
    Aashiq Muhamed, Sriram Srinivasan, Choon-Hui Teo, and 4 more authors
    In Pacific-Asia Conference on Knowledge Discovery and Data Mining, Mar 2023
  2. ACL Oral
    ReAugKD: Retrieval-Augmented Knowledge Distillation for Pre-trained Language Models
    Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, and 7 more authors
    In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics ACL, Mar 2023
  3. ICML ES-FoMo
    Reverse Distillation: Training Billion Parameter Models For CTR Prediction
    Aditya Anantharam, Aashiq Muhamed, Hemant Pugaliya, and 6 more authors
    In ICML Workshop on Efficient Systems for Foundation Models (ES-FoMo), Mar 2023
  4. Preprint
    An In-depth Look at Gemini’s Language Abilities
    Syeda Nahida Akter, Zichun Yu, Aashiq Muhamed, and 6 more authors
    arXiv preprint arXiv: 2312.11444, Mar 2023
  5. KDD
    Tutorial on Training Large-scale Foundation Models on Emerging AI Chips
    Aashiq Muhamed, Christian Bock, Rahul Solanki, and 3 more authors
    In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Mar 2023

2022

  1. WWW
    DCAF-BERT: A Distilled Cachable Adaptable Factorized Model For Improved Ads CTR Prediction
    Aashiq Muhamed, Jaspreet Singh, Shuai Zheng, and 8 more authors
    In WWW ’22: Proceedings of the Web Conference, Mar 2022
    ...
  2. Preprint
    HyperCGAN: Text-to-Image Synthesis with HyperNet-Modulated Conditional Generative Adversarial Networks
    Kilichbek Haydarov, Aashiq Muhamed, Jovana Lazarevic, and 2 more authors
    https://openreview.net/forum?id=z-5BjnU3-OQ, Mar 2022

2021

  1. AAAI Oral
    Symbolic Music Generation with Transformer-GANs
    Aashiq Muhamed, Liang Li, Xingjian Shi, and 6 more authors
    In Proceedings of the AAAI Conference on Artificial Intelligence, Mar 2021
  2. EMBC
    Gated Transformer for Decoding Human Brain EEG Signals
    Yunzhe Tao, Tao Sun, Aashiq Muhamed, and 6 more authors
    43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mar 2021
  3. NeurIPS ENLSP
    CTR-BERT: Cost-effective knowledge distillation for billion-parameter teacher models
    Aashiq Muhamed, Iman Keivanloo, Sujan Perera, and 6 more authors
    In NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP) (Oral Spotlight), Mar 2021

2020

  1. NeurIPS ML4CD
    Transformer-GAN: Symbolic music generation using a learned loss
    Aashiq Muhamed, Liang Li, Xingjian Shi, and 6 more authors
    In 4th NeurIPS Workshop on Machine Learning for Creativity and Design, Mar 2020
  2. ISMIR NLP4MusA
    Symbolic Music Generation with Transformer-GANs
    Aashiq Muhamed, Liang Li, Xingjian Shi, and 2 more authors
    In 1st ISMIR Workshop on NLP for Music and Audio (NLP4MusA) (Oral spotlight), Mar 2020
  3. Patent
    3D convolutional neural networks for television advertisement detection. US Patent 10,706,286
    Aashiq Muhamed, Susmita Ghose, and Dawnis Chow
    Jul 2020
    US Patent 10,706,286
  4. Patent
    Text independent speaker-verification on a media operating system using deep learning on raw waveforms. US Patent 10,699,715
    Aashiq Muhamed, and Susmita Ghose
    Jun 2020
    US Patent 10,699,715
  5. Amazon CVC
    Designing event representations for symbolic music
    Aashiq Muhamed, Liang Li, and Xingjian Shi
    In Amazon Computer Vision Conference (CVC), Jun 2020