Vardaan Pahuja

I am a Ph.D. student in CSE at The Ohio State University. I am fortunate to be advised by Prof. Yu Su. I graduated with M.Sc. (thesis track) in Computer Science from Université de Montréal (affiliated with MILA). Prior to this, I was working as Software Engineer in IBM India Research Lab., Bangalore. I graduated with Bachelor of Technology (Hons.) from IIT Kharagpur, India.

Email  /  CV  /  Twitter  /  LinkedIn  /  Google Scholar

• [July 2024] Our work Reviving the Context: Camera Trap Species Classification as Link Prediction on Multimodal Knowledge Graphs has been accepted to CIKM'24.
• [Aug 2023] Our work A Retrieve-and-Read Framework for Knowledge Graph Link Prediction has been accepted to CIKM'23.
• [June 2023] Our work SalsaBot: Towards a Robust and Generalizable Embodied Agent has been accepted to Embodied AI workshop at CVPR 2023.
• [May 2023] My internship work @ Google Brain is accepted to Transformers for Vison (T4V) workshop, CVPR 2023 [Diversifying Joint Vision-Language Tokenization Learning].
• [Feb 2023] Our team Salsabot has qualified to enter the semifinals of Alexa Prize Simbot Challenge.
• [Oct 2022] Attending Automated Knowledge Base Construction (AKBC) at London, UK.
• [April 2022] Interning at Google Brain this summer.
• [May 2021] Long paper accepted to ACL 2021 (Oral).
• [March 2021] Interning at Bosch AI Research this summer.

Multimodal Foundation Models, Knowledge Graph Reasoning, Graph Representation Learning, Natural Language Processing

Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents
Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou, Arindam Mitra, Spencer Whitehead, Yu Su, Ahmed Awadallah
[pdf] Preprint

Reviving the Context: Camera Trap Species Classification as Link Prediction on Multimodal Knowledge Graphs
Vardaan Pahuja, Weidi Luo, Yu Gu, Cheng-Hao Tu, Hong-You Chen, Tanya Berger-Wolf, Charles Stewart, Song Gao, Wei-Lun Chao, Yu Su
[pdf] [code] CIKM 24 (Oral)
[poster] Honourable Mention, OSU CSE Graduate Student Research Poster Exhibition
[short version] CV4Animals workshop, CVPR 24 (Oral)

A Retrieve-and-Read Framework for Knowledge Graph Link Prediction
Vardaan Pahuja, Boshi Wang, Hugo Latapie, Jayanth Srinivasa, Yu Su
[pdf] [code] [blog] CIKM 23 (Oral)

Diversifying Joint Vision-Language Tokenization Learning
Vardaan Pahuja, AJ Piergiovanni, Anelia Angelova
[pdf] [poster] Transformers for Vision workshop, CVPR 2023

Fine-Tuning is Fine, if Calibrated
Zheda Mai^*, Arpita Chowdhury^*, Ping Zhang^*, Cheng-Hao Tu, Hong-You Chen, Vardaan Pahuja, Tanya Berger-Wolf, Song Gao, Charles Stewart, Yu Su, Wei-Lun Chao
[pdf] NeurIPS 2024

Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data
Cheng-Hao Tu, Hong-You Chen, Jike Zhong, Zheda Mai, Vardaan Pahuja, Tanya Berger-Wolf, Song Gao, Charles Stewart, Yu Su, Wei-Lun Chao
[pdf] NeurIPS 2023

Knowledge Base Question Answering: A Semantic Parsing Perspective
Yu Gu, Vardaan Pahuja, Gong Cheng, Yu Su
[pdf] AKBC 2022

A Systematic Investigation of KB-Text Embedding Alignment at Scale
Vardaan Pahuja, Yu Gu, Wenhu Chen, Mehdi Bahrami, Lei Liu, Wei-Peng Chen and Yu Su
[pdf] [code] [slides] ACL 2021 (Oral)
[poster] Also presented at AKBC 22.

Structure Learning for Neural Module Networks
Vardaan Pahuja, Jie Fu, Sarath Chandar, Christopher J Pal
[pdf] [code] [slides] LANTERN workshop, EMNLP 2019

Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graph
Amrita Saha^*, Vardaan Pahuja^*, Mitesh M. Khapra, Karthik Sankaranarayanan, Sarath Chandar
[pdf] [code] [website] [slides] AAAI 2018

Joint Learning of Correlated Sequence Labeling Tasks Using Bidirectional Recurrent Neural Networks
Vardaan Pahuja^*, Anirban Laha^*, Shachar Mirkin, Vikas Raykar, Lili Kotlerman, Guy Lev
[pdf] [code] Interspeech 2017

Learning a Probabilistic Boolean Network Model from Biological Pathways and Time-series Expression Data
Vardaan Pahuja, Ritwik Kumar Layek, Pabitra Mitra
[paper] EMBC 16

SalsaBot: Towards a Robust and Generalizable Embodied Agent
Chan Hee Song, Jiaman Wu, Ju-Seung Byeon, Zexin Xu, Vardaan Pahuja, Goonmeet Bajaj, Samuel Stevens, Ziru Chen, Yu Su
[short version] Embodied AI Workshop at CVPR 2023
[long version] Alexa Prize SimBot Challenge Proceedings 2023

Learning Sparse Mixture of Experts for Visual Question Answering
Vardaan Pahuja, Jie Fu, Christopher J Pal
[pdf] Visual Question Answering and Dialog Workshop, CVPR 2019

Tooling framework for instantiating natural language querying system
Manasa Jammi, Jaydeep Sen, Ashish Mittal, Sagar Verma, Vardaan Pahuja, Rema Ananthanarayanan, Pranay Lohia, Hima Karanam, Diptikalyan Saha, Karthik Sankaranarayanan
[pdf] VLDB Endowment 2018

(website template borrowed from here)