publications

2026

  1. EMNLP
    PALMs: Using Multi Construct-Grounded Rationales for Modeling Population Preferences in LLMs
    Priyanka Dey, Brihi Joshi, Preyashi Poddar, Jieyu Zhao, and Emilio Ferrara
    EMNLP, 2026
    HTML
  2. EvalEval
    Rigorous Interpretation Is a Form of Evaluation
    Isabelle Lee, Emmy Liu, Cathy Jiao, Brihi Joshi, Dani Yogatama, Fazl Barez, and Michael Saxon
    Workshop on Evaluating Evaluations (EvalEval), 2026
    HTML
  3. EMNLP
    Translating the Untranslatable: An Operationalizable Ontology for Untranslatability
    Jacob Bremerman, Brihi Joshi, Hirona Arai, Xiang Ren, and Jonathan May
    Findings of EMNLP, 2026
    HTML
  4. ACL
    Believing without Seeing: Quality Scores for Contextualizing Vision-Language Model Explanations
    Keyu He, Tejas Srinivasan, Brihi Joshi, Xiang Ren, Jesse Thomason, and Swabha Swayamdipta
    ACL, 2026
  5. NeurIPS
    Evaluating the Evaluators: Investigating LLM Judges for Personalized Writing Style Assessment
    Natalie Mackraz, Andrew Silva, Aini Putkonen, Brihi Joshi, Joelle Alcaidinho, Arnav Arora, Barry-John Theobald, and Katherine Metcalf
    Trust-AI-Eval Workshop, NeurIPS, 2026
  6. PREPRINT
    MatrAIx: Simulating the World with 8.3 Billion Persona Agents
    Xiaomin Li, Yuexing Hao, Jianheng Hou, Jintao Huang, Qianfeng Wen, Shirley Huang, Yifan Liu, Xiaoyi Liu, Yilan Fan, Yijun Wang, Koutian Wu, Ruoqi Gao, Muhammad Ahmed Mohsin, Jing Tang, Brihi Joshi, Heming Liu, Zheyuan Deng, Zonglin Di, Sankalp Jajee, Jiuyao Lu, Zhiwei Zhang, Saksham Kapoor, Ishan Gupta, Yunhan Zhao, Chanwoo Park, Yucheng Lu, Bing Hu, Weihang Xiao, Aravind Mohan, Hanwen Xing, Runyu Zhang, Mihir Kulshreshtha, Yuanda Xu, Qianyu Zhu, Dianzhuo Wang, Yuxin Xiao, Bowen Jiang, Yongye Su, Wenhao Chai, Zuxin Liu, Lawrence Yunliang Chen, Xuandong Zhao, Ethan Ye, Shivam Patel, Jason Xie, Alex Martin Richmond, Weixiang Ding, Emre Okcular, Diya Mathew, Ziheng Wang, Rana M Shahroz Khan, Zhejian Peng, Fang Wu, Fan Nie, Xinyang Han, Yubin Kim, Jiawei Zhang, Zhenting Qi, Huangyuan Su, Xu Pan, Abinitha Gourabathina, Hyewon Jeong, Hemanth Neelgund Ramesh, Kumail Alhamoud, Kimia Hamidieh, Zidi Xiong, Samuel Schmidgall, Pengrui Han, Yepeng Huang, Yongheng Wang, Bowen Yang, Alex Gu, Yuchu Wang, Akshay Paruchuri, Brenna Li, Hejie Cui, Jiayuan Ding, Chaosheng Dong, Jiahao Wang, Yixuan He, Chi Wang, Pamela Bhattacharya, Tianyi Peng, Paul Pu Liang, Mitchell Gordon, Yilun Du, Marinka Zitnik, James Zou, Prasanna Tambe, Philip Torr, Emily Fox, Asu Ozdaglar, and Dawn Song
    PREPRINT, 2026
    HTML
  7. COLM
    MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulations
    Sky Ng, Brihi Joshi, Ishan Gupta, Shirley Huang, Zonglin Di, Yun Shen, Qianfeng Wen, Yifan Simon Liu, Ruoqi Gao, Zhiwei Zhang, Muhammad Ahmed Mohsin, Yucheng Lu, Xiaoyi Liu, Heming Liu, Qianyu Zhu, Hanwen Xing, Zhengyang Shan, My Chiffon Nguyen, Guanghui Min, Keyang Xuan, Hannah Collison, Jintao Huang, Jiatong Li, Sankalp Jajee, Yunhan Zhao, Bing Hu, Xupeng Chen, Binghang Lu, Weihang Xiao, Aravind Mohan, Bolun Sun, Yunshu Wu, Yuanda Xu, Runyu Zhang, Zheyuan Deng, Dianzhuo Wang, Yijun Wang, Yixuan He, Koutian Wu, Cheng Cheng, Xiaomin Li, and Yuexing Hao
    Workshop on Social Simulation with LLMs, COLM, 2026
    HTML
  8. COLM
    PersonaEval: Persona-Based User Simulation for Evaluating Interactive Applications
    Yifan Simon Liu, Qianfeng Wen, Yilan Fan, Shirley Huang, Ruoqi Gao, Jianheng Hou, Muhammad Ahmed Mohsin, Zonglin Di, Brihi Joshi, Xincheng Tan, Yucheng Lu, Xiaoyi Liu, Heming Liu, Hanwen Xing, Guanghui Min, Zhengyang Shan, My Chiffon Nguyen, Ishan Gupta, Yunze Xiao, Hannah Collison, Jintao Huang, Jiatong Li, Sankalp Jajee, Yunhan Zhao, Bing Hu, Sky Ng, Xupeng Chen, Binghang Lu, Weihang Xiao, Aravind Mohan, Bolun Sun, Yunshu Wu, Yuanda Xu, Yun Shen, Runyu Zhang, Zheyuan Deng, Zhiwei Zhang, Qianyu Zhu, Dianzhuo Wang, Yijun Wang, Yixuan He, Yuexing Hao, and Xiaomin Li
    Workshop on Social Simulation with LLMs, COLM, 2026
    HTML
  9. COLM
    Position: Synthetic Persona Needs Explicit Grounding and Standardized Reporting
    Yucheng Lu, Xiaoyi Liu, Heming Liu, Hanwen Xing, Shirley Huang, Guanghui Min, Zhengyang Shan, My Chiffon Nguyen, Ishan Gupta, Zonglin Di, Qianfeng Wen, Yifan Simon Liu, Ruoqi Gao, Yilan Fan, Jianheng Hou, Brihi Joshi, Muhammad Ahmed Mohsin, Yunze Xiao, Keyang Xuan, Hannah Collison, Jintao Huang, Jiatong Li, Sankalp Jajee, Yunhan Zhao, Bing Hu, Zhiwei Zhang, Sky Ng, Xupeng Chen, Weihang Xiao, Aravind Mohan, Bolun Sun, Yunshu Wu, Yuanda Xu, Yun Shen, Zheyuan Deng, Xincheng Tan, Qianyu Julie Zhu, Dianzhuo Wang, Yijun Wang, Runyu Zhang, Yixuan He, Xiaomin Li, and Yuexing Hao
    Workshop on Social Simulation with LLMs, COLM, 2026
    HTML

2025

  1. GEM2
    CoKe: Customizable Fine-Grained Story Evaluation via Chain-of-Keyword Rationalization
    Brihi Joshi, Sriram Venkatapathy, Mohit Bansal, Nanyun Peng, and Haw-Shiuan Chang
    Workshop on Generation, Evaluation and Metrics (GEM2), 2025
    HTML
  2. EMNLP
    Improving LLM Personas via Rationalization with Psychological Scaffolds
    Brihi Joshi, Xiang Ren, Swabha Swayamdipta, Rik Koncel-Kedziorski, and Tim Paek
    Findings of EMNLP, 2025
  3. EMNLP
    PrimeX: A dataset of worldview, opinion, and explanation
    Rik Koncel-Kedziorski, Brihi Joshi, and Tim Paek
    EMNLP, 2025
  4. EMNLP
    Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries
    Sahana Ramnath, Anurag Mudgil, Brihi Joshi, Skyler Hallinan, and Xiang Ren
    EMNLP, 2025
  5. ACL
    ELI-Why: Evaluating the Pedagogical Utility of LLM Explanations
    Brihi Joshi*, Keyu He*, Sahana Ramnath, Sadra Sabouri, Kaitlyn Zhou, Souti Chattopadhyay, Swabha Swayamdipta, and Xiang Ren
    Findings of ACL, 2025

2024

  1. EMNLP
    OATH-Frames: Characterizing Online Attitudes towards Homelessness via LLM Assistants
    Jaspreet Ranjit, Brihi Joshi, Rebecca Dorn, Laura Petry, Olga Koumoundouros, Jayne Bottarini, Peichen Liu, Eric Rice, and Swabha Swayamdipta
    EMNLP, Outstanding Paper Award, 2024
    HTML
  2. ICLR
    Tailoring Self-Rationalizers with Multi-Reward Distillation
    Sahana Ramnath, Brihi Joshi, Skyler Hallinan, Ximing Lu, Liunian Harold Li, Aaron Chan, Jack Hessel, Yejin Choi, and Xiang Ren
    ICLR, 2024
    HTML

2023

  1. ACL
    XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models
    Dong-Ho Lee*, Akshen Kadakia*, Brihi Joshi, Aaron Chan, Ziyi Liu, Kiran Narahari, Takashi Shibuya, Ryosuke Mitani, Toshiyuki Sekiya, Jay Pujara, and Xiang Ren
    ACL Demo Track, 2023
    HTML
  2. ACL
    Are Machine Rationales (Not) Useful to Humans? Measuring and Improving Human Utility of Free-text Rationales
    Brihi Joshi*, Ziyi Liu*, Sahana Ramnath, Aaron Chan, Zhewei Tong, Shaoliang Nie, Qifan Wang, Yejin Choi, and Xiang Ren
    ACL and trAIt@CHI, 2023
    HTML
  3. PREPRINT
    KNIFE: Knowledge Distillation with Free-Text Rationales
    Aaron Chan*, Zhiyuan Zeng*, Wyatt Lake, Brihi Joshi, Hanjie Chen, and Xiang Ren
    TrustML-(un)Limited@ICLR, 2023
    HTML

2022

  1. EMNLP
    ER-Test: Evaluating Explanation Regularization Methods for NLP Models
    Brihi Joshi*, Aaron Chan*, Ziyi Liu*, Shaoliang Nie, Maziar Sanjabi, Hamed Firooz, and Xiang Ren
    Findings of EMNLP and TrustNLP@NAACL, 2022
    HTML

2020

  1. COLING
    The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks
    Brihi Joshi, Neil Shah, Francesco Barbieri, and Leonardo Neves
    International Conference on Computational Linguistics, 2020
    HTML Code
  2. ACM TIST
    Analyzing and Detecting Collusive Users Involved in Blackmarket Retweeting Activities
    Udit Arora, Hridoy Sankar Dutta, Brihi Joshi*, Aditya Chetan*, and Tanmoy Chakraborty
    ACM Transactions on Intelligent Systems and Technology, 2020
    HTML Code
  3. ISMIR
    Did You “Read” the Next Episode? Using Textual Cues for Predicting Podcast Popularity
    Brihi Joshi, Shravika Mittal, and Aditya Chetan
    Workshop on NLP for Music and Audio (NLP4MusA), ISMIR, 2020
    HTML Code
  4. ICMI
    It’s Not What They Play, It’s What You Hear: Understanding Perceived vs. Induced Emotions in Hindustani Classical Music
    Amogh Gulati, Brihi Joshi, Chirag Jain, and Jainendra Shukla
    International Conference on Multimodal Interaction Late Breaking Reports, 2020
    HTML

2019

  1. WSDM
    CoReRank: Ranking to Detect Users Involved in Blackmarket-Based Collusive Retweeting Activities
    Aditya Chetan*, Brihi Joshi*, Hridoy Sankar Dutta*, and Tanmoy Chakraborty
    International Conference on Web Search and Data Mining, 2019
    HTML Code

2018

  1. ASONAM
    Retweet Us, We will Retweet You: Spotting Collusive Retweeters Involved in Blackmarket Services
    Hridoy Sankar Dutta, Aditya Chetan, Brihi Joshi, and Tanmoy Chakraborty
    International Conference on Advances in Social Networks Analysis and Mining, 2018
    HTML Code
  2. PREPRINT
    Generating Clues for Gender based Occupation De-biasing in Text
    Nishtha Madaan, Gautam Singh, Sameep Mehta, Aditya Chetan, and Brihi Joshi
    arXiv:1804.03839, 2018
    HTML