Publications

This section contains publications published by ISI over the past several decades.

2023

Tailoring self-rationalizers with multi-reward distillation

Sahana Ramnath, Brihi Joshi, Skyler Hallinan, Ximing Lu, Liunian Harold Li, Aaron Chan, Jack Hessel, Yejin Choi, Xiang Ren
arXiv preprint arXiv:2311.02805,  2023

Bootstrap your own skills: Learning to solve new tasks with large language model guidance

Jesse Zhang, Jiahui Zhang, Karl Pertsch, Ziyi Liu, Xiang Ren, Minsuk Chang, Shao-Hua Sun, Joseph J Lim
arXiv preprint arXiv:2310.10021,  2023

Phenomenal yet puzzling: Testing inductive reasoning capabilities of language models with hypothesis refinement

Linlu Qiu, Liwei Jiang, Ximing Lu, Melanie Sclar, Valentina Pyatkin, Chandra Bhagavatula, Bailin Wang, Yoon Kim, Yejin Choi, Nouha Dziri, Xiang Ren
arXiv preprint arXiv:2310.08559,  2023

How far are large language models from agents with theory-of-mind?

Pei Zhou, Aman Madaan, Srividya Pranavi Potharaju, Aditya Gupta, Kevin R McKee, Ari Holtzman, Jay Pujara, Xiang Ren, Swaroop Mishra, Aida Nematzadeh, Shyam Upadhyay, Manaal Faruqui
arXiv preprint arXiv:2310.03051,  2023

An Experimental and Numerical Investigation of Cardiac Tissue-Patch Interrelation

Gozde Basara, Gokhan Bahcecioglu, Xiang Ren, Pinar Zorlutuna
Journal of Biomechanical Engineering 145 (8),  2023

Virtual prompt injection for instruction-tuned large language models

Jun Yan, Vikas Yadav, Shiyang Li, Lichang Chen, Zheng Tang, Hai Wang, Vijay Srinivasan, Xiang Ren, Hongxia Jin
arXiv preprint arXiv:2307.16888,  2023

Instruction-following evaluation through verbalizer manipulation

Shiyang Li, Jun Yan, Hai Wang, Zheng Tang, Xiang Ren, Vijay Srinivasan, Hongxia Jin
arXiv preprint arXiv:2307.10558,  2023

Cross-lingual continual learning

Meryem M’hamdi, Xiang Ren, Jonathan May
Proceedings of the 61st Annual Meeting of the Association for Computational …,  2023

FiD-ICL: A fusion-in-decoder approach for efficient in-context learning

Qinyuan Ye, Iz Beltagy, Matthew E Peters, Xiang Ren, Hannaneh Hajishirzi
Proceedings of the 61st Annual Meeting of the Association for Computational …,  2023

On grounded planning for embodied tasks with language models

Bill Yuchen Lin, Chengsong Huang, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
Proceedings of the AAAI Conference on Artificial Intelligence 37 (11), 13192 …,  2023

Symbolic chain-of-thought distillation: Small models can also" think" step-by-step

Liunian Harold Li, Jack Hessel, Youngjae Yu, Xiang Ren, Kai-Wei Chang, Yejin Choi
arXiv preprint arXiv:2306.14050,  2023

Llm-blender: Ensembling large language models with pairwise ranking and generative fusion

Dongfu Jiang, Xiang Ren, Bill Yuchen Lin
arXiv preprint arXiv:2306.02561,  2023

How new ideas diffuse in science

Mengjie Cheng, Daniel Scott Smith, Xiang Ren, Hancheng Cao, Sanne Smith, Daniel A McFarland
American sociological review 88 (3), 522-561,  2023

Plasma: Making small language models better procedural knowledge models for (counterfactual) planning

Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, Jena D Hwang, Xiang Lorraine Li, Hirona J Arai, Soumya Sanyal, Keisuke Sakaguchi, Xiang Ren, Yejin Choi
arXiv preprint arXiv:2305.19472,  2023

Grill: Grounded vision-language pre-training via aligning text and image regions

Woojeong Jin, Subhabrata Mukherjee, Yu Cheng, Yelong Shen, Weizhu Chen, Ahmed Hassan Awadallah, Damien Jose, Xiang Ren
arXiv preprint arXiv:2305.14676,  2023

How predictable are large language model capabilities? a case study on big-bench

Qinyuan Ye, Harvey Yiyun Fu, Xiang Ren, Robin Jia
arXiv preprint arXiv:2305.14947,  2023

Inference-time policy adapters (ipa): Tailoring extreme-scale lms without fine-tuning

Ximing Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, Yejin Choi
arXiv preprint arXiv:2305.15065,  2023

Spatial heterogeneity of socio-economic determinants of typhoid/paratyphoid fever in one province in central China from 2015 to 2019

Xiang Ren, Siyu Zhang, Piaoyi Luo, Jin Zhao, Wentao Kuang, Han Ni, Nan Zhou, Haoyun Dai, Xiuqin Hong, Xuewen Yang, Wenting Zha, Yuan Lv
BMC Public Health 23 (1), 927,  2023

Are machine rationales (not) useful to humans? measuring and improving human utility of free-text rationales

Brihi Joshi, Ziyi Liu, Sahana Ramnath, Aaron Chan, Zhewei Tong, Shaoliang Nie, Qifan Wang, Yejin Choi, Xiang Ren
arXiv preprint arXiv:2305.07095,  2023

Scott: Self-consistent chain-of-thought distillation

Peifeng Wang, Zhengyang Wang, Zheng Li, Yifan Gao, Bing Yin, Xiang Ren
arXiv preprint arXiv:2305.01879,  2023