Publications

This section contains publications published by ISI over the past several decades.

2024

Egocentric Speaker Classification in Child-Adult Dyadic Interactions: From Sensing to Computational Modeling

Tiantian Feng, Anfeng Xu, Xuan Shi, Somer Bishop, Shrikanth Narayanan
arXiv preprint arXiv:2409.09340,  2024

Data efficient child-adult speaker diarization with simulated conversations

Anfeng Xu, Tiantian Feng, Helen Tager-Flusberg, Catherine Lord, Shrikanth Narayanan
arXiv preprint arXiv:2409.08881,  2024

ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation

Tiantian Feng, Tuo Zhang, Salman Avestimehr, Shrikanth S Narayanan
arXiv preprint arXiv:2408.15803,  2024

Early detection of coffee leaf rust through convolutional neural networks trained on low-resolution images

Angelly Cabrera, Kleanthis Avramidis, Shrikanth Narayanan
arXiv preprint arXiv:2407.14737,  2024

Artificial intelligence to differentiate pediatric pseudopapilledema and true papilledema on fundus photographs

Melinda Y Chang, Gena Heidary, Shannon Beres, Stacy L Pineles, Eric D Gaier, Ryan Gise, Mark Reid, Kleanthis Avramidis, Mohammad Rostami, Shrikanth Narayanan, Pediatric Optic Nerve Investigator Group
Ophthalmology Science 4 (4), 100496,  2024

Scaling representation learning from ubiquitous ecg with state-space models

Kleanthis Avramidis, Dominika Kunc, Bartosz Perz, Kranti Adsul, Tiantian Feng, Przemysław Kazienko, Stanisław Saganowski, Shrikanth Narayanan
IEEE Journal of Biomedical and Health Informatics,  2024

Saliency analysis of eye tracking in children with cortical/cerebral visual impairment (CVI) enabled by machine learning

Melinda Chang, Kleanthis Avramidis, Rahul Sharma, Mark Borchert, Shrikanth Narayanan
Investigative Ophthalmology & Visual Science 65 (7), 1501-1501,  2024

Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding

Tuo Zhang, Tiantian Feng, Yibin Ni, Mengqin Cao, Ruying Liu, Katharine Butler, Yanjun Weng, Mi Zhang, Shrikanth S Narayanan, Salman Avestimehr
arXiv preprint arXiv:2406.10318,  2024

Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?

Tiantian Feng, Dimitrios Dimitriadis, Shrikanth Narayanan
arXiv preprint arXiv:2406.08800,  2024

Exploring speech foundation models for speaker diarization in child-adult dyadic interactions

Anfeng Xu, Kevin Huang, Tiantian Feng, Lue Shen, Helen Tager-Flusberg, Shrikanth Narayanan
arXiv preprint arXiv:2406.07890,  2024

Toward fully-end-to-end listened speech decoding from EEG signals

Jihwan Lee, Aditya Kommineni, Tiantian Feng, Kleanthis Avramidis, Xuan Shi, Sudarsana Kadiri, Shrikanth Narayanan
arXiv preprint arXiv:2406.08644,  2024

Machine-learning-based prediction of client distress from session recordings

Patty B Kuo, Michael J Tanana, Simon B Goldberg, Derek D Caperton, Shrikanth Narayanan, David C Atkins, Zac E Imel
Clinical Psychological Science 12 (3), 435-446,  2024

TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality

Tiantian Feng, Xuan Shi, Rahul Gupta, Shrikanth S Narayanan
arXiv preprint arXiv:2404.17983,  2024

KULCQ: An Unsupervised Keyword-based Utterance Level Clustering Quality Metric

Pranav Guruprasad, Negar Mokhberian, Nikhil Varghese, Chandra Khatri, Amol Kelkar
arXiv preprint arXiv:2411.09853,  2024

Non-binary gender expression in online interactions

Rebecca Dorn, Negar Mokhberian, Julie Jiang, Jeremy Abramson, Fred Morstatter, Kristina Lerman
International Conference on Advances in Social Networks Analysis and Mining …,  2024

Retweets Amplify the Echo Chamber Effect

Ashwin Rao, Fred Morstatter, Kristina Lerman
ASONAM '23: Proceedings of the 2023 IEEE/ACM International Conference on …,  2024

Personalized Multimodal Large Language Models: A Survey

Junda Wu, Hanjia Lyu, Yu Xia, Zhehao Zhang, Joe Barrow, Ishita Kumar, Mehrnoosh Mirtaheri, Hongjie Chen, Ryan A Rossi, Franck Dernoncourt, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Namyong Park, Sungchul Kim, Huanrui Yang, Subrata Mitra, Zhengmian Hu, Nedim Lipka, Dang Nguyen, Yue Zhao, Jiebo Luo, Julian McAuley
arXiv preprint arXiv:2412.02142,  2024

Towards Automatic Evaluation of Task-Oriented Dialogue Flows

Mehrnoosh Mirtaheri, Nikhil Varghese, Chandra Khatri, Amol Kelkar
arXiv preprint arXiv:2411.10416,  2024

Tackling Long-Tail Entities for Temporal Knowledge Graph Completion

Mehrnoosh Mirtaheri, Ryan A Rossi, Sungchul Kim, Kanak Mahadik, Tong Yu, Xiang Chen, Mohammad Rostami
Companion Proceedings of the ACM on Web Conference 2024, 497-500,  2024

Artificial Intuition: Efficient Classification of Scientific Abstracts

Harsh Sakhrani, Naseela Pervez, Anirudh Ravi Kumar, Fred Morstatter, Alexandra Graddy Reed, Andrea Belz
arXiv preprint arXiv:2407.06093,  2024