Shrikanth Narayanan Publications | Information Sciences Institute

Shrikanth Narayanan

Publications

2026

VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMs

Hezhao Zhang, Huang-Cheng Chou, Shrikanth Narayanan, Thomas Hain

arXiv preprint arXiv:2603.08936, 2026

Accent Vector: Controllable Accent Manipulation for Multilingual TTS Without Accented Data

Thanathai Lertpetchpun, Thanapat Trachu, Jihwan Lee, Tiantian Feng, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2603.07534, 2026

Targeted Speaker Poisoning Framework in Zero-Shot Text-to-Speech

Thanapat Trachu, Thanathai Lertpetchpun, Sai Praneeth Karimireddy, Shrikanth Narayanan

arXiv preprint arXiv:2603.07551, 2026

Learning-free L2-Accented Speech Generation using Phonological Rules

Thanathai Lertpetchpun, Yoonjeong Lee, Jihwan Lee, Tiantian Feng, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2603.07550, 2026

Reconstruct! Don't Encode: Self-Supervised Representation Reconstruction Loss for High-Intelligibility and Low-Latency Streaming Neural Audio Codec

Junhyeok Lee, Xiluo He, Jihwan Lee, Helin Wang, Shrikanth Narayanan, Thomas Thebaud, Laureano Moro-Velazquez, Jesús Villalba, Najim Dehak

arXiv preprint arXiv:2603.05887, 2026

An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Production

Jihwan Lee, Parsa Razmara, Kevin Huang, Sean Foley, Aditya Kommineni, Haley Hsu, Woojae Jeong, Prakash Kumar, Xuan Shi, Yoonjeong Lee, Tiantian Feng, Takfarinas Medani, Ye Tian, Sudarsana Reddy Kadiri, Krishna S Nayak, Dani Byrd, Louis Goldstein, Richard M Leahy, Shrikanth Narayanan

arXiv preprint arXiv:2603.04840, 2026

Affect Decoding in Phonated and Silent Speech Production from Surface EMG

Simon Pistrosch, Kleanthis Avramidis, Tiantian Feng, Jihwan Lee, Monica Gonzalez-Machorro, Shrikanth Narayanan, Björn W Schuller

arXiv preprint arXiv:2603.11715, 2026

Speech Codec Probing from Semantic and Phonetic Perspectives

Xuan Shi, Chang Zeng, Tiantian Feng, Shih-Heng Wang, Jianbo Ma, Shrikanth Narayanan

arXiv preprint arXiv:2603.10371, 2026

VoxCare: Studying Natural Communication Behaviors of Hospital Caregivers through Wearable Sensing of Egocentric Audio

Tiantian Feng, Kleanthis Avramidis, Anfeng Xu, Deqi Wang, Brandon M Booth, Shrikanth Narayanan

arXiv preprint arXiv:2603.10888, 2026

Trade-offs Between Capacity and Robustness in Neural Audio Codecs for Adversarially Robust Speech Recognition

Jordan Prescott, Thanathai Lertpetchpun, Shrikanth Narayanan

arXiv preprint arXiv:2603.09034, 2026

Addressing Dysarthric Speech Variability with Severity-Aware Fine-Tuning of Transformer-Based Wav2vec2 ASR Models: P. Sapkota, HK Kathania, S. Narayanan, SR Kadiri

Paban Sapkota, Hemant Kumar Kathania, Shrikanth Narayanan, Sudarsana Reddy Kadiri

Circuits, Systems, and Signal Processing, 1-41, 2026

Validation of socialbit as a smartwatch algorithm for social interaction detection in a clinical population

Amar Dhand, Samuel Tate, Cade Mack, Sofia Carozza, David Farynyk, Mehdi Bourahla, Oluwamayomikun Adeboye, Grace Cooke, Olivia Berglund, Riya Dahima, Melinda Luo, Vrushali Dhongade, George S Usmanov, Kelly White, Amanda M Bernal, Ross Zafonte, Shrikanth Narayanan, Minwoo Lee, Matthias R Mehl, Min Shin

Scientific Reports 16 (1), 4529, 2026

Association of majority versus minority first language multilingualism and socioeconomic status with cognition among older adults residing in India

Iris M Strangmann, Pranali Khobragade, Emma Nichols, Erik Meijer, Sarah Petrosyan, Shrikanth Narayanan, Jinkook Lee, Miguel Arce Rentería

Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring 18 (1 …, 2026

voice2mode: Phonation Mode Classification in Singing using Self-Supervised Speech Models

Aju Ani Justus, Ruchit Agrawal, Sudarsana Reddy Kadiri, Shrikanth Narayanan

arXiv preprint arXiv:2602.13928, 2026

Tracing Moral Foundations in Large Language Models

Chenxiao Yu, Bowen Yi, Farzan Karimi-Malekabadi, Suhaib Abdurahman, Jinyi Ye, Shrikanth Narayanan, Yue Zhao, Morteza Dehghani

arXiv preprint arXiv:2601.05437, 2026

Effects of Emotional Spillover and Exposure to Interparental Psychological Aggression on Momentary Physiological Linkage during Naturalistic Couple Conflicts

KE Carta, GA Jumonville, JB Duong, SN Walters, AS Carrasco, DN Romero, IP Khurd, T Chaspari, SC Han, Y Kim, S Narayanan, G Margolin, AC Timmons

Biological Psychology, 109191, 2026

End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactions

Anfeng Xu, Tiantian Feng, Somer Bishop, Catherine Lord, Shrikanth Narayanan

arXiv preprint arXiv:2601.17640, 2026

Intelligence Requires Grounding But Not Embodiment

Marcus Ma, Shrikanth Narayanan

arXiv preprint arXiv:2601.17588, 2026

Generative Artificial Intelligence (AI)-enabled Saliency analysis of Eye Tracking in Cerebral/Cortical Visual Impairment (SET-CVI)

Kate Matsunaga, Kleanthis Avramidis, Mark S Borchert, Shrikanth Narayanan, Melinda Y Chang

Ophthalmology Science, 101081, 2026

Quantifying Speaker Embedding Phonological Rule Interactions in Accented Speech Synthesis

Thanathai Lertpetchpun, Yoonjeong Lee, Thanapat Trachu, Jihwan Lee, Tiantian Feng, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2601.14417, 2026

Encoding Emotion Through Self-Supervised Eye Movement Reconstruction

Marcus Ma, Jordan Prescott, Emily Zhou, Tiantian Feng, Kleanthis Avramidis, Gabor Mihaly Toth, Shrikanth Narayanan

arXiv preprint arXiv:2601.12534, 2026

VoxCog: Towards End-to-End Multilingual Cognitive Impairment Classification through Dialectal Knowledge

Tiantian Feng, Anfeng Xu, Jinkook Lee, Shrikanth Narayanan

arXiv preprint arXiv:2601.07999, 2026

2025

Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Models

Efthymios Tsaprazlis, Tiantian Feng, Anil Ramakrishna, Rahul Gupta, Shrikanth Narayanan

arXiv preprint arXiv:2509.23827, 2025

ARTI-6: Towards Six-dimensional Articulatory Speech Encoding

Jihwan Lee, Sean Foley, Thanathai Lertpetchpun, Kevin Huang, Yoonjeong Lee, Tiantian Feng, Louis Goldstein, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2509.21447, 2025

VoxGuard: Evaluating User and Attribute Privacy in Speech via Membership Inference Attacks

Efthymios Tsaprazlis, Thanathai Lertpetchpun, Tiantian Feng, Sai Praneeth Karimireddy, Shrikanth Narayanan

arXiv preprint arXiv:2509.18413, 2025

Interpretable Modeling of Articulatory Temporal Dynamics from real-time MRI for Phoneme Recognition

Jay Park, Hong Nguyen, Sean Foley, Jihwan Lee, Yoonjeong Lee, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2509.15689, 2025

A long-form single-speaker real-time MRI speech dataset and benchmark

Sean Foley, Jihwan Lee, Kevin Huang, Xuan Shi, Yoonjeong Lee, Louis Goldstein, Shrikanth Narayanan

arXiv preprint arXiv:2509.14479, 2025

Can speech foundation models effectively identify languages in low-resource multilingual aging populations?

Aditya Kommineni, Rajat Hebbar, Sarah Petrosyan, Pranali Khobragade, Sudarsana Kadiri, Miguel Arce Rentería, Jinkook Lee, Shrikanth Narayanan

JASA Express Letters 5 (9), 2025

Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globe

Tiantian Feng, Kevin Huang, Anfeng Xu, Xuan Shi, Thanathai Lertpetchpun, Jihwan Lee, Yoonjeong Lee, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2508.01691, 2025

Can Layer-wise SSL Features Improve Zero-Shot ASR Performance for Children's Speech?

Abhijit Sinha, Hemant Kumar Kathania, Sudarsana Reddy Kadiri, Shrikanth Narayanan

IEEE Signal Processing Letters, 2025

Layer-Wise Analysis of Self-Supervised Representations for Age and Gender Classification in Children's Speech

Abhijit Sinha, Harishankar Kumar, Mohit Joshi, Hemant Kumar Kathania, Shrikanth Narayanan, Sudarsana Reddy Kadiri

arXiv preprint arXiv:2508.10332, 2025

Effective Elicitation of Stuttering in Magnetic Resonance Imaging Data Collection Using a Suite of Connected Speech Tasks

Yijing Lu, Louis Goldstein, Dani Byrd, Shrikanth Narayanan

Journal of Speech, Language, and Hearing Research, 1-15, 2025

286 Assessing visual saliency in children with cerebral/cortical visual impairment (CVI) using generative AI and eye tracking

Kate Matsunaga, Kleanthis Avramidis, Shrikanth Narayanan, Mark Borchert, Melinda Chang

Journal of American Association for Pediatric Ophthalmology and Strabismus …, 2025

Decoding Neural Signatures of Semantic Evaluations in Depression and Suicidality

Woojae Jeong, Aditya Kommineni, Kleanthis Avramidis, Colin McDaniel, Donald Berry, Myzelle Hughes, Thomas McGee, Elsi Kaiser, Dani Byrd, Assal Habibi, B Rael Cahn, Idan A Blank, Kristina Lerman, Dimitrios Pantazis, Sudarsana R Kadiri, Takfarinas Medani, Shrikanth Narayanan, Richard M Leahy

arXiv preprint arXiv:2507.22313, 2025

Time-Resolved EEG Decoding of Semantic Processing Reveals Altered Neural Dynamics in Depression and Suicidality

arXiv preprint arXiv:2507.22313, 2025

On the Relationship between Accent Strength and Articulatory Features

Kevin Huang, Sean Foley, Jihwan Lee, Yoonjeong Lee, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2507.03149, 2025

Multilingual profiles and their association with cognition and brain structure among older Indian adults

Miguel Arce Renteria, Iris Strangmann, Yingxu Liu, Pranali Khobragade, Sarah Petrosyan, Niranjan Khandelwal, Joyita Banerjee, Emma Nichols, Erik Meijer, Shrikanth Narayanan, Kirsten M Lynch, Leon M Aksman, Jinkook Lee

Alzheimer's Association International Conference, 2025

Dampening versus amplification: Intrapersonal and interpersonal vocal affect dynamics during psychotherapy for depression

Adar Paz, Eshkol Rafaeli, Eran Bar-Kalifa, Eva Gilboa-Schectman, Sharon Gannot, Shrikanth Narayanan, Dana Atzil-Slonim

Psychotherapy Research, 1-14, 2025

Estimating Markers of Driving Stress through Multimodal Physiological Monitoring

Kleanthis Avramidis, Emily Zhou, Tiantian Feng, Hossein Hamidi Shishavan, Frederico Marcolino Quintao Severgnini, Danny J Lohan, Paul Schmalenberg, Ercan M Dede, Shrikanth Narayanan

arXiv preprint arXiv:2507.14146, 2025

Rhythm Features for Speaker Identification

Nick Mehlman, Thomas Thebaud, Dani Byrd, Shri Narayanan

arXiv preprint arXiv:2506.06834, 2025

Neural Responses to Affective Sentences Reveal Signatures of Depression

Aditya Kommineni, Woojae Jeong, Kleanthis Avramidis, Colin McDaniel, Myzelle Hughes, Thomas McGee, Elsi Kaiser, Kristina Lerman, Idan A Blank, Dani Byrd, Assal Habibi, B Rael Cahn, Sudarsana Kadiri, Takfarinas Medani, Richard M Leahy, Shrikanth Narayanan

arXiv preprint arXiv:2506.06244, 2025

LSM-2: Learning from Incomplete Wearable Sensor Data

Maxwell A Xu, Girish Narayanswamy, Kumar Ayush, Dimitris Spathis, Shun Liao, Shyam A Tailor, Ahmed Metwally, A Ali Heydari, Yuwei Zhang, Jake Garrison, Samy Abdel-Ghaffar, Xuhai Xu, Ken Gu, Jacob Sunshine, Ming-Zher Poh, Yun Liu, Tim Althoff, Shrikanth Narayanan, Pushmeet Kohli, Mark Malhotra, Shwetak Patel, Yuzhe Yang, James M Rehg, Xin Liu, Daniel McDuff

arXiv preprint arXiv:2506.05321, 2025

CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech

Helin Wang, Jiarui Hai, Dading Chong, Karan Thakkar, Tiantian Feng, Dongchao Yang, Junhyeok Lee, Laureano Moro Velazquez, Jesus Villalba, Zengyi Qin, Shrikanth Narayanan, Mounya Elhiali, Najim Dehak

arXiv preprint arXiv:2506.02863, 2025

How to Retrieve Examples in In-context Learning to Improve Conversational Emotion Recognition using Large Language Models?

Mengqi Wang, Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2506.20199, 2025

Developing a High-performance Framework for Speech Emotion Recognition in Naturalistic Conditions Challenge for Emotional Attribute Prediction

Thanathai Lertpetchpun, Tiantian Feng, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2506.10930, 2025

Joint ASR and Speaker Role Tagging with Serialized Output Training

Anfeng Xu, Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2506.10349, 2025

MOOSE: Pay Attention to Temporal Dynamics for Video Understanding via Optical Flows

Hong Nguyen, Dung Tran, Hieu Hoang, Phong Nguyen, Shrikanth Narayanan

arXiv preprint arXiv:2506.01119, 2025

The association between multilingualism and cognitive function among literate and illiterate older adults with low education in India

Iris M Strangmann, Emily Briceño, Sarah Petrosyan, Erik Meijer, Emma Nichols, Lindsay C Kobayashi, Shrikanth Narayanan, Jinkook Lee, Miguel Arce Rentería

Alzheimer's & Dementia: Behavior & Socioeconomics of Aging 1 (2), e70018, 2025

Towards disentangling the contributions of articulation and acoustics in multimodal phoneme recognition

Sean Foley, Hong Nguyen, Jihwan Lee, Sudarsana Reddy Kadiri, Dani Byrd, Louis Goldstein, Shrikanth Narayanan

arXiv preprint arXiv:2505.24059, 2025

Developing a Top-tier Framework in Naturalistic Conditions Challenge for Categorized Emotion Prediction: From Speech Foundation Models and Learning Objective to Data …

Tiantian Feng, Thanathai Lertpetchpun, Dani Byrd, Shrikanth Narayanan

arXiv preprint arXiv:2505.22133, 2025

Large Language Models based ASR Error Correction for Child Conversations

Anfeng Xu, Tiantian Feng, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan

arXiv preprint arXiv:2505.16212, 2025

Articulatory Feature Prediction from Surface EMG during Speech Production

Jihwan Lee, Kevin Huang, Kleanthis Avramidis, Simon Pistrosch, Monica Gonzalez-Machorro, Yoonjeong Lee, Björn Schuller, Louis Goldstein, Shrikanth Narayanan

arXiv preprint arXiv:2505.13814, 2025

Vox-Profile: A Speech Foundation Model Benchmark for Characterizing Diverse Speaker and Speech Traits

Tiantian Feng, Jihwan Lee, Anfeng Xu, Yoonjeong Lee, Thanathai Lertpetchpun, Xuan Shi, Helin Wang, Thomas Thebaud, Laureano Moro-Velazquez, Dani Byrd, Najim Dehak, Shrikanth Narayanan

arXiv preprint arXiv:2505.14648, 2025

Who Said What WSW 2.0? Enhanced Automated Analysis of Preschool Classroom Speech

Anchen Sun, Tiantian Feng, Gabriela Gutierrez, Juan J Londono, Anfeng Xu, Batya Elbaum, Shrikanth Narayanan, Lynn K Perry, Daniel S Messinger

arXiv preprint arXiv:2505.09972, 2025

Wavelet Scattering Network Features for Intensity Category Classification and Prediction of SPL from Speech

Manila Kodali, Sudarsana Reddy Kadiri, Shrikanth Narayanan, Paavo Alku

IEEE International Conference on Acoustics, Speech, and Signal Processing, 2025

2024

Speech2rtMRI: Speech-Guided Diffusion Model for Real-time MRI Video of the Vocal Tract during Speech

Hong Nguyen, Sean Foley, Kevin Huang, Xuan Shi, Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2409.15525, 2024

2025

Conversational Latency in Autistic Children With Heterogeneous Spoken Language Abilities

Lue Shen, Anfeng Xu, Lindsay K Butler, Karen Chenausky, Marc Maffei, Shrikanth Narayanan, Helen Tager-Flusberg

Journal of Speech, Language, and Hearing Research, 1-13, 2025

Adversarial Robustness of Self-Supervised Learning Features

Nick Mehlman, Shri Narayanan

IEEE Open Journal of Signal Processing, 2025

ModalityMirror: Enhancing Audio Classification in Modality Heterogeneity Federated Learning via Multimodal Distillation

Tiantian Feng, Tuo Zhang, Salman Avestimehr, Shrikanth Narayanan

Proceedings of the 35th Workshop on Network and Operating System Support for …, 2025

The association of multilingualism with diverse language families and cognition among adults with and without education in India

Sarah Petrosyan, Iris M Strangmann, Emma Nichols, Erik Meijer, Emily M Briceño, Shrikanth Narayanan, Jinkook Lee, Miguel Arce Rentería

Neuropsychology 39 (3), 223-234, 2025

Association of Machine Learning Rated Supportive Counseling Skills with Psychotherapy Outcome

Xinyao Zhang, Simon B Goldberg, Scott A Baldwin, Michael J Tanana, Lauren M Weitzman, Shrikanth S Narayanan, David C Atkins, Zac E Imel

Journal of Consulting and Clinical Psychology 93 (2), 2025

Speech acoustics to rt-MRI articulatory dynamics inversion with video diffusion model

Xuan Shi, Tiantian Feng, Jay Park, Christina Hagedorn, Louis Goldstein, Shrikanth Narayanan

Computer Speech & Language, 101928, 2025

Caregiver perceptions of healthcare barriers across traditional and digital contexts: a mixed-methods analysis

Jacqueline B Duong, Sierra N Walters, Kayla E Carta, Grace A Jumonville, Alyssa S Carrasco, Natalia Simo Fiallo, Daniela N Romero, Ishita P Khurd, Matthew W Ahle, Jonathan S Comer, Stacy L Frazier, Theodora Chaspari, Shrikanth Narayanan, Adela C Timmons

npj Digital Medicine, 2025

Informed Bootstrap Augmentation Improves EEG Decoding

Woojae Jeong, Wenhui Cui, Kleanthis Avramidis, Takfarinas Medani, Shrikanth Narayanan, Richard Leahy

arXiv preprint arXiv:2511.12073, 2025

Do all features matter? Layer-wise feature probing of self-supervised speech models for dysarthria severity classification

Paban Sapkota, Harsh Srivastava, Hemant Kumar Kathania, Shrikanth Narayanan, Sudarsana Reddy Kadiri

Speech Communication, 103326, 2025

The Developmental Assessment of Social Communication Ability (DASCA): initial creation and psychometric description

Aaron J Kaat, Audrey Thurm, Cristan Farmer, Shuting Zheng, Sheila Ghods, Stelios Georgiades, Stephen Kanne, Shrikanth Narayanan, Somer L Bishop

Molecular Autism 16 (1), 52, 2025

Neural Codecs as Biosignal Tokenizers

Kleanthis Avramidis, Tiantian Feng, Woojae Jeong, Jihwan Lee, Wenhui Cui, Richard M Leahy, Shrikanth Narayanan

arXiv preprint arXiv:2510.09095, 2025

A Point Process Model of Skin Conductance Responses in a Stroop Task for Predicting Depression and Suicidal Ideation

Kleanthis Avramidis, Myzelle Hughes, Idan A Blank, Dani Byrd, Assal Habibi, Takfarinas Medani, Richard M Leahy, Shrikanth Narayanan

arXiv preprint arXiv:2510.00422, 2025

Enhancing Listened Speech Decoding from EEG via Parallel Phoneme Sequence Prediction

Jihwan Lee, Tiantian Feng, Aditya Kommineni, Sudarsana Reddy Kadiri, Shrikanth Narayanan

arXiv preprint arXiv:2501.04844, 2025

Method for assessing visual saliency in children with cerebral/cortical visual impairment using generative artificial intelligence

Kate Matsunaga, Kleanthis Avramidis, Mark S Borchert, Shrikanth Narayanan, Melinda Y Chang

Frontiers in Human Neuroscience 18, 1506286, 2025

Formant Tracking by Combining Deep Neural Network and Linear Prediction

Sudarsana Reddy Kadiri, Kevin Huang, Christina Hagedorn, Dani Byrd, Paavo Alku, Shrikanth Narayanan

IEEE Open Journal of Signal Processing, 2025

Automatic classification of vocal intensity categories from amplitude-normalized speech signals by comparing acoustic features and classifier models

Manila Kodali, Luna Ansari, Sudarsana Kadiri, Shrikanth Narayanan, Paavo Alku

Speech Communication, 2025

Can Multimodal Foundation Models Help Analyze Child-Inclusive Autism Diagnostic Videos?

Aditya Kommineni, Digbalay Bose, Tiantian Feng, So Hyun Kim, Helen Tager-Flusberg, Somer Bishop, Catherine Lord, Sudarsana Kadiri, Shrikanth Narayanan

Proc. Interspeech 2025, 3050-3054, 2025

75-Speaker Annot-16: A benchmark dataset for speech articulatory rt-MRI annotation with articulator contours and phonetic alignment

Xuan Shi, Yubin Zhang, Yijing Lu, Marcus Ma, Tiantian Feng, Asterios Toutios, Haley Hsu, Louis Goldstein, Shrikanth Narayanan

Proc. Interspeech 2025, 2175-2179, 2025

Co-registration of real-time MRI and respiration for speech research

Yubin Zhang, Prakash Kumar, Ye Tian, Ziwei Zhao, Xuan Shi, Kevin Huang, Kevin Lee, Haley Hsu, Shrikanth Narayanan, Krishna Nayak, Louis Goldstein

Proc. Interspeech 2025, 983-987, 2025

Examining Test-Time Adaptation for Personalized Child Speech Recognition

Zhonghao Shi, Xuan Shi, Anfeng Xu, Tiantian Feng, Harshvardhan Srivastava, Shrikanth Narayanan, Maja Mataric

Proc. Interspeech 2025, 2820-2824, 2025

The machine learning-based prediction of the sound pressure level from pathological and healthy speech signal

Manila Kodali, Sudarsana Kadiri, Shrikanth Narayanan, Paavo Alku

Journal of the Acoustical Society of America, 2025

Evaluation of Speech Foundation Models for ASR on Child-Adult Conversations in Autism Diagnostic Sessions

Aditya Asvin, Rimita Lahiri, Aditya Kommineni, Somer Bishop, Catherine Lord, Sudarsana Kadiri, Shrikanth Narayanan

Proc. WOCCI 2025, 31-35, 2025

PRECOG: Comprehensive Experimental Design and Stimuli Protocol for Investigating Depression and Suicidal Ideation

Myzelle Hughes, Colin McDaniel, Takfarinas Medani, Woojae Jeong, Idan Blank, Dani Byrd, Thomas McGee, Kleanthis Avramidis, Sudarsana Kadiri, Chinmay Chinara, Kristina Lerman, Elsi Kaiser, Richard Leahy, Shrikanth Narayanan, B Cahn

OSF, 2025

PPX-Anon: Prosody, Pitch and X-Vectors for De-Anonymization; our submission to the Voice Attacker Challenge 2024

Thomas Thebaud, Nicholas Mehlman, Yaohan Guan, Laureano Moro-Velazquez, Jesus Villalba Lopez, Shrikanth Narayanan, Najim Dehak

Proc. SPSC 2025, 61-67, 2025

2024

Evaluation of state-of-the-art ASR Models in Child-Adult Interactions

Aditya Ashvin, Rimita Lahiri, Aditya Kommineni, Somer Bishop, Catherine Lord, Sudarsana Reddy Kadiri, Shrikanth Narayanan

arXiv preprint arXiv:2409.16135, 2024

Towards child-inclusive clinical video understanding for autism spectrum disorder

Aditya Kommineni, Digbalay Bose, Tiantian Feng, So Hyun Kim, Helen Tager-Flusberg, Somer Bishop, Catherine Lord, Sudarsana Kadiri, Shrikanth Narayanan

arXiv preprint arXiv:2409.13606, 2024

Personalized Speech Recognition for Children with Test-Time Adaptation

Zhonghao Shi, Harshvardhan Srivastava, Xuan Shi, Shrikanth Narayanan, Maja J Matarić

arXiv preprint arXiv:2409.13095, 2024

Emotion-aware speech popularity prediction: a use-case on TED talks

Dimitrios Sgouropoulos, Petros Mitseas, Sofia Eleftheriou, Theodoros Giannakopoulos, Antonia Petrogianni, Lefteris Kapelonis, Nikolaos Antoniou, Athanasios Katsamanis, Shrikanth Narayanan

2024 12th International Conference on Affective Computing and Intelligent …, 2024

ROBUSER: A robustness benchmark for Speech Emotion Recognition

Antonia Petrogianni, Lefteris Kapelonis, Nikolaos Antoniou, Sofia Eleftheriou, Petros Mitseas, Dimitris Sgouropoulos, Athanasios Katsamanis, Theodoros Giannakopoulos, Shrikanth Narayanan

2024 12th International Conference on Affective Computing and Intelligent …, 2024

Egocentric Speaker Classification in Child-Adult Dyadic Interactions: From Sensing to Computational Modeling

Tiantian Feng, Anfeng Xu, Xuan Shi, Somer Bishop, Shrikanth Narayanan

arXiv preprint arXiv:2409.09340, 2024

Data efficient child-adult speaker diarization with simulated conversations

Anfeng Xu, Tiantian Feng, Helen Tager-Flusberg, Catherine Lord, Shrikanth Narayanan

arXiv preprint arXiv:2409.08881, 2024

ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation

Tiantian Feng, Tuo Zhang, Salman Avestimehr, Shrikanth S Narayanan

arXiv preprint arXiv:2408.15803, 2024

Multimodal analysis of temporal affective variability within treatment for depression.

Adar Paz, Eshkol Rafaeli, Eran Bar-Kalifa, Eva Gilboa-Schechtman, Sharon Gannot, Shrikanth S Narayanan, Dana Atzil-Slonim

2024

Early detection of coffee leaf rust through convolutional neural networks trained on low-resolution images

Angelly Cabrera, Kleanthis Avramidis, Shrikanth Narayanan

arXiv preprint arXiv:2407.14737, 2024

Knowledge-guided eeg representation learning

Aditya Kommineni, Kleanthis Avramidis, Richard Leahy, Shrikanth Narayanan

arXiv preprint arXiv:2403.03222, 2024

Evaluating atypical gaze patterns through vision models: the case of cortical visual impairment

Kleanthis Avramidis, Melinda Y Chang, Rahul Sharma, Mark S Borchert, Shrikanth Narayanan

arXiv preprint arXiv:2402.09655, 2024

Understanding Stress, Burnout, and Behavioral Patterns in Medical Residents Using Large-scale Longitudinal Wearable Recordings

Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2402.09028, 2024

Artificial intelligence to differentiate pediatric pseudopapilledema and true papilledema on fundus photographs

Melinda Y Chang, Gena Heidary, Shannon Beres, Stacy L Pineles, Eric D Gaier, Ryan Gise, Mark Reid, Kleanthis Avramidis, Mohammad Rostami, Shrikanth Narayanan, Pediatric Optic Nerve Investigator Group

Ophthalmology Science 4 (4), 100496, 2024

Scaling representation learning from ubiquitous ecg with state-space models

Kleanthis Avramidis, Dominika Kunc, Bartosz Perz, Kranti Adsul, Tiantian Feng, Przemysław Kazienko, Stanisław Saganowski, Shrikanth Narayanan

IEEE Journal of Biomedical and Health Informatics, 2024

Unique affective profile of music-evoked nostalgia: An extension and conceptual replication of Barrett et al.’s (2010) study.

Sarah Hennessy, Timothy Greer, Shrikanth Narayanan, Assal Habibi

Emotion, 2024

Saliency analysis of eye tracking in children with cortical/cerebral visual impairment (CVI) enabled by machine learning

Melinda Chang, Kleanthis Avramidis, Rahul Sharma, Mark Borchert, Shrikanth Narayanan

Investigative Ophthalmology & Visual Science 65 (7), 1501-1501, 2024

Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding

Tuo Zhang, Tiantian Feng, Yibin Ni, Mengqin Cao, Ruying Liu, Katharine Butler, Yanjun Weng, Mi Zhang, Shrikanth S Narayanan, Salman Avestimehr

arXiv preprint arXiv:2406.10318, 2024

Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?

Tiantian Feng, Dimitrios Dimitriadis, Shrikanth Narayanan

arXiv preprint arXiv:2406.08800, 2024

Exploring speech foundation models for speaker diarization in child-adult dyadic interactions

Anfeng Xu, Kevin Huang, Tiantian Feng, Lue Shen, Helen Tager-Flusberg, Shrikanth Narayanan

arXiv preprint arXiv:2406.07890, 2024

Toward fully-end-to-end listened speech decoding from EEG signals

Jihwan Lee, Aditya Kommineni, Tiantian Feng, Kleanthis Avramidis, Xuan Shi, Sudarsana Kadiri, Shrikanth Narayanan

arXiv preprint arXiv:2406.08644, 2024

Machine-learning-based prediction of client distress from session recordings

Patty B Kuo, Michael J Tanana, Simon B Goldberg, Derek D Caperton, Shrikanth Narayanan, David C Atkins, Zac E Imel

Clinical Psychological Science 12 (3), 435-446, 2024

TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality

Tiantian Feng, Xuan Shi, Rahul Gupta, Shrikanth S Narayanan

arXiv preprint arXiv:2404.17983, 2024

Character attribute extraction from movie scripts using llms

Sabyasachee Baruah, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

Audio-visual child-adult speaker classification in dyadic interactions

Anfeng Xu, Kevin Huang, Tiantian Feng, Helen Tager-Flusberg, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

Does Video Summarization Require Videos? Quantifying the Effectiveness of Language in Video Summarization

Yoonsoo Nam, Adam Lehavi, Daniel Yang, Digbalay Bose, Swabha Swayamdipta, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

Foundation model assisted automatic speech emotion recognition: Transcribing, annotating, and augmenting

Tiantian Feng, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

Emotion-aligned contrastive learning between images and music

Shanti Stewart, Kleanthis Avramidis, Tiantian Feng, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

Trust-ser: On the trustworthiness of fine-tuning pre-trained speech embeddings for speech emotion recognition

Tiantian Feng, Rajat Hebbar, Shrikanth Narayanan

ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and …, 2024

The strong pull of prior knowledge in large language models and its impact on emotion recognition

Georgios Chochlakis, Alexandros Potamianos, Kristina Lerman, Shrikanth Narayanan

arXiv preprint arXiv:2403.17125, 2024

The NeurIPS 2023 Machine Learning for Audio Workshop: Affective Audio Benchmarks and Novel Data

Alice Baird, Rachel Manzelli, Panagiotis Tzirakis, Chris Gagne, Haoqi Li, Sadie Allen, Sander Dieleman, Brian Kulis, Shrikanth S Narayanan, Alan Cowen

arXiv preprint arXiv:2403.14048, 2024

Abstract TP14: SocialBit: A Novel Smartwatch Sensor to Detect Social Interaction Frequency in Stroke Survivors

Oluwamayomikun Adeboye, Grace Cooke, Kelly White, Samuel Tate, Ross Zafonte, Shrikanth Narayanan, Matthias Mehl, Min Shin, Amar Dhand

Stroke 55 (Suppl_1), ATP14-ATP14, 2024

Biased Bots: An Empirical Demonstration of How AI Bias Could Compromise Mental Healthcare

Adela Timmons, Kexin Feng, Kayla Carta, Sierra Walters, Grace Jumonville, Alyssa Carrasco, Gabrielle Freitag, Daniela Romero, Gayla Margolin, Shrikanth Narayanan, Jonathan Comer, Matthew Ahle

OSF, 2024

Developing Personalized Algorithms for Sensing Mental Health Symptoms in Daily Life

Adela Timmons, Abdullah Aman Tutul, Kleanthis Avramidis, Kayla Carta, Sierra Walters, Grace Jumonville, Alyssa Carrasco, Gabrielle Freitag, Daniela Romero, Matthew Ahle, Jonathan Comer, Shrikanth Narayanan

OSF, 2024

Association of Majority versus Minority First Language Multilingualism and Socioeconomic Status on Cognition among Older Indian Adults

Iris M Strangmann, Justina F Avila, Sarah Petrosyan, Erik Meijer, Emma Nichols, Shrikanth Narayanan, Leon M Aksman, Jinkook Lee, Miguel Arce Rentería

Alzheimer's & Dementia 20, e090676, 2024

People make mistakes: Obtaining accurate ground truth from continuous annotations of subjective constructs

Brandon M Booth, Shrikanth S Narayanan

Behavior Research Methods 56 (8), 8784-8800, 2024

Can text-to-image model assist multi-modal learning for visual recognition with visual modality missing?

Tiantian Feng, Daniel Yang, Digbalay Bose, Shrikanth Narayanan

Proceedings of the 26th International Conference on Multimodal Interaction …, 2024

Can Generic LLMs Help Analyze Child-Adult Interactions Involving Children with Autism in Clinical Observation?

Tiantian Feng, Anfeng Xu, Rimita Lahiri, Helen Tager-Flusberg, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan

arXiv preprint arXiv:2411.10761, 2024

Direct articulatory observation reveals phoneme recognition performance characteristics of a self-supervised speech model

Xuan Shi, Tiantian Feng, Kevin Huang, Sudarsana Reddy Kadiri, Jihwan Lee, Yijing Lu, Yubin Zhang, Louis Goldstein, Shrikanth Narayanan

JASA Express Letters 4 (11), 2024

Systematic Study of Dysarthric Speech Recognition: Spectral Features and Acoustic Models

Paban Sapkota, Hemant Kumar Kathania, Mikko Kurimo, Sudarsana Reddy Kadiri, Shrikanth Narayanan

2024 58th Asilomar Conference on Signals, Systems, and Computers, 303-307, 2024

Improving end-to-end speech recognition for dysarthric speech through in-domain data augmentation

Paban Sapkota, Hemant Kumar Kathania, Sudarsana Reddy Kadiri, Shrikanth Narayanan

2024 58th Asilomar Conference on Signals, Systems, and Computers, 345-349, 2024

Can a Machine Distinguish High and Low Amount of Social Creak in Speech?

Anne-Maria Laukkanen, Sudarsana Reddy Kadiri, Shrikanth Narayanan, Paavo Alku

Journal of Voice, 2024

Scaling wearable foundation models

Girish Narayanswamy, Xin Liu, Kumar Ayush, Yuzhe Yang, Xuhai Xu, Shun Liao, Jake Garrison, Shyam Tailor, Jake Sunshine, Yun Liu, Tim Althoff, Shrikanth Narayanan, Pushmeet Kohli, Jiening Zhan, Mark Malhotra, Shwetak Patel, Samy Abdel-Ghaffar, Daniel McDuff

arXiv preprint arXiv:2410.13638, 2024

Towards large-scale cross-speaker articulatory modeling of vowels

Sean Foley, Shrikanth Narayanan

The Journal of the Acoustical Society of America 156 (4_Supplement), A49-A49, 2024

A multi-perspective machine learning approach to evaluate police-driver interaction in Los Angeles

Benjamin AT Grahama, Lauren Brown, Georgios Chochlakis, Morteza Dehghani, Raquel Delerme, Brittany Friedman, Ellie Graeden, Preni Golazizian, Rajat Hebbar, Parsa Hejabi, Aditya Kommineni, Mayagüez Salinas, Michael Sierra-Arévalo, Jackson Trager, Nicholas Weller, Shrikanth Narayanan

arXiv preprint arXiv:2402.01703, 2024

Deep hierarchical fusion for machine intelligence applications

E Georgiou, G Paraskevopoulos, J Gibson, A Potamianos, S Narayanan

US Patent 11,862,145, 2024

The SHADOW Team Submission to the ASVSpoof 2024 Challenge

Jesús Villalba, Tiantian Feng, Thomas Thebaud, Jihwan Lee, Shrikanth Narayanan, Najim Dehak

Proc. ASVspoof 2024, 36-42, 2024

State-of-the-art speech production MRI protocol for new 0.55 Tesla scanners

Prakash Kumar, Ye Tian, Yongwan Lim, Sophia X Cui, Christina Hagedorn, Dani Byrd, Uttam K Sinha, Shrikanth Narayanan, Krishna S Nayak

Proc. Interspeech 2024, 2590-2594, 2024

Analysis of articulatory setting for L1 and L2 English speakers using MRI data

Kevin Huang, Jack Goldberg, Louis Goldstein, Shrikanth Narayanan

Korea 7, 789, 2024

ConPro: Learning Severity Representation for Medical Images using Contrastive Learning and Preference Optimization

Hong Nguyen, Hoang Nguyen, Melinda Chang, Hieu Pham, Shrikanth Narayanan, Michael Pazzani

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024

2023

Fedaiot: A federated learning benchmark for artificial intelligence of things

Samiul Alam, Tuo Zhang, Tiantian Feng, Hui Shen, Zhichao Cao, Dong Zhao, JeongGil Ko, Kiran Somasundaram, Shrikanth S Narayanan, Salman Avestimehr, Mi Zhang

arXiv preprint arXiv:2310.00109, 2023

Context unlocks emotions: Text-based emotion classification dataset auditing with large language models

Daniel Yang, Aditya Kommineni, Mohammad Alshehri, Nilamadhab Mohanty, Vedant Modi, Jonathan Gratch, Shrikanth Narayanan

2023 11th International Conference on Affective Computing and Intelligent …, 2023

Peft-ser: On the use of parameter efficient transfer learning approaches for speech emotion recognition using pre-trained speech models

Tiantian Feng, Shrikanth Narayanan

2023 11th International Conference on Affective Computing and Intelligent …, 2023

Fedmultimodal: A benchmark for multimodal federated learning

Tiantian Feng, Digbalay Bose, Tuo Zhang, Rajat Hebbar, Anil Ramakrishna, Rahul Gupta, Mi Zhang, Salman Avestimehr, Shrikanth Narayanan

Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and …, 2023

SocialBit: protocol for a prospective observational study to validate a wearable social sensor for stroke survivors with diverse neurological abilities

Kelly White, Samuel Tate, Ross Zafonte, Shrikanth Narayanan, Matthias R Mehl, Min Shin, Amar Dhand

BMJ open 13 (8), e076297, 2023

A machine-learning algorithm for the automated perceptual evaluation of dysphonia severity

Benjamin van der Woerd, Zhuohao Chen, Nikolaos Flemotomos, Maria Oljaca, Lauren Timmons Sund, Shrikanth Narayanan, Michael M Johns

Journal of Voice, 2023

Robust self supervised speech embeddings for child-adult classification in interactions involving children with autism

Rimita Lahiri, Tiantian Feng, Rajat Hebbar, Catherine Lord, So Hyun Kim, Shrikanth Narayanan

arXiv preprint arXiv:2307.16398, 2023

Creating musical features using multi-faceted, multi-task encoders based on transformers

Timothy Greer, Xuan Shi, Benjamin Ma, Shrikanth Narayanan

Scientific Reports 13 (1), 10713, 2023

Multimodal neuroimaging data from a 5-week heart rate variability biofeedback randomized clinical trial

Hyun Joo Yoo, Kaoru Nashiro, Jungwon Min, Christine Cho, Noah Mercer, Shelby L Bachman, Padideh Nasseri, Shubir Dutt, Shai Porat, Paul Choi, Yong Zhang, Vardui Grigoryan, Tiantian Feng, Julian F Thayer, Paul Lehrer, Catie Chang, Jeffrey A Stanley, Elizabeth Head, Jeremy Rouanet, Vasilis Z Marmarelis, Shrikanth Narayanan, Jessica Wisnowski, Daniel A Nation, Mara Mather

Scientific Data 10 (1), 503, 2023

Wearable and mobile technologies for the evaluation and treatment of obsessive-compulsive disorder: scoping review

Adam C Frank, Ruibei Li, Bradley S Peterson, Shrikanth S Narayanan

JMIR Mental Health 10, e45572, 2023

Learning Behavioral Representations of Routines From Large-scale Unlabeled Wearable Time-series Data Streams using Hawkes Point Process

Tiantian Feng, Brandon M Booth, Shrikanth Narayanan

arXiv preprint arXiv:2307.04445, 2023

A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Cady Berkel, Dillon C Knox, Nikolaos Flemotomos, Victor R Martinez, David C Atkins, Shrikanth S Narayanan, Lizeth Alonso Rodriguez, Carlos G Gallo, Justin D Smith

Implementation Research and Practice 4, 26334895231187906, 2023

Character coreference resolution in movie screenplays

Sabyasachee Baruah, Shrikanth Narayanan

Findings of the Association for Computational Linguistics: ACL 2023, 10300-10313, 2023

Modeling inter-individual differences in ambulatory-based multimodal signals via metric learning: a case study of personalized well-being estimation of healthcare workers

Projna Paromita, Karel Mundnich, Amrutha Nadarajan, Brandon M Booth, Shrikanth S Narayanan, Theodora Chaspari

Frontiers in Digital Health 5, 1195795, 2023

Navigating and Reaching Therapeutic Goals with Dynamical Systems in Conversation-Based Interventions

Victor Ardulov, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Signal processing grand challenge 2023–e-prevention: Sleep behavior as an indicator of relapses in psychotic patients

Kleanthis Avramidis, Kranti Adsul, Digbalay Bose, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

On the role of visual context in enriching music representations

Kleanthis Avramidis, Shanti Stewart, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Toward Privacy-Enhancing Ambulatory-Based Well-Being Monitoring: Investigating User Re-Identification Risk in Multimodal Data

Ravi Pranjal, Ranjana Seshadri, Rakesh Kumar Sanath Kumar Kadaba, Tiantian Feng, Shrikanth S Narayanan, Theodora Chaspari

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Designing and evaluating speech emotion recognition systems: A reality check case study with iemocap

Nikolaos Antoniou, Athanasios Katsamanis, Theodoros Giannakopoulos, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Contextually-rich human affect perception using multimodal scene information

Digbalay Bose, Rajat Hebbar, Krishna Somandepalli, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

A dataset for audio-visual sound event detection in movies

Rajat Hebbar, Digbalay Bose, Krishna Somandepalli, Veena Vijai, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Can Knowledge of End-to-End Text-to-Speech Models Improve Neural Midi-to-Audio Synthesis Systems?

Xuan Shi, Erica Cooper, Xin Wang, Junichi Yamagishi, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

A context-aware computational approach for measuring vocal entrainment in dyadic conversations

Rimita Lahiri, Md Nasir, Catherine Lord, So Hyun Kim, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Using emotion embeddings to transfer knowledge between emotions, languages, and annotation formats

Georgios Chochlakis, Gireesh Mahajan, Sabyasachee Baruah, Keith Burghardt, Kristina Lerman, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Leveraging label correlations in a multi-label setting: A case study in emotion

Georgios Chochlakis, Gireesh Mahajan, Sabyasachee Baruah, Keith Burghardt, Kristina Lerman, Shrikanth Narayanan

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Fedaudio: A federated learning benchmark for audio tasks

Tuo Zhang, Tiantian Feng, Samiul Alam, Sunwoo Lee, Mi Zhang, Shrikanth S Narayanan, Salman Avestimehr

ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and …, 2023

Gpt-fl: Generative pre-trained model-assisted federated learning

Tuo Zhang, Tiantian Feng, Samiul Alam, Dimitrios Dimitriadis, Sunwoo Lee, Mi Zhang, Shrikanth S Narayanan, Salman Avestimehr

arXiv preprint arXiv:2306.02210, 2023

Tensor embedding: A supervised framework for human behavioral data mining and prediction

Homa Hosseinmardi, Amir Ghasemian, Kristina Lerman, Shrikanth Narayanan, Emilio Ferrara

2023 IEEE 11th International Conference on Healthcare Informatics (ICHI), 91-100, 2023

An engineering view on emotions and speech: From analysis and predictive models to responsible human-centered applications

Chi-Chun Lee, Theodora Chaspari, Emily Mower Provost, Shrikanth S Narayanan

Proceedings of the IEEE 111 (10), 1142-1158, 2023

Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content

Tiantian Feng, Digbalay Bose, Xuan Shi, Shrikanth Narayanan

arXiv preprint arXiv:2306.07791, 2023

You never know what you are going to get: Large-scale assessment of therapists’ supportive counseling skill use.

Xinyao Zhang, Michael Tanana, Lauren Weitzman, Shrikanth Narayanan, David Atkins, Zac Imel

Psychotherapy 60 (2), 149, 2023

The silent treatment? Changes in patient emotional expression after silence

Christina S Soma, Bruce E Wampold, Nikolaos Flemotomos, Raghuveer Peri, Shrikanth Narayanan, David C Atkins, Zac E Imel

Counselling and psychotherapy research 23 (2), 378-388, 2023

Understanding spoken language development of children with asd using pre-trained speech embeddings

Anfeng Xu, Rajat Hebbar, Rimita Lahiri, Tiantian Feng, Lindsay Butler, Lue Shen, Helen Tager-Flusberg, Shrikanth Narayanan

arXiv preprint arXiv:2305.14117, 2023

RI Core: Medium: Structured variability in vocal tract articulation dynamics in speech

Shrikanth S Narayanan

NSF Award Number 2311676. Directorate for Computer and Information Science …, 2023

Audio-visual activity guided cross-modal identity association for active speaker detection

Rahul Sharma, Shrikanth Narayanan

IEEE Open Journal of Signal Processing 4, 225-232, 2023

A study of bias mitigation strategies for speaker recognition

Raghuveer Peri, Krishna Somandepalli, Shrikanth Narayanan

Computer Speech & Language 79, 101481, 2023

Multimodal Machine Intelligence for Mental Health

Shrikanth Narayanan

2023 Annual Meeting, 2023

Mel frequency spectral domain defenses against adversarial attacks on speech recognition systems

Nicholas Mehlman, Anirudh Sreeram, Raghuveer Peri, Shrikanth Narayanan

JASA Express Letters 3 (3), 2023

It’s not what you said, it’s how you said it: An analysis of therapist vocal features during psychotherapy

Christina S Soma, Dillon Knox, Timothy Greer, Keith Gunnerson, Alexander Young, Shrikanth Narayanan

Counselling and psychotherapy research 23 (1), 258-269, 2023

Ten questions concerning the impact of environmental stress on office workers

Mohamad Awada, Burcin Becerik-Gerber, Ruying Liu, Mirmahdi Seyedrezaei, Zheng Lu, Matheos Xenakis, Gale Lucas, Shawn C Roll, Shrikanth Narayanan

Building and Environment 229, 109964, 2023

Increasing coordination and responsivity of emotion-related brain regions with a heart rate variability biofeedback randomized trial

Kaoru Nashiro, Jungwon Min, Hyun Joo Yoo, Christine Cho, Shelby L Bachman, Shubir Dutt, Julian F Thayer, Paul M Lehrer, Tiantian Feng, Noah Mercer, Padideh Nasseri, Diana Wang, Catie Chang, Vasilis Z Marmarelis, Shri Narayanan, Daniel A Nation, Mara Mather

Cognitive, Affective, & Behavioral Neuroscience 23 (1), 66-83, 2023

Explainable Severity ranking via pairwise n-hidden comparison: a case study of glaucoma

Hong Nguyen, Cuong V Nguyen, Shrikanth Narayanan, Benjamin Y Xu, Michael Pazzani

arXiv preprint arXiv:2312.02541, 2023

Domain adaptation for sentiment analysis using robust internal representations

Mohammad Rostami, Digbalay Bose, Shrikanth Narayanan, Aram Galstyan

Findings of the Association for Computational Linguistics: EMNLP 2023, 11484 …, 2023

Clinical note section classification on doctor-patient conversations in low-resourced settings

Zhuohao Chen, Jangwon Kim, Yang Liu, Shrikanth Narayanan

Proceedings of the Third Workshop on NLP for Medical Conversations, 1-12, 2023

Behavioral Audio Signal Processing in Mobile Sensing Research

Rajat Hebbar, Arindam Jati, Tiantian Feng, Ramon Reyes, Alexander F Danvers, Matthias R Mehl, Shrikanth S Narayanan

Mobile Sensing in Psychology: Methods and Applications, 258, 2023

Linguistic analysis of differences in portrayal of movie characters

S Narayanan, VM Palacios, A Ramakrishna, K Somandepalli, ...

US Patent 11,775,765, 2023

SEAR: Semantically-grounded Audio Representations

Rajat Hebbar, Digbalay Bose, Shrikanth Narayanan

Proceedings of the 31st ACM International Conference on Multimedia, 2785-2794, 2023

MM-AU: Towards multimodal understanding of advertisement videos

Digbalay Bose, Rajat Hebbar, Tiantian Feng, Krishna Somandepalli, Anfeng Xu, Shrikanth Narayanan

Proceedings of the 31st ACM International Conference on Multimedia, 86-95, 2023

Intra-Operative Radiotherapy (IORT) in Breast Conserving Therapy in Early-Stage Breast Cancer and DCIS

A Suen, HT Pham, K Suen, S Narayanan, G Song, AB Post, P Mitsuyama, D Wechter, Q Le, J Grumley, N Robinson, M O'Malley, J Lavigne, L Stevens, V Youn, MS Yao

International Journal of Radiation Oncology, Biology, Physics 117 (2), e209, 2023

Data Driven Approach to Exactrac Setup Parameters after CBCT for Cranial Radiotherapy

S Narayanan, J Manino, A Suen, HT Pham

International Journal of Radiation Oncology, Biology, Physics 117 (2), e700-e701, 2023

Relationship satisfaction, feelings of closeness and annoyance, and linkage in electrodermal activity.

Adela C Timmons, Sohyun C Han, Theodora Chaspari, Yehsong Kim, Shrikanth Narayanan, Jacqueline B Duong, Natalia Simo Fiallo, Gayla Margolin

Emotion, 2023

Detecting Poisoning Attacks against Speech Datasets using Variational Autoencoders

Nick Mehlman, Xuan Shi, Aditya Kommineni, Shrikanth Narayanan

Proc. 3rd Symposium on Security and Privacy in Speech Communication, 34-40, 2023

Beatboxing kick drum kinematics

Reed Blaylock, Shrikanth Narayanan

Interspeech 2023, 2583-2587, 2023

Cross-lingual features for alzheimer’s dementia detection from speech

Thomas Melistas, Lefteris Kapelonis, Nikos Antoniou, Petros Mitseas, Dimitris Sgouropoulos, Theodoros Giannakopoulos, Athanasios Katsamanis, Shrikanth Narayanan, NCSR Demokritos

Proc. Interspeech 2023, 3008-3012, 2023

Bridging Speech Science and Technology—Now and Into the Future

Shrikanth Narayanan

Proc. Interspeech 2023, 1-1, 2023

A review of speech-centric trustworthy machine learning: Privacy, safety, and fairness

Tiantian Feng, Rajat Hebbar, Nicholas Mehlman, Xuan Shi, Aditya Kommineni, Shrikanth Narayanan

APSIPA Transactions on Signal and Information Processing 12 (3), 2023

About this journal

C-C Jay Kuo

Emotion 13 (1), 2023

Movieclip: Visual scene recognition in movies

Digbalay Bose, Rajat Hebbar, Krishna Somandepalli, Haoyang Zhang, Yin Cui, Kree Cole-McLaughlin, Huisheng Wang, Shrikanth Narayanan

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer …, 2023

2022

Unsupervised active speaker detection in media content using cross-modal information

Rahul Sharma, Shrikanth Narayanan

arXiv preprint arXiv:2209.11896, 2022

Multi-modal, Multi-task, Music BERT: A Context-Aware Music Encoder Based on Transformers

Timothy Greer, Xuan Shi, Benjamin Ma, Shrikanth Narayanan

2022

Enhancing the quality of cognitive behavioral therapy in community mental health through artificial intelligence generated fidelity feedback (Project AFFECT): a study protocol

Torrey A Creed, Leah Salama, Roisin Slevin, Michael Tanana, Zac Imel, Shrikanth Narayanan, David C Atkins

BMC health services research 22 (1), 1177, 2022

The 2022 far-field speaker verification challenge: Exploring domain mismatch and semi-supervised learning under the far-field scenario

Xiaoyi Qin, Ming Li, Hui Bu, Shrikanth Narayanan, Haizhou Li

arXiv preprint arXiv:2209.05273, 2022

Interpersonal synchrony across vocal and lexical modalities in interactions involving children with autism spectrum disorder

Rimita Lahiri, Md Nasir, Manoj Kumar, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan

JASA express letters 2 (9), 2022

An automated quality evaluation framework of psychotherapy conversations with local quality estimates

Zhuohao Chen, Nikolaos Flemotomos, Karan Singla, Torrey A Creed, David C Atkins, Shrikanth Narayanan

Computer speech & language 75, 101380, 2022

VAuLT: Augmenting the vision-and-language transformer for sentiment classification on social media

Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan

arXiv preprint arXiv:2208.09021, 2022

A multi-sclice rtMRI analysis of horizontal tongue narrowing in English laterals

Anisia Popescu, Louis Goldstein, Mairym Llorens Montesérin, Shrikanth S Narayanan

18th Conference on Laboratory Phonology, 2022

Enhancing privacy through domain adaptive noise injection for speech emotion recognition

Tiantian Feng, Hanieh Hashemi, Murali Annavaram, Shrikanth S Narayanan

ICASSP 2022-2022 IEEE international conference on acoustics, speech and …, 2022

Evaluation of Swallow Function Post-tongue Cancer Treatment Using Real-time Mri: a Pilot Study.

Yihe Zu, S Narayanan, YC Kim, B Villegas, M Ouyoung, U Sinha

Dysphagia 28 (4), 648-649, 2022

Representation of professions in entertainment media: Insights into frequency and sentiment trends through computational text analysis

Sabyasachee Baruah, Krishna Somandepalli, Shrikanth Narayanan

Plos one 17 (5), e0267812, 2022

Technology-facilitated support system for monitoring and understanding interpersonal relationships

SS Narayanan, G Margolin, AC Ahle, T Chaspari

US Patent App. 17/562,647, 2022

Knowledge and attitudes toward an artificial intelligence-based fidelity measurement in community cognitive behavioral therapy supervision

Torrey A Creed, Patty B Kuo, Rebecca Oziel, Danielle Reich, Margaret Thomas, Sydne O’Connor, Zac E Imel, Tad Hirsch, Shrikanth Narayanan, David C Atkins

Administration and Policy in Mental Health and Mental Health Services …, 2022

User-level differential privacy against attribute inference attack of speech emotion recognition in federated learning

Tiantian Feng, Raghuveer Peri, Shrikanth Narayanan

arXiv preprint arXiv:2204.02500, 2022

Local dynamic mode of cognitive behavioral therapy

Victor Ardulov, Torrey A Creed, David C Atkins, Shrikanth Narayanan

arXiv preprint arXiv:2205.09752, 2022

Variation in compensatory strategies as a function of target constriction degree in post-glossectomy speech

Christina Hagedorn, Yijing Lu, Asterios Toutios, Uttam Sinha, Louis Goldstein, Shrikanth Narayanan

JASA Express Letters 2 (4), 2022

Multimodal clustering with role induced constraints for speaker diarization

Nikolaos Flemotomos, Shrikanth Narayanan

arXiv preprint arXiv:2204.00657, 2022

Leveraging social networks for the assessment and management of neurological patients

Amar Dhand, Archana Podury, Niteesh Choudhry, Shrikanth Narayanan, Min Shin, Matthias R Mehl

Seminars in Neurology 42 (02), 136-148, 2022

Automated evaluation of psychotherapy skills using speech and language technologies

Nikolaos Flemotomos, Victor R Martinez, Zhuohao Chen, Karan Singla, Victor Ardulov, Raghuveer Peri, Derek D Caperton, James Gibson, Michael J Tanana, Panayiotis Georgiou, Jake Van Epps, Sarah P Lord, Tad Hirsch, Zac E Imel, David C Atkins, Shrikanth Narayanan

Behavior Research Methods 54 (2), 690-711, 2022

Confusion2Vec 2.0: Enriching ambiguous spoken language representations with subwords

Prashanth Gurunath Shivakumar, Panayiotis Georgiou, Shrikanth Narayanan

Plos one 17 (3), e0264488, 2022

Using active speaker faces for diarization in tv shows

Rahul Sharma, Shrikanth Narayanan

arXiv preprint arXiv:2203.15961, 2022

Audio visual character profiles for detecting background characters in entertainment media

Rahul Sharma, Shrikanth Narayanan

arXiv preprint arXiv:2203.11368, 2022

To train or not to train adversarially: A study of bias mitigation strategies for speaker recognition

Raghuveer Peri, Krishna Somandepalli, Shrikanth Narayanan

arXiv preprint arXiv:2203.09122, 2022

Semi-fedser: Semi-supervised learning for speech emotion recognition on federated learning using multiview pseudo-labeling

Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2203.08810, 2022

End-to-end neural systems for automatic children speech recognition: An empirical study

Prashanth Gurunath Shivakumar, Shrikanth Narayanan

Computer Speech & Language 72, 101289, 2022

A review of speaker diarization: Recent advances with deep learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language 72, 101317, 2022

Intra-topic latency as an automated behavioral marker of treatment response in autism spectrum disorder

Elizabeth P McKernan, Manoj Kumar, Adriana Di Martino, Lisa Shulman, Alexander Kolevzon, Catherine Lord, Shrikanth Narayanan, So Hyun Kim

Scientific reports 12 (1), 3255, 2022

Special Issue on Signal Analysis for Detection and Monitoring of Contagious Diseases

Bjorn W Schuller, Yonina Eldar, Maja Pantic, Shrikanth Narayanan, Tuomas Virtanen, Jianhua Tao

IEEE Journal on Selected Topics in Signal Processing 16 (2), 2022

Intelligent signal analysis for contagious virus diseases

Björn W Schuller, Yonina Eldar, Maja Pantic, Shrikanth Narayanan, Tuomas Virtanen, Jianhua Tao

IEEE journal of selected topics in signal processing 16 (2), 159-163, 2022

Boys don’t cry (or kiss or dance): A computational linguistic lens into gendered actions in film

Victor R Martinez, Krishna Somandepalli, Shrikanth Narayanan

Plos one 17 (12), e0278604, 2022

Exploring workplace behaviors through speaking patterns using large-scale multimodal wearable recordings: A study of healthcare providers

Tiantian Feng, Shrikanth Narayanan

arXiv preprint arXiv:2212.09090, 2022

Cross modal video representations for weakly supervised active speaker localization

Rahul Sharma, Krishna Somandepalli, Shrikanth Narayanan

IEEE Transactions on Multimedia 25, 7825-7836, 2022

Automatic analysis of asymmetry in facial paralysis patients using landmark-based measures

Digbalay Bose, Krishna Somandepalli, Tymon Tai, Courtney Voelker, Shrikanth Narayanan, Amit Kochhar

Facial Plastic Surgery & Aesthetic Medicine 24 (6), 491-493, 2022

Effects of multilingualism on cognition among older Indian adults in the nationally representative LASI‐DAD study

Sarah Petrosyan, Miguel Arce Renteria, Jennifer J Manly, Shrikanth Narayanan, Jinkook Lee

Alzheimer's & Dementia 18, e065968, 2022

Phone duration modeling for speaker age estimation in children

Prashanth Gurunath Shivakumar, Somer Bishop, Catherine Lord, Shrikanth Narayanan

The Journal of the Acoustical Society of America 152 (5), 3000-3009, 2022

Multimodal Estimation of Change Points of Physiological Arousal in Drivers

Kleanthis Avramidis, Tiantian Feng, Digbalay Bose, Shrikanth Narayanan

arXiv preprint arXiv:2210.15826, 2022

Leveraging open data and task augmentation to automated behavioral coding of psychotherapy conversations in low-resource scenarios

Zhuohao Chen, Nikolaos Flemotomos, Zac E Imel, David C Atkins, Shrikanth Narayanan

arXiv preprint arXiv:2210.14254, 2022

Audio and ASR-based filled pause detection

Aggelina Chatziagapi, Dimitris Sgouropoulos, Constantinos Karouzos, Thomas Melistas, Theodoros Giannakopoulos, Athanasios Katsamanis, Shrikanth Narayanan

2022 10th International Conference on Affective Computing and Intelligent …, 2022

Automating detection of papilledema in pediatric fundus images with explainable machine learning

Kleanthis Avramidis, Mohammad Rostami, Melinda Chang, Shrikanth Narayanan

2022 IEEE International Conference on Image Processing (ICIP), 3973-3977, 2022

Expert-driven, technology-facilitated intervention system for improving interpersonal relationships

G Margolin, AC Ahle, MW Ahle, T Chaspari, SS Narayanan

US Patent App. 17/849,996, 2022

Behavioral Machine Intelligence with Language

Nikolaos Malandrakis, Victor R Martinez, Anil K Ramakrishna, Manoj Kumar, Karan Singla, Md Nasir, Shrikanth Narayanan

Handbook of Language Analysis in Psychology, 359, 2022

Causal indicators for assessing the truthfulness of child speech in forensic interviews

Zane Durante, Victor Ardulov, Manoj Kumar, Jennifer Gongola, Thomas Lyon, Shrikanth Narayanan

Computer speech & language 71, 101263, 2022

Studying Large-Scale Behavioral Differences in Auschwitz-Birkenau with Simulation of Gendered Narratives

Gábor Mihály Tóth, Tim Hempel, Krishna Somandepalli, Shri Narayanan

Digital Humanities Quarterly, 2022

Vault: Augmenting the vision-and-language transformer with the propagation of deep language representations

Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan

arXiv preprint arXiv:2208.09021 6, 17, 2022

Far-field speaker verification challenge (ffsvc) 2022: Challenge evaluation plan

Xiaoyi Qin, Ming Li, Hui Bu, Shrikanth Narayanan, Haizhou Li

2022

Tongue deformation and strain estimation using tagged RT‐MRI and optical flow

Ye Tian, Weiyi Chen, Dani Byrd, Shrikanth Narayanan, Krishna S Nayak

Proceedings of the 31st Annual Meeting of ISMRM, London, UK, 3390, 2022

2021

Privacy and utility preserving data transformation for speech emotion recognition

Tiantian Feng, Shrikanth Narayanan

2021 9th International Conference on Affective Computing and Intelligent …, 2021

Phone Duration Modeling for Speaker Age Estimation in Children

Prashanth Gurunath Shivakumar, Somer Bishop, Catherine Lord, Shrikanth Narayanan

arXiv e-prints, arXiv: 2109.01568, 2021

Health behaviour outcomes of a family based intervention for paediatric obesity in primary care: A randomized type II hybrid effectiveness‐implementation trial

Justin D Smith, Cady Berkel, Allison J Carroll, Emily Fu, Kevin J Grimm, Anne M Mauricio, Jenna Rudo‐Stern, Emily Winslow, Thomas J Dishion, Neil Jordan, David C Atkins, Shrikanth S Narayanan, Carlos Gallo, Meg M Bruening, Charlton Wilson, Farah Lokey, Kristen Samaddar

Pediatric Obesity 16 (9), e12780, 2021

Generalized Multiview Shared Subspace Learning Using View Bootstrapping

Krishna Somandepalli, Shrikanth Narayanan

IEEE Transactions on Signal Processing 69, 4774-4786, 2021

Annotation and evaluation of coreference resolution in screenplays

Sabyasachee Baruah, Sandeep Nallan Chakravarthula, Shrikanth Narayanan

Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 …, 2021

Leveraging real-time MRI for illuminating linguistic velum action

Miran Oh, Dani Byrd, Shrikanth S Narayanan

Interspeech, 2021

Aliasing artifact reduction in spiral real‐time MRI

Ye Tian, Yongwan Lim, Ziwei Zhao, Dani Byrd, Shrikanth Narayanan, Krishna S Nayak

Magnetic resonance in medicine 86 (2), 916-925, 2021

Robust character labeling in movie videos: Data resources and self-supervised feature adaptation

Krishna Somandepalli, Rajat Hebbar, Shrikanth Narayanan

IEEE Transactions on Multimedia 24, 3355-3368, 2021

A multispeaker dataset of raw and reconstructed speech production real-time MRI video and 3D volumetric images

Yongwan Lim, Asterios Toutios, Yannick Bliesener, Ye Tian, Sajan Goud Lingala, Colin Vaz, Tanner Sorensen, Miran Oh, Sarah Harper, Weiyi Chen, Yoonjeong Lee, Johannes Töger, Mairym Lloréns Monteserin, Caitlin Smith, Bianca Godinez, Louis Goldstein, Dani Byrd, Krishna S Nayak, Shrikanth S Narayanan

Scientific data 8 (1), 187, 2021

Perceptual-based deep-learning denoiser as a defense against adversarial attacks on ASR systems

Anirudh Sreeram, Nicholas Mehlman, Raghuveer Peri, Dillon Knox, Shrikanth Narayanan

arXiv preprint arXiv:2107.05222, 2021

Dark tone quality and vocal tract shaping in soprano song production: Insights from real-time MRI

Elisabeth Lynn, Shrikanth S Narayanan, Adam C Lammert

JASA Express Letters 1 (7), 2021

Adversarial attack and defense strategies for deep speaker recognition systems

Arindam Jati, Chin-Cheng Hsu, Monisankha Pal, Raghuveer Peri, Wael AbdAlmageed, Shrikanth Narayanan

Computer Speech & Language 68, 101199, 2021

Context-aware speech stress detection in hospital workers using Bi-LSTM classifiers

Amr Gaballah, Abhishek Tiwari, Shrikanth Narayanan, Tiago H Falk

ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and …, 2021

Multi-scale speaker diarization with neural affinity score fusion

Tae Jin Park, Manoj Kumar, Shrikanth Narayanan

ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and …, 2021

Adversarial defense for deep speaker recognition using hybrid adversarial training

Monisankha Pal, Arindam Jati, Raghuveer Peri, Chin-Cheng Hsu, Wael AbdAlmageed, Shrikanth Narayanan

ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and …, 2021

Robust diagnostic classification via Q-learning

Victor Ardulov, Victor R Martinez, Krishna Somandepalli, Shuting Zheng, Emma Salzman, Catherine Lord, Somer Bishop, Shrikanth Narayanan

Scientific reports 11 (1), 11730, 2021

A computational tool to study vocal participation of women in UN-ITU meetings

Rajat Hebbar, Krishna Somandepalli, Raghuveer Peri, Ruchir Travadi, Tracy Tuplin, Fernando Rivera, Shrikanth Narayanan

2021 International Conference on Content-Based Multimedia Indexing (CBMI), 1-4, 2021

Loss function approaches for multi-label music tagging

Dillon Knox, Timothy Greer, Benjamin Ma, Emily Kuo, Krishna Somandepalli, Shrikanth Narayanan

2021 International Conference on Content-Based Multimedia Indexing (CBMI), 1-4, 2021

Family Check-up 4 Health Improves Health Behaviors Among Low-Income Families with Overweight/Obese Children: Results of a Randomized Hybrid Trial

JD Smith, Cady Berkel, Allison J Carroll, Emily Fu, Kevin Grimm, Anne Marie Mauricio, Jenna Rudo-Stern, Emily B Winslow, Thomas J Dishion, Neil Jordan, David Atkins, Shrikanth S Narayanan, Carlos Gallo, Meg Bruening, Charlton Wilson, Farah Lokey, Kristen Samaddar

SPR Virtual 29th Annual Meeting, 2021

Complexity of vocal tract shaping in glossectomy patients and typical speakers: A principal component analysis

Christina Hagedorn, Jangwon Kim, Uttam Sinha, Louis Goldstein, Shrikanth S Narayanan

The Journal of the Acoustical Society of America 149 (6), 4437-4449, 2021

Improved 3D real‐time MRI of speech production

Ziwei Zhao, Yongwan Lim, Dani Byrd, Shrikanth Narayanan, Krishna S Nayak

Magnetic Resonance in Medicine 85 (6), 3182-3195, 2021

Expert-driven, technology-facilitated intervention system for improving interpersonal relationships

G Margolin, AC Ahle, MW Ahle, T Chaspari, SS Narayanan

US Patent App. 16/501,128, 2021

Human mental state monitoring in the wild: Are we better off with deeperneural networks or improved input features?

Arthur Pimentel, Abhishek Tiwari, Shrikanth Narayanan, Tiago H Falk

CMBES Proceedings 44, 2021

A computational lens into how music characterizes genre in film

Benjamin Ma, Timothy Greer, Dillon Knox, Shrikanth Narayanan

PloS one 16 (4), e0249957, 2021

Acted vs. improvised: Domain adaptation for elicitation approaches in audio-visual emotion recognition

Haoqi Li, Yelin Kim, Cheng-Hao Kuo, Shrikanth Narayanan

arXiv preprint arXiv:2104.01978, 2021

A multimodal analysis of physical activity, sleep, and work shift in nurses with wearable sensor data

Tiantian Feng, Brandon M Booth, Brooke Baldwin-Rodríguez, Felipe Osorno, Shrikanth Narayanan

Scientific reports 11 (1), 8693, 2021

The Possibilities and Challenges of Deep Learning in Health Communication Contexts

Dana Ketcher, Amy Otto, Sandeep Nallan Chakravarthula, Richard E Heyman, Lee Ellington, Susan Vadaparampil, Shrikanth S Narayanan, Maija Reblin

ANNALS OF BEHAVIORAL MEDICINE 55, S470-S470, 2021

Romantic partner presence and physiological responses in daily life: Attachment style as a moderator

Sohyun C Han, Hannah L Schacter, Adela C Timmons, Yehsong Kim, Stassja Sichko, Corey Pettit, Theodora Chaspari, Shrikanth Narayanan, Gayla Margolin

Biological psychology 161, 108082, 2021

Extending the Beta divergence to complex values

Colin Vaz, Shrikanth Narayanan

Pattern Recognition Letters 144, 105-111, 2021

Front-end Diarization for Percussion Separation in Taniavartanam of Carnatic Music Concerts

Nauman Dawalatabad, Jilt Sebastian, Jom Kuriakose, C Chandra Sekhar, Shrikanth Narayanan, Hema A Murthy

arXiv preprint arXiv:2103.03215, 2021

Linguistic analysis of differences in portrayal of movie characters

S Narayanan, VM Palacios, A Ramakrishna, K Somandepalli, ...

US Patent 10,956,679, 2021

Evidence of task-independent person-specific signatures in EEG using subspace techniques

Mari Ganesh Kumar, Shrikanth Narayanan, Mriganka Sur, Hema A Murthy

IEEE Transactions on Information Forensics and Security 16, 2856-2871, 2021

Multimodal embeddings from language models for emotion recognition in the wild

Shao-Yen Tseng, Shrikanth Narayanan, Panayiotis Georgiou

IEEE Signal Processing Letters 28, 608-612, 2021

Deblurring for spiral real-time MRI using convolutional neural networks (vol 84, pg 3438, 2020)

Y Lim, Y Bliesener, S Narayanan, KS Nayak

MAGNETIC RESONANCE IN MEDICINE 85 (3), 1742-1742, 2021

Intrapersonal and interpersonal vocal affect dynamics during psychotherapy.

Adar Paz, Eshkol Rafaeli, Eran Bar-Kalifa, Eva Gilboa-Schectman, Sharon Gannot, Bracha Laufer-Goldshtein, Shrikanth Narayanan, Joseph Keshet, Dana Atzil-Slonim

Journal of Consulting and Clinical Psychology 89 (3), 227, 2021

Deep multiple instance learning for foreground speech localization in ambient audio from wearable devices

Rajat Hebbar, Pavlos Papadopoulos, Ramon Reyes, Alexander F Danvers, Angelina J Polsinelli, Suzanne A Moseley, David A Sbarra, Matthias R Mehl, Shrikanth Narayanan

EURASIP Journal on Audio, Speech, and Music Processing 2021 (1), 7, 2021

Meta-learning with latent space clustering in generative adversarial network for speaker diarization

Monisankha Pal, Manoj Kumar, Raghuveer Peri, Tae Jin Park, So Hyun Kim, Catherine Lord, Somer Bishop, Shrikanth Narayanan

IEEE/ACM transactions on audio, speech, and language processing 29, 1204-1219, 2021

Attention-gated convolutional neural networks for off-resonance correction of spiral real-time MRI

Yongwan Lim, Shrikanth S Narayanan, Krishna S Nayak

arXiv preprint arXiv:2102.07271, 2021

Conversational correlates of rapid social judgments of children and adolescents with and without ASD

Aaron Shield, Xin Wang, Daniel Bone, Shrikanth Narayanan, Ruth B Grossman

Clinical linguistics & phonetics 35 (2), 172-184, 2021

Attribute inference attack of speech emotion recognition in federated learning settings

Tiantian Feng, Hanieh Hashemi, Rajat Hebbar, Murali Annavaram, Shrikanth S Narayanan

arXiv preprint arXiv:2112.13416, 2021

Unsupervised speech representation learning for behavior modeling using triplet enhanced contextualized networks

Haoqi Li, Brian Baucom, Shrikanth Narayanan, Panayiotis Georgiou

Computer Speech & Language 70, 101226, 2021

Feature fusion strategies for end-to-end evaluation of cognitive behavior therapy sessions

Zhuohao Chen, Nikolaos Flemotomos, Victor Ardulov, Torrey A Creed, Zac E Imel, David C Atkins, Shrikanth Narayanan

2021 43rd Annual International Conference of the IEEE Engineering in …, 2021

Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations

Nikolaos Flemotomos, Victor R Martinez, Zhuohao Chen, Torrey A Creed, David C Atkins, Shrikanth Narayanan

PloS one 16 (10), e0258639, 2021

Understanding of emotion perception from art

Digbalay Bose, Krishna Somandepalli, Souvik Kundu, Rimita Lahiri, Jonathan Gratch, Shrikanth Narayanan

arXiv preprint arXiv:2110.06486, 2021

Cross domain emotion recognition using few shot knowledge transfer

Justin Olah, Sabyasachee Baruah, Digbalay Bose, Shrikanth Narayanan

arXiv preprint arXiv:2110.05021, 2021

Inclusive machine intelligence and its promise for speech-centered societal application

Shrikanth Narayanan, Dani Byrd

The Journal of the Acoustical Society of America 150 (4_Supplement), A346-A346, 2021

Modeling speaker-specific vocal tract kinematics from gestural scores

Yijing Lu, Justin Ly, Shrikanth Narayanan, Louis Goldstein, Asterios Toutios

The Journal of the Acoustical Society of America 150 (4_Supplement), A188-A189, 2021

Developing neural representations for robust child-adult diarization

Suchitra Krishnamachari, Manoj Kumar, So Hyun Kim, Catherine Lord, Shrikanth Narayanan

2021 IEEE Spoken Language Technology Workshop (SLT), 590-597, 2021

Rnn based incremental online spoken language understanding

Prashanth Gurunath Shivakumar, Naveen Kumar, Panayiotis Georgiou, Shrikanth Narayanan

2021 IEEE Spoken Language Technology Workshop (SLT), 989-996, 2021

Temporal dynamics of workplace acoustic scenes: Egocentric analysis and prediction

Arindam Jati, Amrutha Nadarajan, Raghuveer Peri, Karel Mundnich, Tiantian Feng, Benjamin Girault, Shrikanth Narayanan

IEEE/ACM Transactions on Audio, Speech, and Language Processing 29, 756-769, 2021

Computational media intelligence: Human-centered machine analysis of media

Krishna Somandepalli, Tanaya Guha, Victor R Martinez, Naveen Kumar, Hartwig Adam, Shrikanth Narayanan

Proceedings of the IEEE 109 (5), 891-910, 2021

Enhancing the brain's emotion regulation capacity with a randomised trial of a 5-week heart rate variability biofeedback intervention

Kaoru Nashiro, Jungwon Min, Hyun Joo Yoo, Christine Cho, Shelby L Bachman, Shubir Dutt, Julian F Thayer, Paul Lehrer, Tiantian Feng, Noah Mercer, Padideh Nasseri, Diana Wang, Catie Chang, Vasilis Z Marmarelis, Shri Narayanan, Daniel A Nation, Mara Mather

MedRxiv, 2021

USC-SAIL system for DIHARD III: Domain adaptive diarization system

Tae Jin Park, Raghuveer Peri, Arindam Jati, Shrikanth Narayanan

Proc. 3rd DIHARD Speech Diarization Challenge Workshop, 2021

Analyzing Short Term Dynamic Speech Features for Understanding Behavioral Traits of Children with Autism Spectrum Disorder.

Young-Kyung Kim, Rimita Lahiri, Md Nasir, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth S Narayanan

Interspeech, 2916-2920, 2021

2020

Group-specific models of healthcare workers’ well-being using iterative participant clustering

Vinesh Ravuri, Projna Paromita, Karel Mundnich, Amrutha Nadarajan, Brandon M Booth, Shrikanth S Narayanan, Theodora Chaspari

2020 Second International Conference on Transdisciplinary AI (TransAI), 115-118, 2020

Modeling vocal entrainment in conversational speech using deep unsupervised learning

Md Nasir, Brian Baucom, Craig Bryan, Shrikanth Narayanan, Panayiotis Georgiou

IEEE Transactions on Affective Computing 13 (3), 1651-1663, 2020

Studying clicks using real-time MRI

Michael Proctor, Yinghua Zhu, Adam Lammert, Asterios Toutios, Bonny Sands, Shrikanth Narayanan

Click consonants, 210-240, 2020

Technology-Facilitated Support System for Monitoring and Understanding Interpersonal Relationships

SS Narayanan, G Margolin, AC Ahle, T Chaspari

US Patent App. 16/291,225, 2020

Leveraging linguistic context in dyadic interactions to improve automatic speech recognition for children

Manoj Kumar, So Hyun Kim, Catherine Lord, Thomas D Lyon, Shrikanth Narayanan

Computer speech & language 63, 101101, 2020

Victim or perpetrator? Analysis of violent characters portrayals from movie scripts

Victor R Martinez, Krishna Somandepalli, Karan Singla, Anil Ramanakrishna, Yalda T Uhls, Shrikanth Narayanan

arXiv preprint arXiv:2008.08225, 2020

Neural speech decoding during audition, imagination and production

Rini A Sharon, Shrikanth S Narayanan, Mriganka Sur, A Hema Murthy

IEEE access 8, 149714-149729, 2020

Improved real‐time tagged MRI using REALTAG

Weiyi Chen, Nam Gyun Lee, Dani Byrd, Shrikanth Narayanan, Krishna S Nayak

Magnetic resonance in medicine 84 (2), 838-846, 2020

Designing neural speaker embeddings with meta learning

Manoj Kumar, Tae Jin-Park, Somer Bishop, Shrikanth Narayanan

arXiv preprint arXiv:2007.16196, 2020

Coregulation of therapist and client emotion during psychotherapy

Christina S Soma, Brian RW Baucom, Bo Xiao, Jonathan E Butner, Peter Hilpert, Shrikanth Narayanan, David C Atkins, Zac E Imel

Psychotherapy research 30 (5), 591-603, 2020

Dynamical systems modeling of day-to-day signal-based patterns of emotional self-regulation and stress spillover in highly-demanding health professions

George Hadjiantonis, Projna Paromita, Karel Mundnich, Amrutha Nadarajan, Brandon M Booth, Shrikanth Narayanan, Theodora Chaspari

2020 42nd Annual International Conference of the IEEE Engineering in …, 2020

Modeling Human Movement Behavior Among Nursing Profession

Tiantian Feng, Shrikanth Narayanan

2020 42nd Annual International Conference of the IEEE Engineering in …, 2020

Joint multi-dimensional model for global and time-series annotations

Anil Ramakrishna, Rahul Gupta, Shrikanth Narayanan

IEEE Transactions on Affective Computing 13 (1), 473-484, 2020

Machine learning and natural language processing in psychotherapy research: Alliance as example use case.

Simon B Goldberg, Nikolaos Flemotomos, Victor R Martinez, Michael J Tanana, Patty B Kuo, Brian T Pace, Jennifer L Villatte, Panayiotis G Georgiou, Jake Van Epps, Zac E Imel, Shrikanth S Narayanan, David C Atkins

Journal of counseling psychology 67 (4), 438, 2020

Towards end-2-end learning for predicting behavior codes from spoken utterances in psychotherapy conversations

Karan Singla, Zhuohao Chen, David C Atkins, Shrikanth Narayanan

Proceedings of the conference. Association for Computational Linguistics …, 2020

Affective conditioning on hierarchical networks applied to depression detection from transcribed clinical interviews

Danai Xezonaki, Georgios Paraskevopoulos, Alexandros Potamianos, Shrikanth Narayanan

arXiv preprint arXiv:2006.08336, 2020

Variability in individual constriction contributions to third formant values in American English/ɹ

Sarah Harper, Louis Goldstein, Shrikanth Narayanan

The Journal of the Acoustical Society of America 147 (6), 3905-3916, 2020

How an aglossic speaker produces an alveolar-like percept without a functional tongue tip

Asterios Toutios, Melissa Xu, Dani Byrd, Louis Goldstein, Shrikanth Narayanan

The Journal of the Acoustical Society of America 147 (6), EL460-EL464, 2020

Identifying truthful language in child interviews

Victor Ardulov, Zane Durante, Shanna Williams, Thomas Lyon, Shrikanth Narayanan