Sound

Authors and titles for August 2023

[1] arXiv:2308.00010 [pdf, other]

Title: Monaural Multi-Speaker Speech Separation Using Efficient Transformer Model

S. Rijal, R. Neupane, S. P. Mainali, S. K. Regmi, S. Maharjan

Comments: 5 pages, 6 figures, 2 tables, study conducted as major project for B.E. (Computer Engineering), IOE Tribhuvan University 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2] arXiv:2308.00015 [pdf, other]

Title: Exploring how a Generative AI interprets music

Gabriela Barenboim, Luigi Del Debbio, Johannes Hirn, Veronica Sanz

Comments: 16 pages, 12 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[3] arXiv:2308.01187 [pdf, html, other]

Title: Music De-limiter Networks via Sample-wise Gain Inversion

Chang-Bin Jeon, Kyogu Lee

Comments: Results corrected as some bugs were found in the previous codes and dataset. Presented at WASPAA 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[4] arXiv:2308.01327 [pdf, other]

Title: Careful Whisper -- leveraging advances in automatic speech recognition for robust and interpretable aphasia subtype classification

Laurin Wagner, Mario Zusag, Theresa Bloder

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[5] arXiv:2308.01531 [pdf, other]

Title: Optimizing multi-user indoor sound communications with acoustic reconfigurable metasurfaces

Hongkuan Zhang, Qiyuan Wang, Mathias Fink, Guancong Ma

Journal-ref: Nature Communications (2024)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Applied Physics (physics.app-ph)

[6] arXiv:2308.01546 [pdf, other]

Title: MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies

Ke Chen, Yusong Wu, Haohe Liu, Marianna Nezhurina, Taylor Berg-Kirkpatrick, Shlomo Dubnov

Comments: 16 pages, 3 figures, 2 tables, demo page: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[7] arXiv:2308.01573 [pdf, other]

Title: Adversarial Training of Denoising Diffusion Model Using Dual Discriminators for High-Fidelity Multi-Speaker TTS

Myeongjin Ko, Yong-Hoon Choi

Journal-ref: IEEE Open Journal of Signal Processing, vol. 5, pp. 577-587, 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[8] arXiv:2308.02013 [pdf, other]

Title: Federated Representation Learning for Automatic Speech Recognition

Guruprasad V Ramesh, Gopinath Chennupati, Milind Rao, Anit Kumar Sahu, Ariya Rastrow, Jasha Droppo

Comments: Accepted at ISCA SPSC Symposium 3rd Symposium on Security and Privacy in Speech Communication, 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[9] arXiv:2308.02190 [pdf, other]

Title: Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Recognition

Jiaxin Ye, Yujie Wei, Xin-Cheng Wen, Chenglong Ma, Zhizhong Huang, Kunhong Liu, Hongming Shan

Comments: Accepted by ACM MM 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[10] arXiv:2308.02249 [pdf, other]

Title: Finding Tori: Self-supervised Learning for Analyzing Korean Folk Song

Danbinaerin Han, Rafael Caro Repetto, Dasaem Jeong

Comments: Accepted at 24th International Society for Music Information Retrieval Conference (ISMIR 2023)

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[11] arXiv:2308.02263 [pdf, other]

Title: Efficient Monaural Speech Enhancement using Spectrum Attention Fusion

Jinyu Long, Jetic Gū, Binhao Bai, Zhibo Yang, Ping Wei, Junli Li

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[12] arXiv:2308.02560 [pdf, other]

Title: From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusion

Robin San Roman, Yossi Adi, Antoine Deleforge, Romain Serizel, Gabriel Synnaeve, Alexandre Défossez

Comments: 10 pages

Journal-ref: Thirty-seventh Conference on Neural Information Processing Systems (2023)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[13] arXiv:2308.02723 [pdf, other]

Title: Towards Improving Harmonic Sensitivity and Prediction Stability for Singing Melody Extraction

Keren Shao, Ke Chen, Taylor Berg-Kirkpatrick, Shlomo Dubnov

Comments: 7 pages, 4 figures, 2 tables, Proceedings of the 24th International Society for Music Information Retrieval Conference, ISMIR 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[14] arXiv:2308.02867 [pdf, other]

Title: A Systematic Exploration of Joint-training for Singing Voice Synthesis

Yuning Wu, Yifeng Yu, Jiatong Shi, Tao Qian, Qin Jin

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[15] arXiv:2308.02898 [pdf, other]

Title: Elucidate Gender Fairness in Singing Voice Transcription

Xiangming Gu, Wei Zeng, Ye Wang

Comments: Camera-ready version of ACM MM2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[16] arXiv:2308.03019 [pdf, other]

Title: Characterization of cough sounds using statistical analysis

Naveenkumar Vodnala (VNR Vignana Jyothi Institute of Engineering and Technology), Pratap Reddy Lankireddy (Jawaharlal Nehru Technological University Hyderabad), Padmasai Yarlagadda (VNR Vignana Jyothi Institute of Engineering and Technology)

Comments: 19 pages, 8 figures, paper submitted to journal Biomedical Signal Processing and Control which is under review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[17] arXiv:2308.03266 [pdf, html, other]

Title: SeACo-Paraformer: A Non-Autoregressive ASR System with Flexible and Effective Hotword Customization Ability

Xian Shi, Yexin Yang, Zerui Li, Yanni Chen, Zhifu Gao, Shiliang Zhang

Comments: accepted by ICASSP2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[18] arXiv:2308.03300 [pdf, other]

Title: Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detection

Xiaohui Zhang, Jiangyan Yi, Jianhua Tao, Chenglong Wang, Chuyuan Zhang

Comments: 40th Internation Conference on Machine Learning (ICML 2023)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[19] arXiv:2308.03332 [pdf, other]

Title: Improving Deep Attractor Network by BGRU and GMM for Speech Separation

Rawad Melhem, Assef Jafar, Riad Hamadeh

Journal-ref: Journal of Harbin Institute of Technology (New Series), vol. 28, no. 3, pp. 90-96, 2021

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[20] arXiv:2308.04025 [pdf, html, other]

Title: MSAC: Multiple Speech Attribute Control Method for Reliable Speech Emotion Recognition

Yu Pan, Yuguang Yang, Yuheng Huang, Jixun Yao, Jingjing Yin, Yanni Hu, Heng Lu, Lei Ma, Jianjun Zhao

Comments: 12 pages

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[21] arXiv:2308.04169 [pdf, other]

Title: Dual input neural networks for positional sound source localization

Eric Grinstein, Vincent W. Neo, Patrick A. Naylor

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[22] arXiv:2308.04244 [pdf, other]

Title: Auditory Attention Decoding with Task-Related Multi-View Contrastive Learning

Xiaoyu Chen, Changde Du, Qiongyi Zhou, Huiguang He

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC); Quantitative Methods (q-bio.QM)

[23] arXiv:2308.04517 [pdf, other]

Title: Capturing Spectral and Long-term Contextual Information for Speech Emotion Recognition Using Deep Learning Techniques

Samiul Islam, Md. Maksudul Haque, Abu Jobayer Md. Sadat

Comments: the research paper is still in progress

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[24] arXiv:2308.04666 [pdf, html, other]

Title: Speaker Recognition Using Isomorphic Graph Attention Network Based Pooling on Self-Supervised Representation

Zirui Ge, Xinzhou Xu, Haiyan Guo, Tingting Wang, Zhen Yang

Comments: 9 pages, 4 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[25] arXiv:2308.04729 [pdf, other]

Title: JEN-1: Text-Guided Universal Music Generation with Omnidirectional Diffusion Models

Peike Li, Boyu Chen, Yao Yao, Yikai Wang, Allen Wang, Alex Wang

Journal-ref: https://ieeecai.org/2024/wp-content/pdfs/540900a773/540900a773.pdf

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[26] arXiv:2308.04960 [pdf, other]

Title: Representation Learning for Audio Privacy Preservation using Source Separation and Robust Adversarial Learning

Diep Luong, Minh Tran, Shayan Gharib, Konstantinos Drossos, Tuomas Virtanen

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[27] arXiv:2308.05141 [pdf, html, other]

Title: Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

Nikolas Borrel-Jensen, Somdatta Goswami, Allan P. Engsig-Karup, George Em Karniadakis, Cheol-Ho Jeong

Comments: 25 pages, 10 figures, 4 tables

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[28] arXiv:2308.05218 [pdf, other]

Title: Conformer-based Target-Speaker Automatic Speech Recognition for Single-Channel Audio

Yang Zhang, Krishna C. Puvvada, Vitaly Lavrukhin, Boris Ginsburg

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[29] arXiv:2308.05734 [pdf, html, other]

Title: AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining

Haohe Liu, Yi Yuan, Xubo Liu, Xinhao Mei, Qiuqiang Kong, Qiao Tian, Yuping Wang, Wenwu Wang, Yuxuan Wang, Mark D. Plumbley

Comments: Accepted by IEEE/ACM Transactions on Audio, Speech and Language Processing. Project page is this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[30] arXiv:2308.05987 [pdf, other]

Title: Large-Scale Learning on Overlapped Speech Detection: New Benchmark and New General System

Zhaohui Yin, Jingguang Tian, Xinhui Hu, Xinkang Xu, Yang Xiang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[31] arXiv:2308.05995 [pdf, html, other]

Title: Audio is all in one: speech-driven gesture synthetics using WavLM pre-trained model

Fan Zhang, Naye Ji, Fuxing Gao, Siyuan Zhao, Zhaohan Wang, Shunman Li

Comments: This article needs major revision

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[32] arXiv:2308.06089 [pdf, other]

Title: An Autoethnographic Exploration of XAI in Algorithmic Composition

Ashley Noel-Hirst, Nick Bryan-Kinns

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[33] arXiv:2308.06112 [pdf, other]

Title: Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping

Yasser Abdelaziz Dahou Djilali, Sanath Narayan, Haithem Boussaid, Ebtessam Almazrouei, Merouane Debbah

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[34] arXiv:2308.06382 [pdf, html, other]

Title: Phoneme Hallucinator: One-shot Voice Conversion via Set Expansion

Siyuan Shan, Yang Li, Amartya Banerjee, Junier B. Oliva

Comments: AAAI 2024 Demo, Codes: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[35] arXiv:2308.06472 [pdf, other]

Title: Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding

Kumari Nishu, Minsik Cho, Paul Dixon, Devang Naik

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[36] arXiv:2308.06483 [pdf, other]

Title: BigWavGAN: A Wave-To-Wave Generative Adversarial Network for Music Super-Resolution

Yenan Zhang, Hiroshi Watanabe

Comments: Accepted by IEEE GCCE 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[37] arXiv:2308.07117 [pdf, other]

Title: iSTFTNet2: Faster and More Lightweight iSTFT-Based Neural Vocoder Using 1D-2D CNN

Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka, Shogo Seki

Comments: Accepted to Interspeech 2023. Project page: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[38] arXiv:2308.07121 [pdf, other]

Title: Active Bird2Vec: Towards End-to-End Bird Sound Monitoring with Transformers

Lukas Rauch, Raphael Schwinger, Moritz Wirth, Bernhard Sick, Sven Tomforde, Christoph Scholz

Comments: Accepted @AI4S ECAI2023. This is the author's version of the work

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[39] arXiv:2308.07170 [pdf, html, other]

Title: Human Voice Pitch Estimation: A Convolutional Network with Auto-Labeled and Synthetic Data

Jeremy Cochoy

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[40] arXiv:2308.07221 [pdf, other]

Title: AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codes

Zhaohui Li, Haitao Wang, Xinghua Jiang

Comments: Need to supplement more detailed experiments

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[41] arXiv:2308.07293 [pdf, other]

Title: DiffSED: Sound Event Detection with Denoising Diffusion

Swapnil Bhosale, Sauradip Nag, Diptesh Kanojia, Jiankang Deng, Xiatian Zhu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[42] arXiv:2308.07787 [pdf, other]

Title: DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding

Jeongsoo Choi, Joanna Hong, Yong Man Ro

Comments: ICCV 2023

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[43] arXiv:2308.08125 [pdf, other]

Title: Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals

Running Zhao, Jiangtao Yu, Hang Zhao, Edith C.H. Ngai

Comments: Accepted by Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (ACM IMWUT/UbiComp 2023)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[44] arXiv:2308.08143 [pdf, html, other]

Title: IIANet: An Intra- and Inter-Modality Attention Network for Audio-Visual Speech Separation

Kai Li, Runxuan Yang, Fuchun Sun, Xiaolin Hu

Comments: 18 pages, 6 figures

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[45] arXiv:2308.08181 [pdf, other]

Title: ChinaTelecom System Description to VoxCeleb Speaker Recognition Challenge 2023

Mengjie Du, Xiang Fang, Jie Li

Comments: System description of VoxSRC 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[46] arXiv:2308.08438 [pdf, other]

Title: Accurate synthesis of Dysarthric Speech for ASR data augmentation

Mohammad Soleymanpour, Michael T. Johnson, Rahim Soleymanpour, Jeffrey Berry

Comments: arXiv admin note: text overlap with arXiv:2201.11571

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[47] arXiv:2308.08577 [pdf, other]

Title: AffectEcho: Speaker Independent and Language-Agnostic Emotion and Affect Transfer for Speech Synthesis

Hrishikesh Viswanath, Aneesh Bhattacharya, Pascal Jutras-Dubé, Prerit Gupta, Mridu Prashanth, Yashvardhan Khaitan, Aniket Bera

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[48] arXiv:2308.08850 [pdf, other]

Title: Long-frame-shift Neural Speech Phase Prediction with Spectral Continuity Enhancement and Interpolation Error Compensation

Yang Ai, Ye-Xin Lu, Zhen-Hua Ling

Comments: Published at IEEE Signal Processing Letters

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[49] arXiv:2308.09089 [pdf, other]

Title: Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries

Julia Wilkins, Justin Salamon, Magdalena Fuentes, Juan Pablo Bello, Oriol Nieto

Comments: WASPAA 2023. Project page: this https URL. 4 pages, 2 figures, 2 tables

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[50] arXiv:2308.09302 [pdf, other]

Title: Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms

Penghui Wen, Kun Hu, Wenxi Yue, Sen Zhang, Wanlei Zhou, Zhiyong Wang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)