Machine Learning

Authors and titles for June 2023

[1] arXiv:2306.00008 [pdf, html, other]

Title: Brainformers: Trading Simplicity for Efficiency

Yanqi Zhou, Nan Du, Yanping Huang, Daiyi Peng, Chang Lan, Da Huang, Siamak Shakeri, David So, Andrew Dai, Yifeng Lu, Zhifeng Chen, Quoc Le, Claire Cui, James Laudon, Jeff Dean

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2] arXiv:2306.00009 [pdf, other]

Title: Graph Exploration Matters: Improving both individual-level and system-level diversity in WeChat Feed Recommender

Shuai Yang, Lixin Zhang, Feng Xia, Leyu Lin

Subjects: Machine Learning (cs.LG)

[3] arXiv:2306.00010 [pdf, html, other]

Title: Trainable and Explainable Simplicial Map Neural Networks

Eduardo Paluzo-Hidalgo, Miguel A. Gutiérrez-Naranjo, Rocio Gonzalez-Diaz

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Algebraic Topology (math.AT)

[4] arXiv:2306.00011 [pdf, other]

Title: DeepVAT: A Self-Supervised Technique for Cluster Assessment in Image Datasets

Alokendu Mazumder, Tirthajit Baruah, Akash Kumar Singh, Pagadla Krishna Murthy, Vishwajeet Pattanaik, Punit Rathore

Comments: Accepted at ViPriors @ ICCV 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[5] arXiv:2306.00012 [pdf, other]

Title: Graph Neural Network for spatiotemporal data: methods and applications

Yun Li, Dazhou Yu, Zhenke Liu, Minxing Zhang, Xiaoyun Gong, Liang Zhao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[6] arXiv:2306.00015 [pdf, other]

Title: GraphCleaner: Detecting Mislabelled Samples in Popular Graph Learning Benchmarks

Yuwen Li, Miao Xiong, Bryan Hooi

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[7] arXiv:2306.00016 [pdf, other]

Title: Incorporating Domain Knowledge in Deep Neural Networks for Discrete Choice Models

Shadi Haj-Yahia, Omar Mansour, Tomer Toledo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Econometrics (econ.EM)

[8] arXiv:2306.00023 [pdf, other]

Title: Predicting Heart Disease and Reducing Survey Time Using Machine Learning Algorithms

Salahaldeen Rababa, Asma Yamin, Shuxia Lu, Ashraf Obaidat

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Applications (stat.AP)

[9] arXiv:2306.00035 [pdf, other]

Title: ROSARL: Reward-Only Safe Reinforcement Learning

Geraud Nangue Tasse, Tamlin Love, Mark Nemecek, Steven James, Benjamin Rosman

Subjects: Machine Learning (cs.LG)

[10] arXiv:2306.00040 [pdf, other]

Title: Assessing the Generalizability of a Performance Predictive Model

Ana Nikolikj, Gjorgjina Cenikj, Gordana Ispirova, Diederick Vermetten, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov

Comments: To appear at GECCO 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[11] arXiv:2306.00042 [pdf, other]

Title: Graph-based methods coupled with specific distributional distances for adversarial attack detection

Dwight Nwaigwe, Lucrezia Carboni, Martial Mermillod, Sophie Achard, Michel Dojat

Comments: published in Neural Networks

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[12] arXiv:2306.00044 [pdf, other]

Title: How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning

Hye-jin Shim, Rosa González Hautamäki, Md Sahidullah, Tomi Kinnunen

Comments: Interspeech 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[13] arXiv:2306.00074 [pdf, html, other]

Title: Human-Aligned Calibration for AI-Assisted Decision Making

Nina L. Corvelo Benz, Manuel Gomez Rodriguez

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Machine Learning (stat.ML)

[14] arXiv:2306.00087 [pdf, other]

Title: Adaptive Coordination in Social Embodied Rearrangement

Andrew Szot, Unnat Jain, Dhruv Batra, Zsolt Kira, Ruta Desai, Akshara Rai

Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA); Robotics (cs.RO)

[15] arXiv:2306.00088 [pdf, other]

Title: Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning

Yuxin Tang, Zhimin Ding, Dimitrije Jankov, Binhang Yuan, Daniel Bourgeois, Chris Jermaine

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Databases (cs.DB)

[16] arXiv:2306.00119 [pdf, html, other]

Title: Optimal Sets and Solution Paths of ReLU Networks

Aaron Mishkin, Mert Pilanci

Comments: Minor updates and corrections to clarify the role of merge/split symmetries in formation of ReLU optimal set and add missing sufficient conditions for all minimal models to have the same cardinality

Journal-ref: Proceedings of the 40th International Conference on Machine Learning, PMLR 202:24888-24924, 2023

Subjects: Machine Learning (cs.LG)

[17] arXiv:2306.00127 [pdf, other]

Title: Surrogate Model Extension (SME): A Fast and Accurate Weight Update Attack on Federated Learning

Junyi Zhu, Ruicong Yao, Matthew B. Blaschko

Comments: Accepted at ICML 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[18] arXiv:2306.00144 [pdf, other]

Title: Mechanic: A Learning Rate Tuner

Ashok Cutkosky, Aaron Defazio, Harsh Mehta

Subjects: Machine Learning (cs.LG)

[19] arXiv:2306.00148 [pdf, other]

Title: SafeDiffuser: Safe Planning with Diffusion Probabilistic Models

Wei Xiao, Tsun-Hsuan Wang, Chuang Gan, Daniela Rus

Comments: 19 pages, website: this https URL

Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Systems and Control (eess.SY)

[20] arXiv:2306.00152 [pdf, other]

Title: Learning the Right Layers: a Data-Driven Layer-Aggregation Strategy for Semi-Supervised Learning on Multilayer Graphs

Sara Venturini, Andrea Cristofari, Francesco Rinaldi, Francesco Tudisco

Subjects: Machine Learning (cs.LG)

[21] arXiv:2306.00153 [pdf, other]

Title: Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health

Jennifer J. Schnur, Nitesh V. Chawla

Journal-ref: Information Fusion (2022)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Symbolic Computation (cs.SC)

[22] arXiv:2306.00169 [pdf, other]

Title: Inconsistency, Instability, and Generalization Gap of Deep Neural Network Training

Rie Johnson, Tong Zhang

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG)

[23] arXiv:2306.00172 [pdf, other]

Title: Learning for Edge-Weighted Online Bipartite Matching with Robustness Guarantees

Pengfei Li, Jianyi Yang, Shaolei Ren

Comments: Accepted by ICML 2023

Subjects: Machine Learning (cs.LG)

[24] arXiv:2306.00183 [pdf, other]

Title: Diffused Redundancy in Pre-trained Representations

Vedant Nanda, Till Speicher, John P. Dickerson, Soheil Feizi, Krishna P. Gummadi, Adrian Weller

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[25] arXiv:2306.00188 [pdf, other]

Title: Multi-environment lifelong deep reinforcement learning for medical imaging

Guangyao Zheng, Shuhao Lai, Vladimir Braverman, Michael A. Jacobs, Vishwa S. Parekh

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

[26] arXiv:2306.00196 [pdf, other]

Title: Restless Bandits with Average Reward: Breaking the Uniform Global Attractor Assumption

Yige Hong, Qiaomin Xie, Yudong Chen, Weina Wang

Comments: NeurIPS 2023. 35 pages, 8 figures

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Machine Learning (stat.ML)

[27] arXiv:2306.00201 [pdf, other]

Title: Generalized Implicit Follow-The-Regularized-Leader

Keyi Chen, Francesco Orabona

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[28] arXiv:2306.00204 [pdf, other]

Title: Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Yan Pan, Yuanzhi Li

Comments: 37 pages, 16 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[29] arXiv:2306.00206 [pdf, html, other]

Title: Quantifying Representation Reliability in Self-Supervised Learning Models

Young-Jin Park, Hao Wang, Shervin Ardeshir, Navid Azizan

Comments: Presented in UAI 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[30] arXiv:2306.00212 [pdf, other]

Title: Provably Efficient Generalized Lagrangian Policy Optimization for Safe Multi-Agent Reinforcement Learning

Dongsheng Ding, Xiaohan Wei, Zhuoran Yang, Zhaoran Wang, Mihailo R. Jovanović

Comments: 59 pages, a full version of the main paper in the 5th Annual Conference on Learning for Dynamics and Control

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Systems and Control (eess.SY); Optimization and Control (math.OC)

[31] arXiv:2306.00245 [pdf, html, other]

Title: From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces

Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

[32] arXiv:2306.00256 [pdf, other]

Title: DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm

Lisang Ding, Kexin Jin, Bicheng Ying, Kun Yuan, Wotao Yin

Subjects: Machine Learning (cs.LG)

[33] arXiv:2306.00258 [pdf, other]

Title: Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behavior

Shashank Subramanian, Peter Harrington, Kurt Keutzer, Wahid Bhimji, Dmitriy Morozov, Michael Mahoney, Amir Gholami

Comments: 16 pages, 11 figures

Journal-ref: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)

[34] arXiv:2306.00265 [pdf, other]

Title: Doubly Robust Self-Training

Banghua Zhu, Mingyu Ding, Philip Jacobson, Ming Wu, Wei Zhan, Michael Jordan, Jiantao Jiao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[35] arXiv:2306.00267 [pdf, other]

Title: Provable Benefit of Mixup for Finding Optimal Decision Boundaries

Junsoo Oh, Chulhee Yun

Comments: ICML 2023 camera-ready version; 48 pages

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[36] arXiv:2306.00280 [pdf, other]

Title: Towards Bias Correction of FedAvg over Nonuniform and Time-Varying Communications

Ming Xiang, Stratis Ioannidis, Edmund Yeh, Carlee Joe-Wong, Lili Su

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[37] arXiv:2306.00281 [pdf, other]

Title: Transfer Learning for Underrepresented Music Generation

Anahita Doosti, Matthew Guzdial

Comments: 5 pages, 3 figures, International Conference on Computational Creativity

Journal-ref: Proceedings of the 2023 International Conference on Computational Creativity

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[38] arXiv:2306.00288 [pdf, other]

Title: Training-free Neural Architecture Search for RNNs and Transformers

Aaron Serianni (Princeton University), Jugal Kalita (University of Colorado at Colorado Springs)

Comments: Code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[39] arXiv:2306.00297 [pdf, other]

Title: Transformers learn to implement preconditioned gradient descent for in-context learning

Kwangjun Ahn, Xiang Cheng, Hadi Daneshmand, Suvrit Sra

Comments: Improved presentation and added new results for the nonlinear activation case; 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Journal-ref: 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[40] arXiv:2306.00301 [pdf, other]

Title: CapText: Large Language Model-based Caption Generation From Image Context and Description

Shinjini Ghosh, Sagnik Anupam

Comments: Update 6/6/23: Fixed typographic error in abstract

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[41] arXiv:2306.00315 [pdf, other]

Title: Explicit Feature Interaction-aware Uplift Network for Online Marketing

Dugang Liu, Xing Tang, Han Gao, Fuyuan Lyu, Xiuqiang He

Comments: Accepted by SIGKDD 2023 Applied Data Science Track

Subjects: Machine Learning (cs.LG); Information Retrieval (cs.IR)

[42] arXiv:2306.00317 [pdf, html, other]

Title: FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization

Jung Hyun Lee, Jeonghoon Kim, Se Jung Kwon, Dongsoo Lee

Comments: Accepted to ICML 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[43] arXiv:2306.00321 [pdf, html, other]

Title: Improving Offline RL by Blending Heuristics

Sinong Geng, Aldo Pacchiano, Andrey Kolobov, Ching-An Cheng

Subjects: Machine Learning (cs.LG)

[44] arXiv:2306.00324 [pdf, other]

Title: Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning

Peizhong Ju, Arnob Ghosh, Ness B. Shroff

Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[45] arXiv:2306.00338 [pdf, other]

Title: Last Switch Dependent Bandits with Monotone Payoff Functions

Ayoub Foussoul, Vineet Goyal, Orestis Papadigenopoulos, Assaf Zeevi

Comments: Accepted to the 40th International Conference on Machine Learning (ICML 2023)

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS)

[46] arXiv:2306.00342 [pdf, other]

Title: Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks

Dan Zhao

Journal-ref: Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 3024--3038

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[47] arXiv:2306.00344 [pdf, html, other]

Title: BOtied: Multi-objective Bayesian optimization with tied multivariate ranks

Ji Won Park, Nataša Tagasovska, Michael Maser, Stephen Ra, Kyunghyun Cho

Comments: 12 pages (+9 appendix), 13 figures. Accepted at ICML 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[48] arXiv:2306.00352 [pdf, other]

Title: Improving Energy Conserving Descent for Machine Learning: Theory and Practice

G. Bruno De Luca, Alice Gatti, Eva Silverstein

Comments: 15 pages + appendices, full code available

Subjects: Machine Learning (cs.LG); Instrumentation and Methods for Astrophysics (astro-ph.IM); High Energy Physics - Theory (hep-th); Optimization and Control (math.OC); Machine Learning (stat.ML)

[49] arXiv:2306.00356 [pdf, other]

Title: Regularizing Towards Soft Equivariance Under Mixed Symmetries

Hyunsu Kim, Hyungi Lee, Hongseok Yang, Juho Lee

Comments: Proceedings of the International Conference on Machine Learning (ICML), 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[50] arXiv:2306.00367 [pdf, other]

Title: On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularization

Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji, Stefano Ermon

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST)