Yeong-Joon Ju

🎓 Affiliation: Pattern Recognition and Machine Learning Lab in Korea University (2020~)

I'm researching efficient and effective in-context augmentation for multimodal large language models (MLLMs).

Research direction: face generation (vision) $\rightarrow$ dialogue generation (NLP) $\rightarrow$ neural network debugging (XAI) $\rightarrow$ 🌞 language modeling for multimodalities (NLP)

• "Neuron-based Debugging Framework for Neural Networks Using Class-conditional Visualizations", arXiv, 2023. | code

  Authors: Y-J. Ju, J-H. Park, and S-W. Lee

  History -> NeurIPS 2023: rejected - 3 borderline accept and 1 reject

• "Class-conditional Feature Visualizations in Realistic Image Space for Neuron-based Debugging", KCC XAI Workshop, 2024 (oral).

  Authors: Y-J. Ju, J-H. Park, and S-W. Lee

  Oral speaker: Yeong-Joon Ju

• "Complete Face Recovery GAN: Unsupervised Joint Face Rotation and De-Occlusion from a Single-View Image", WACV, 2022. | code

  Authors: Y-J. Ju, G-H. Lee, J-H. Hong, and S-W. Lee

• "CPR: Mitigating Large Language Model Hallucinations with Curative Prompt Refinement", SMC, 2024.

  Authors: J-W. Shim, Y-J. Ju, J-H. Park, and S-W. Lee

• "CIRF: Importance of Related Features for Plausible Counterfactual Explanations", Information Sciences, 2024.

  Authors: H-D. Kim, Y-J. Ju, J-H. Hong, and S-W. Lee

• "Explaining Generative Diffusion Models via Visual Analysis for Interpretable Decision-Making Process", Expert Systems with Applications, 2024. | code

  Authors: J-H. Park, Y-J. Ju, and S-W. Lee

• "Enhancing Robustness of Over-Parameterized Models via Feature Reweighting Using Logit-Wise Mixup", ICPRAI, 2024 (oral).

  Authors: W-S. Jo, Y-J. Ju, and S-W. Lee

  Oral speaker: Yeong-Joon Ju

• "Compensatory Debiasing for Gender Imbalances in Language Models", ICASSP, 2023 (oral). | code

  Authors: T-J. Woo, W-J. Nam, Y-J. Ju, and S-W. Lee

  Oral speaker: Yeong-Joon Ju

• Research on AI-based large-scale language modeling techniques for Military-related topic (hidden), Agency for Defense Development (ADD, 국방과학연구소), Korea (Aug. 2023 ~ Nov. 2023) Team leader (practitioner)

• Development of an AI assistant for elementary education teacher based on a large language model (LLM), i-Scream Edu (아이스크림에듀), Korea (May 2023 ~ Jan. 2024) Team leader (practitioner)

  Research of LLM for NLG

• Development of Artificial Intelligence Technology for Personalized Plug-and-Play Explanation and Verification of Explanation, Institute of Information & communications Technology Planning & Evaluation (IITP), Korea (Jun. 2022 ~ Dec. 2023) Team leader (practitioner)

  Research of plug-and-play debugging for the decision-making process of neural networks

• Development of facial skin change analysis and visualization techniques, Samsung Electronics (삼성전자), Korea (Jun. 2020 ~ Jun. 2021)

  Research of facial dense alignment technique based on optical flow

• Reviewer at IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024

• Grand Prize in The 6th SW·AI Hackerton, Sejong University, Korea (Jul. 2019)

  Project: Android application that manages seat status for discussion lounge / Development of seat status detection model and API based on Flask (Jul. 2019 ~ Jul. 2019)

• Grand Prize in The 7th Creative Design Competition, Sejong University, Korea (Jun. 2019)

  Project: Web application that automatically blurs out license plates and faces / Development of web application based on React.js, detection models, and API. (Mar. 2019 ~ Jun. 2019)