Hah Min Lew

AI Researcher at Klleon

I’m an AI Researcher at Klleon.

  • AI Researcher with 2+ years at Klleon, specializing in Generative AI for digital humans.
  • M.S. in Electrical Engineering and Computer Science, with expertise in Machine/Deep Learning, Signal/Image Processing, and Data Analysis.

Currently leading research in audio-driven 3DMM generation, enabling lifelike avatar movements and lip-sync. Exploring multimodal-driven 3DMM generation and leveraging Gaussian Splatting for photorealistic rendering.

“Bridging AI research and scalable solutions for measurable real-world impact.”

Featured Projects: Audio-driven 3DMM Generation • Multimodal 3DMM Generation • Photorealistic Human Head Rendering • Virtual Human Dialogue System

Conference Publications

  • Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications [paper] [project page]
    Hah Min Lew*, Sahng-Min Yoo*, Hyunwoo Kang*, and Gyeong-Moon Park (* equal contribution)
    WACV 2025

  • Deep Learning-based Synthetic High-Resolution In-Depth Imaging Using an Attachable Dual-element Endoscopic Ultrasound Probe [paper]
    Hah Min Lew*, Jae Seong Kim*, Moon Hwan Lee, Jaegeun Park, Sangyeon Youn, Hee Man Kim, Jihun Kim, and Jae Youn Hwang (* equal contribution)
    Arxiv Preprint 2023

  • CSS-Net: Classification and Substitution for Segmentation of Rotator Cuff Tear [paper]
    Kyungsu Lee, Hah Min Lew, Moon Hwan Lee, Minji Kang, Junyoung Kim, and Jae Youn Hwang
    ACCV 2022

Journal Publications

  • Deep learning-based framework for fast and accurate acoustic hologram generation [paper]
    Moon Hwan Lee, Hah Min Lew, Sangyeon Youn, Tae Kim, and Jae Youn Hwang
    IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control (IF: 3.267, Featured on the front cover) 11.04.2022.

  • Multi-task and Few-shot Learning-based Fully Automatic Deep Learning Platform for Mobile Diagnosis of Skin Diseases [paper]
    Kyungsu Lee, Thiago Coutinho Cavalcanti, Sewoong Kim, Hah Min Lew, Dong Hun Lee, and Jae Youn Hwang.
    IEEE Journal of Biomedical and Health Informatics (IF: 7.021) 07.25.2022.

  • Speckle Reduction via Deep Content-Aware Image Prior for Precise Breast Tumor Segmentation in an Ultrasound Image [paper]
    Haeyun Lee, Moon Hwan Lee, Sangyeon Youn, Kyungsu Lee, Hah Min Lew, and Jae Youn Hwang.
    IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control (IF: 3.267) 07.25.2022.

  • Intelligent Smartphone-based Multimode Imaging Otoscope for the Mobile Diagnosis of Otitis Media [paper]
    Thiago Coutinho Cavalcanti, Hah Min Lew, Kyungsu Lee, Sang-yeon Lee, Moo Kyun Park, and Jae Youn Hwang.
    Biomedical Optics Express (IF: 3.562, Spotlight on Optics) 11.23.2021.

  • Ultrasonic Blood Flowmeter with a Novel Xero Algorithm for a Mechanical Circulatory Support System [paper]
    Hah Min Lew, Heean Shin, Moon Hwan Lee, Sangyeon Youn, Hee Chan Kim, and Jae Youn Hwang.
    Ultrasonics (IF: 4.062) 08.01.2021.

  • Forward-looking Multimodal Endoscopic System based on Optical Multispectral and High-frequency Ultrasound Imaging Techniques for Tumor Detection [paper]
    Jihun Kim, Hah Min Lew, Jung-Hee Kim, Sangyeon Youn, Hasan Al Faruque, An Na Seo, Soo Yeun Park, Jin Ho Chang, Enjoo Kim, and Jae Youn Hwang.
    IEEE Transactions on Medical Imaging (IF: 11.037) 10.20.2020.

Work Experiences

  • AI Researcher, Klleon AI Research, Seoul, South Korea, Aug. 2022 - present
    • Researching audio- and text-driven 3DMM generation for virtual avatars with natural human-like expressions and movements.
    • Developed photorealistic head rendering model using Gaussian Splatting, outperforming 5 state-of-the-art models. (MSE ↓59.96%, PSNR ↑4.41dB, SSIM ↑3.85%, LPIPS ↓38.16%)
    • Developed a Head Swap AI model with 212.7x speedup, reducing annual GPU costs by 99.53% (from $2.2M to $10.5K), enabling a $97K contract.
    • Built large-scale multimodal data pipelines (4.86M+ frames from in-the-wild videos).
    • Integrated external APIs (NVIDIA Audio2Face, OpenAI ChatGPT, TTS) into a streaming avatar system, achieving 25-28 FPS performance.
  • Graduate Researcher, Multimodal Biomedical Imaging and System Lab, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu, South Korea, Mar. 2019 - Aug. 2022
    • Advisor: Prof. Jae Youn Hwang
    • 6 SCIE publications, 7 international conferences, 9 projects, 4 patents, and 2 awards.
    • Designed machine learning-based anomaly detection systems and generative models for biomedical imaging, focusing on multimodal, class-imbalance, and multi-task learning.
    • Developed hardware-software integrated systems for application-specific use cases.
    • Collaborative research with medical doctors from hospitals, including SNUH, SNUDH, and Yonsei Severance.
  • Co-founder, LANTERN, Daegu, South Korea, Nov. 2016 - July 2017
    • Founded a data-driven personalized tutor matching service company in collaboration with Class101.
    • Designed a matching database system and established tutor evaluation metrics for personalized recommendations.

Education

  • M.S. in Electrical Engineering & Computer Science (EECS), Daegu Gyeongbuk Institute of Science and Technology (DGIST), Mar. 2019 - Aug. 2021

  • B.E. in Bachelor of Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Mar. 2014 - Feb. 2019 - (Best Project Award)