Curriculum Vitae

Shih-Fang Chen

Computer Vision & Machine Learning Researcher and Engineer

Ph.D. in Computer Science. My work focuses on robust, adaptive, and generalizable visual perception, spanning multimodal learning, spatial intelligence, video understanding, and vision foundation models. My experience combines end-to-end machine learning research with the development and deployment of production vision systems.

Selected First-Author Publications

Improving Visual Object Tracking Through Visual Prompting (PiVOT)

Shih-Fang Chen, Jun-Cheng Chen, I-Hong Jhuo, Yen-Yu Lin

IEEE Transactions on Multimedia (TMM)

Designed, developed, and open-sourced an automated visual prompting system for visual/video perception, leveraging CLIP contrastive knowledge for test-time target–distractor discrimination and adaptation.

2025

Peer Review

Peer Reviewer

Reviewed 40+ manuscripts, assessing originality, methodological soundness, and empirical validity.

  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • International Conference on Learning Representations (ICLR)
  • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
2025–Present

Patented Technologies

Intelligent Logistics Data Collection System

Developed and deployed an industrial computer vision system using image restoration and semantic segmentation for stacked-substrate measurement.

Invention patent: TWI802843B (2023)
Utility model patent: TW M615811 (2021)

2021 / 2023

Research & Engineering Experience

Computer Vision & Machine Learning Researcher

NYCU / Academia Sinica · Ph.D. research fellowship

  • Led end-to-end research in adaptive video perception, from problem formulation and model design to implementation, training, evaluation, and open-source release.
  • Developed methods for multimodal learning, self-supervised pretraining, online model editing, and automated visual prompting.
  • Built scalable training pipelines using PEFT, distributed training, activation checkpointing, and mixed precision for 20M+ training samples under limited compute resources.
  • Evaluated robustness and generalization on 1M+ test video samples across seven public benchmarks; analyzed training dynamics, inference behavior, and failure modes.
  • Published three first-author papers at ICLR, IEEE TCSVT, and IEEE TMM as the sole student author, and discussed progress with researchers at NYCU, Academia Sinica, and Microsoft AI.
2021–2026

HPC GPU System Administrator

Vision and Learning Lab, NYCU

Administered 10 GPU servers supporting 30 users, overseeing deployment and operations while coordinating shared compute resources across concurrent research projects.

2021–2026

Research Assistant, Computer Vision

Department of Electrical Engineering, Yuan Ze University · Full-time

  • Led development of real-time vision applications as the sole vision-system developer, including 3D interaction, pose training, pitching analysis, and banknote reconstruction.
  • Built and deployed NVIDIA edge systems using depth estimation, pose estimation, motion analysis, and image reconstruction; delivered systems to industry partners and contributed to patented technologies and CVGIP research.
2020–2021

Graduate Student Researcher, Machine Vision

Department of Computer Science, Yuan Ze University · M.S. industry–academia research

  • Owned end-to-end vision system development, translating industry requirements into research prototypes and production-ready systems.
  • Designed and deployed a PCB stacked-substrate counting and measurement system, automating manual inspection, reducing annual operating costs, and contributing to patents.
2018–2020

Computer Vision Project Lead & Developer

Department of Computer Science, Chaoyang University of Technology

Led an undergraduate team to develop a vision-based autonomous drone for disaster monitoring, receiving a Bronze Award at the Ministry of Education Creative Software Applications Contest.

2013–2017

Team Lead & Programmer, Autonomous Robotics

National LoTung Industrial Vocational High School

Led a student team to develop an autonomous robot and its perception and decision logic, earning first place at the World Robot Olympiad Taipei regional competition.

2011–2013

Research Interests & Technical Skills

Research interests

Visual perception, multimodal learning, spatial intelligence, post-training, video understanding, foundation models, object and point tracking.

Model development & adaptation

Model architecture design, self-supervised learning, parameter-efficient fine-tuning (PEFT), test-time adaptation, online model editing, visual prompting.

Training & scaling

Distributed training (DP/DDP, DeepSpeed), activation checkpointing, mixed-precision training.

Performance & evaluation

GPU memory optimization, performance profiling, model benchmarking.

ML & vision tools

PyTorch, NumPy, OpenCV.

Programming

Python (primary), C++, C, Bash.

Systems & infrastructure

Linux, Git, GPU cluster administration.

Selected Fellowships & Honors

Ph.D. Fellowships

Academia Sinica; Foxconn–NYCU.

2021–2026

Travel Grants

FAOS; National Science and Technology Council (NSTC); International Conference on Learning Representations (ICLR).

2021–2026

Phi Tau Phi Honor Society

Honorary member.

2020

Education

National Yang Ming Chiao Tung University

Ph.D. in Computer Science

Coursework GPA: 4.24 / 4.3 · Dissertation GPA: 4.3 / 4.3

  • Published first-author papers at leading machine learning and computer vision venues.
  • Fellowships: Academia Sinica, Foxconn–NYCU. Travel grants: FAOS, NSTC, ICLR.
  • Dissertation: Rethinking Generic Object Tracking Toward Human-Level Perceptual Intelligence.
  • Advisor: Yen-Yu Lin (NYCU). Co-advisors: Jun-Cheng Chen (Academia Sinica), I-Hong Jhuo (Microsoft AI).
2021–2026

Yuan Ze University

M.S. in Computer Science

GPA: 4.0 / 4.0

  • Conducted industry-collaborative research as the sole software developer, delivering a patented computer vision system into production and generating substantial annual cost savings.
  • Ranked first in the graduating class and inducted into the Phi Tau Phi Honor Society.
  • Advisor: Ting-Ying Chien.
2018–2020

Chaoyang University of Technology

B.S. in Computer Science

First place in the Computer Science project competition

  • Led an award-winning drone project, receiving a Bronze Award from Taiwan's Ministry of Education and presenting the work at the AIT 2017 conference.
  • Received a full scholarship for an academic exchange in Australia and the school-wide City Government Honors Student Award.
  • Later led a 17-member team across departments in a university-wide exhibition.
2013–2017

National LoTung Industrial Vocational High School

High School Diploma, Department of Computer Science

Led a team while developing autonomous robot software, winning first place at the World Robot Olympiad Taipei regional competition.

2011–2013