International Papers Cost-Stability Evaluation Framework for Reliable Deployment of Object Detectors in Industrial Applications
페이지 정보
작성자 관리자
조회 99회 작성일 25-11-24 11:13
조회 99회 작성일 25-11-24 11:13
본문
| Journal | IEEE Access |
|---|---|
| Name | KUHYUN LEE, JIHOON HONG, BEOM-SEOK KIM, YUNA SONG, and DONG-HEE LEE |
| Year | 2025 |
The practical deployment of object detectors is often hindered by a gap between standard academic metrics and real-world requirements—namely, performance at a specific operating threshold, cost asymmetric errors, and performance stability under distribution shifts. To bridge this gap, we introduce the Cost-Stability Evaluation Framework (CSEF), a systematic workflow that transforms the selection of a model and its operating threshold from a heuristic practice to a rational, data-driven decision process. CSEF operationalizes user-defined requirements—an IoU threshold (τ) for localization accuracy; a cost asymmetry parameter (β) that serves as the recall-to-precision weight in the F-beta score; and a maximum tolerable performance degradation (σreq)—to algorithmically recommend the most operationally reliable model– threshold pair. CSEF first selects the threshold that maximizes the F-beta score on the validation set, and then quantifies robustness as the relative change in the F-beta score, σdeg, from the validation set to an unseen held-out test set. Candidates that pass a conservative stability gate—where the bootstrap upper bound of |σdeg| does not exceed σreq—are then ranked by their operational F-beta score at the fixed threshold. CSEF’s utility is demonstrated across four industrial scenarios, from medical imaging to semiconductor manufacturing, highlighting its adaptability to domain-specific requirements. Ultimately, CSEF provides a practical and auditable methodology for deploying object detectors with predictable performance and reliability, thereby helping close the long-standing gap between academic evaluation and industrial deployment.