Expert-Rule-Augmented Machine Learning for Autonomous Controllability Evaluation of Power Equipment with Missing Data
Kai Liu, Mengyue Zhang, Zengchao Wang, Wangsong Wu, Hanhua Luo, Yanpeng Hao, Yuan La, Xiaoguo Chen, Fuzeng Zhang
To address the challenges of quantifying expert experience, handling missing data, and managing class imbalance in evaluating the autonomous controllability of power equipment, this paper proposes a quantitative evaluation method that integrates expert prior rules with machine learning. First, building upon a five-dimensional evaluation indicator system, expert decision logic—including dimension-average threshold judgments, multi-dimensional weakness-based cumulative downgrading mechanisms, and key sub-item interaction rules—is formalized into a 15-dimensional rule prior feature vector, which is concatenated with the original 21-dimensional raw indicators to construct a RAW + RULE augmented feature space. Second, a KNN algorithm is employed for missing value imputation, while cost-sensitive learning combined with the SMOTE is adopted in a dual-path parallel scheme to address class imbalance. Six machine learning models are evaluated and compared via 30 repeated stratified cross-validations on a real-world dataset of 97 high-voltage bushing suppliers. Experimental results show that, on complete datasets, the RAW + RULE configuration with the Random Forest model achieves a mean test accuracy of 0.936 and a Kappa of 0.938, substantially outperforming the pure raw-feature model (accuracy 0.769, Kappa 0.766). Under weighted random missingness ranging from 10% to 50%, the RAW + RULE configuration demonstrates superior robustness, with ensemble tree models maintaining mean accuracies of 0.614–0.636 even at a 50% missing rate. This study provides a practically deployable technical solution and methodological reference for the quantitative assessment of autonomous controllability levels and early security warning in the power equipment supply chain.