Knowledge Distillation via Multi-Teacher Feature Ensemble


Knowledge Distillation via Multi-Teacher Feature Ensemble is a scholarly work, published in 2024 in ''IEEE Signal Processing Letters''. The main subjects of the publication include artificial intelligence, feature extraction, computer science, feature, distillation, machine learning, pattern recognition, and fuzzy logic. The authors evaluate the method on the CIFAR-100, ImageNet and MS-COCO datasets, and the experimental results demonstrate its effectiveness.