D-CRISP: explaining object detectors by combining randomized and segment-based perturbations

Cargando...
Miniatura
Fecha
2025-10-21
Título de la revista
ISSN de la revista
Título del volumen
Editor
IOS Press BV
google-scholar
Resumen
Explaining the decisions issued by Machine Learning models for object detection tasks is essential in high-stakes decision making scenarios, such as medical image processing and vehicular perception for autonomous driving. Despite the proliferation of post-hoc perturbation-based methods for generating visual explanations, most eXplainable AI (XAI) approaches rely exclusively on either random image masking or selective segmentation-based occlusion, missing the opportunity to synergistically leverage both strategies in a complementary fashion. In this paper we address this gap by proposing D-CRISP (Detector-Combining Randomized Input and Segment Perturbations), a novel post-hoc explanation method for object detection models. D-CRISP unifies both random and region-based occlusions derived from image segmentation, producing multiscale saliency maps that capture both granular (pixel-level) and semantic (region-level) cues about the objects detected by the model. Experiments on the MS-COCO dataset show that D-CRISP significantly outperforms random-masking approaches in terms of explanation faithfulness and localization, while requiring slightly more computation effort than these methods. At the same time, it achieves comparable or better performance than segmentation-based methods, yet with substantially lower mask generation latencies. These results position D-CRISP as a highly effective and efficient XAI alternative for object detection models, particularly suited for time-constrained applications requiring timely, accurate, and interpretable decisions.
Palabras clave
Descripción
Ponencia presentada en la 28th European Conference on Artificial Intelligence, ECAI, celebrada en Boloña, entre el 25 y el 30 de octubre de 2025
Materias
Cita
Andres, A., & Del Ser, J. (2025). D-CRISP: explaining object detectors by combining randomized and segment-based perturbations. Frontiers in Artificial Intelligence and Applications, 413, 217-224. https://doi.org/10.3233/FAIA250809
Colecciones