Publications
Detailed Information
Grounding Counterfactual Explanation of Image Classifiers to Textual Concept Space
Cited 0 time in
Web of Science
Cited 3 time in Scopus
- Authors
- Issue Date
- 2023-06
- Publisher
- Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
- Citation
- Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.2023-June, pp.10942-10950
- Abstract
- Concept-based explanation aims to provide concise and human-understandable explanations of an image classifier. However, existing concept-based explanation methods typically require a significant amount of manually collected concept-annotated images. This is costly and runs the risk of human biases being involved in the explanation. In this paper, we propose Counterfactual explanation with text-driven concepts (CounTEX), where the concepts are defined only from text by leveraging a pre-trained multimodal joint embedding space without additional concept-annotated datasets. A conceptual counterfactual explanation is generated with text-driven concepts. To utilize the text-driven concepts defined in the joint embedding space to interpret target classifier outcome, we present a novel projection scheme for mapping the two spaces with a simple yet effective implementation. We show that CounTEX generates faithful explanations that provide a semantic understanding of model decision rationale robust to human bias.
- ISSN
- 1063-6919
- Files in This Item:
- There are no files associated with this item.
Related Researcher
- College of Engineering
- Department of Electrical and Computer Engineering
Item View & Download Count
Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.