Semantic Bottlenecks: Quantifying and Improving Inspectability of Deep Representations

(2020) Semantic Bottlenecks: Quantifying and Improving Inspectability of Deep Representations.

Text 978-3-030-71278-5_2 Download (171kB)

Abstract

Today’s deep learning systems deliver high performance based on end-to-end training but are notoriously hard to inspect. We argue that there are at least two reasons making inspectability challenging: (i) representations are distributed across hundreds of channels and (ii) a unifying metric quantifying inspectability is lacking. In this paper, we address both issues by proposing Semantic Bottlenecks (SB), integrated into pretrained networks, to align channel outputs with individual visual concepts and introduce the model agnostic AUiC metric to measure the alignment. We present a case study on semantic segmentation to demonstrate that SBs improve the AUiC up to four-fold over regular network outputs. We explore two types of SB-layers in this work: while concept-supervised SB-layers (SSB) offer the greatest inspectability, we show that the second type, unsupervised SBs (USB), can match the SSBs by producing one-hot encodings. Importantly, for both SB types, we can recover state of the art segmentation performance despite a drastic dimensionality reduction from 1000s of non aligned channels to 10s of semantics-aligned channels that all downstream results are based on.

Item Type:	Conference or Workshop Item (A Paper) (Paper)
Uncontrolled Keywords:	2020
Divisions:	Mario Fritz (MF)
Conference:	GCPR German Conference on Pattern Recognition
Depositing User:	Mario Fritz
Date Deposited:	18 Feb 2021 11:53
Last Modified:	17 Oct 2022 09:16
Primary Research Area:	NRA1: Trustworthy Information Processing
URI:	https://publications.cispa.saarland/id/eprint/3367

Actions

Actions (login required)

View Item