SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape.

Hua Zheng Kuang-Hung Liu Igor Fedorov Xin Zhang Wen-Yen Chen Wei Wen

Published in: CoRR (2023)

Keyphrases

information theory
information geometry
information theoretic
jensen shannon divergence
statistical learning
statistical mechanics
conditional entropy
shannon entropy
statistical physics
kullback leibler divergence
mdl principle
rate distortion theory
mutual information
graphical models