Information Content Regularization
Definition
Regularization approach preventing encoder collapse by maintaining information in encoded features; enforces that the covariance matrix of representations across a batch approaches identity, ensuring each dimension is individually informative (high variance) and independent (zero correlation).
Cast within
No topic-region cast yet — this appears once Information Content Regularization's compiled claims are aligned into a topic region's argument tree.
Claims mentioning Information Content Regularization (1)
Your notes
Loading notes...