LAY world model uses JEPA (Joint Embedding Predictive Architecture) and adds a SIGG regularizer that enforces the learned latent embeddings follow a Gaussian distribution across all directions, ensuring non-collapse and healthy representation learning.
definitionpending
Speaker
Isaac WardEvidence Quote
“basically what they say is over a batch all of those latent embeddings uh should be in a healthy distribution which they describe as a gausian distributed uh distribution in in the latent space and thus enters the sigg regularizer which is the sort of new term they add”
Created: 8/12/2026, 6:25:34 PM
Your notes
Loading notes...