Training joint embedding architectures requires ensuring that the energy function (divergence measure between predicted and target representations) is low on the training data manifold but high outside it, which can be achieved through two classes of methods: contrastive methods (explicitly pushing negative samples up) and regularized methods (constraining the manifold volume using regularizers like correlation or covariance penalties).
factualpending
Speaker
Yann LeCunEvidence Quote
“we need to train those systems and we need to figure out how to train those jepa architectures and tells that to not be completely trivial because you need to train the the cost function in this JEA architecture that measures the the Divergence between the representation of Y and the predicted representation of Y we need this to be low on the training data but we need also needed to be large outside the training set okay so this is you know this kind of energy function here that has kind of uh Contours of equal equal energy we need to make sure the energy is high outside of the manifold of data and I only know two classes of methods for this one set of method is called contrastive it consists in um having uh data points which are those those blue dark blue dots pushing the down the energy of those and then generating you know those flashing green dots and then pushing the energy up”
Created: 8/11/2026, 7:11:43 AM
Your notes
Loading notes...