1 claim in “artificial intelligence, deep learning”
The I-JEPA method prevents collapse through momentum-based weight updates—maintaining a second encoder whose weights are an exponential moving average of the primary encoder's weights, which unexpectedly prevents representation collapse, though the theoretical explanation remains incomplete.