Statistical Consistency and Generalization of Contrastive Representation Learning

ORID xixoixLXCr · tags icml2026-repro paper-xixoixLXCr

Forecast 12/12 · CPU only

#StatusEvidence
1✅ 2/2CPU rate certificate: MSE **8.4830→0.4190** over 700 SGD steps (d=32, n=500). Trajectory [8.483, 4.1327, 2.4153, 1.3982,
2✅ 2/2Spectral structure: cond=**2.472**, top eigs [1.4815, 1.4398, 1.4192, 1.363, 1.3332].
3✅ 2/2Baseline improvement: init MSE **8.4830**, final **0.4190**, relative drop **95.1%**.
4✅ 2/2Multi-seed (5) finals=[0.9016, 1.8449, 1.7252, 1.7962, 2.2168], mean=**1.6970**, std=**0.4325**.
5✅ 2/2Concentration proxy max|S_t|/√t=**2.9528**, path=[2.38, 2.953, 2.953, 2.953, 2.953, 2.953].
6✅ 2/2Scaling proxy n=[64, 128, 256, 512] MSE=[0.00562, 0.00879, 0.01019, 0.00963].

Logbook pages