Not quite sure what to do with this incredible and no-longer-appropriate-for-promotions band photo, but wow, what a time capsule.
- InfoNCE Explained | Papers With Code
- Contrastive Representation Learning | Lil'Log
- Lei Maoβs Log Book, Noise Contrastive Estimation
References
Balestriero, Randall, Mark Ibrahim, Vlad Sobal, Ari Morcos, Shashank Shekhar, Tom Goldstein, Florian Bordes, et al. 2023. βA Cookbook of Self-Supervised Learning.β arXiv.
Chehab, Omar, Alexandre Gramfort, and Aapo Hyvarinen. 2022. βThe Optimal Noise in Noise-Contrastive Learning Is Not What You Think.β arXiv:2203.01110 [Cs, Stat], March.
Gutmann, Michael U., and Aapo HyvΓ€rinen. 2012. βNoise-Contrastive Estimation of Unnormalized Statistical Models, with Applications to Natural Image Statistics.β Journal of Machine Learning Research 13 (11): 307β61.
Gutmann, Michael, and Aapo Hyvarinen. n.d. βNoise-Contrastive Estimation: A New Estimation Principle for Unnormalized Statistical Models,β 8.
Hinton, Geoffrey E. 2002. βTraining Products of Experts by Minimizing Contrastive Divergence.β Neural Computation 14 (8): 1771β1800.
Le-Khac, Phuc H., Graham Healy, and Alan F. Smeaton. 2020. βContrastive Representation Learning: A Framework and Review.β IEEE Access 8: 193907β34.
Ma, Zhuang, and Michael Collins. 2018. βNoise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency.β arXiv:1809.01812 [Cs, Stat], September.
Miller, Benjamin Kurt, Christoph Weniger, and Patrick ForrΓ©. 2022. βContrastive Neural Ratio Estimation.β In.
Oord, Aaron van den, Yazhe Li, and Oriol Vinyals. 2019. βRepresentation Learning with Contrastive Predictive Coding.β arXiv.
Saunshi, Nikunj, Jordan Ash, Surbhi Goel, Dipendra Misra, Cyril Zhang, Sanjeev Arora, Sham Kakade, and Akshay Krishnamurthy. 2022. βUnderstanding Contrastive Learning Requires Incorporating Inductive Biases.β arXiv:2202.14037 [Cs], February.
Smith, Noah A., and Jason Eisner. 2005. βContrastive Estimation: Training Log-Linear Models on Unlabeled Data.β In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL β05, 354β62. Ann Arbor, Michigan: Association for Computational Linguistics.
Zhang, Yifei, Hao Zhu, Zixing Song, Piotr Koniusz, and Irwin King. 2022. βCOSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learning.β In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2524β34. Washington DC USA: ACM.
Zhu, Hao, Ke Sun, and Piotr Koniusz. 2022. βContrastive Laplacian Eigenmaps.β arXiv.
No comments yet. Why not leave one?