Self-Supervised Learning

Machine Learning Deep Learning

Overview

Contrastive learning, masked prediction, and other self-supervised approaches.

Vision

Joint-Embedding (a.k.a., Multi-View) SSL

• Overview
• Methods
  • Alignment & Uniformity
  • BYOL
  • Decoupled Uniformity
  • InfoNCE
  • Maximum Manifold Capacity Representations
  • ReLIC
  • ReLICv2
  • SimCLR
  • SimSiam
  • SwAV
• Connection to Information Theory

Language

Audio