Video AI Science, Self-Supervised Learning Self-Supervised Learning | Self-supervision for Learning from the Bottom Up by Alexei A. Efros
Video AI Science, Self-Supervised Learning Self-Supervised Learning | Curiosity Driven Exploration by Self-Supervised Prediction
Video Transformer Architecture Self-Attention with Relative Position Representations – Paper explained
Video Transformer Architecture Adding vs. concatenating positional embeddings & Learned positional encodings
Video Transformer Architecture Positional embeddings in transformers EXPLAINED | Demystifying positional encodings.
Video AI Science, Self-Supervised Learning Self-supervised learning in Computer Vision with Yann LeCun, Alfredo Canziani, Ishan Misra
Video Transformer Architecture Charformer: Fast Character Transformers via Gradient-based Subword Tokenization +Tokenizer explained