I take a closer look at “Supermasks in Superposition” after I’ve already done a video on it. Specifically, I look at: 1. The intuition and theoretical justification behind the G objective, 2. Whether Supermasks and Superposition can be viewed as two distinct ideas and 3. The Paper’s Broader Impact Statement.
OUTLINE:
0:00 – Intro & Overview
2:00 – SupSup Recap
4:00 – In-Depth Analysis of the G Objective
20:30 – Superposition without Supermasks
25:40 – Broader Impact Statement
36:40 – Conclusion
37:20 – Live Coding
Part 1 on SupSup:
My Code:
Paper:
Links:
YouTube:
Twitter:
Discord:
BitChute:
Minds:
Parler:
source