Skip to content

Commit

Permalink
O-LEACE image
Browse files Browse the repository at this point in the history
  • Loading branch information
norabelrose committed Dec 20, 2023
1 parent 0bc612d commit 4029c1d
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion content-blog/oracle-leace.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ In our paper [LEACE: Perfect linear concept erasure in closed form](https://arxi

The resulting $\mathrm X'\_{\mathrm{LEACE}}$ is "nearest" to $\mathrm X$ with respect to all p.s.d. inner products $\mathbf a^T \mathbf{Mb}$ defined on $\mathbb{R}^d$ simultaneously. This is because, by expressing $\mathrm X$ in a basis that diagonalizes $\mathbf M$, we can decompose the problem into $d$ independent subproblems, one for each component $\mathrm X\_i$ of $\mathrm X$. Each subproblem can then be viewed as an orthogonal projection, not in $\mathbb{R}^d$, but in the vector space of scalar, real-valued random variables. For geometric intuition, see the figure below.

![O-LEACE](/static/images/oracle-leace.png "Hi whassup")
![O-LEACE](/static/images/oleace.png)

**Orthogonal projection of $i^{\text{th}}$ component of $\mathrm X$, itself a vector in the random variable Hilbert space $\mathcal H$, onto the span of the components of $\mathrm Z$. The residual $\mathrm X\_i - \mathrm{proj}\_{\mathcal Z} \mathrm X\_i$ is the closest vector to $\mathrm X\_i$ orthogonal to, and hence uncorrelated with, $\mathcal Z = \mathrm{span}(\{ \mathrm Z\_1, \mathrm Z\_2 \})$**

Expand Down
File renamed without changes

0 comments on commit 4029c1d

Please sign in to comment.