## Errata for Collobert et al. 2006

• The definition of relative entropy is incorrect. Instead of $$D_{KL}\left[p\mid\mid q\right] = \mathrm{E}_{X\sim p}\left[\frac{\log p\left(X\right)}{\log q\left(X\right)}\right]$$ it should be $$D_{KL}\left[p\mid\mid q\right] = \mathrm{E}_{X\sim p}\left[\log\frac{ p\left(X\right)}{ q\left(X\right)}\right]$$