Intereting Posts

Among all shapes with the same area, a circle has the shortest perimeter
A Wi-Fi password hidden in statistics expression
Integrating squared absolute value of a complex sequence
Prove by induction Fibonacci equality
Prove that $\mathcal{O}_3$ and $\mathcal{O}_7$ are euclidean domains
Integrating $e^{a/x^2-x^2}/(1-e^{b/x^2})$
Finite Extensions and Bases
Upper bounds on the size of $\operatorname{Aut}(G)$
How many different ways can a number N be expressed as a sum of K different positive integers?
How to prove $\sum_{i=1}^k(\frac{1}{\alpha_i}\prod_{j\neq i}^k\frac{\alpha_j}{\alpha_j-\alpha_i})=\sum_{i=1}^k\frac{1}{\alpha_i}$?
Borel $\sigma$ algebra on a topological subspace.
Bounded (from below) continuous local martingale is a supermartingale
Proving $p\nmid \dbinom{p^rm}{p^r}$ where $p\nmid m$
Correlated Brownian motion and Poisson process
How to prove that a simple graph having 11 or more vertices or its complement is not planar?

The Unit Simplex is defined by:

$$ \mathcal{S} = \left\{ x \in \mathbb{{R}^{n}} \mid x \succeq 0, \, \boldsymbol{1}^{T} 1 = 1 \right\} $$

Orthogonal Projection onto the Unit Simplex is defined by:

- Explain `All polyhedrons are convex sets´
- Degeneracy in Linear Programming
- Hessian Related convex optimization question
- Orthogonal Projection onto the $ {L}_{1} $ Unit Ball
- Show that the dual norm of the spectral norm is the nuclear norm
- Derivative of the nuclear norm with respect to its argument

$$

\begin{alignat*}{3}

\arg \min_{x} & \quad & \frac{1}{2} \left\| x – y \right\|_{2}^{2} \\

\text{subject to} & \quad & x \succeq 0 \\

& \quad & \boldsymbol{1}^{T} x = 1

\end{alignat*}

$$

- Number of positive, negative eigenvalues and the number of sign changes in the determinants of the upper left submatrices of a symmetric matrix.
- is matrix transpose a linear transformation?
- Intersection of subspaces by construction
- What is the kernel of the tensor product of two maps?
- Is a linear tranformation onto or one-to-one?
- eigenvalues of a matrix $A$ plus $cI$ for some constant $c$
- eigen decomposition of an interesting matrix (general case)
- Writing an expression as a sum of squares
- Gram-Schmidt in Hilbert space?
- Finding real cubic root of the equation

Projection onto the Simplex can be calculated as following.

The Lagrangian in that case is given by:

$$ \begin{align}

L \left( x, \mu \right) & = \frac{1}{2} {\left\| x – y \right\|}^{2} + \mu \left( \boldsymbol{1}^{T} x – 1 \right) && \text{} \\

\end{align} $$

The trick is to leave non negativity constrain implicit.

Hence the Dual Function is given by:

$$ \begin{align}

g \left( \mu \right) & = \inf_{x \succeq 0} L \left( x, \mu \right) && \text{} \\

& = \inf_{x \succeq 0} \sum_{i = 1}^{n} \left( \frac{1}{2} { \left( {x}_{i} – {y}_{i} \right) }^{2} + \mu {x}_{i} \right) – \mu && \text{Component wise form}

\end{align} $$

Again, taking advantage of the Component Wise form the solution is given:

$$ \begin{align}

{x}_{i}^{\ast} = { \left( {y}_{i} – \mu \right) }_{+}

\end{align} $$

Where the solution includes the non negativity constrain by Projecting onto $ {\mathbb{R}}_{+} $

The solution is given by finding the $ \mu $ which holds the constrain (Pay attention, since the above was equality constrain, $ \mu $ can have any value and it is not limited to non negativity as $ \lambda $ above).

The objective function (From the KKT) is given by:

$$ \begin{align}

h \left( \mu \right) = \sum_{i = 1}^{n} {x}_{i}^{\ast} – 1 & = \sum_{i = 1}^{n} { \left( {y}_{i} – \mu \right) }_{+} – 1

\end{align} $$

The above is a Piece Wise linear function of $ \mu $ and its Derivative given by:

$$ \begin{align}

\frac{\mathrm{d} }{\mathrm{d} \mu} h \left( \mu \right) & = \frac{\mathrm{d} }{\mathrm{d} \mu} \sum_{i = 1}^{n} { \left( {y}_{i} – \mu \right) }_{+} \\

& = \sum_{i = 1}^{n} -{ \mathbf{1} }_{\left\{ {y}_{i} – \mu > 0 \right\}}

\end{align} $$

Hence it can be solved using Newton Iteration.

I wrote MATLAB code which implements them both at Mathematics StackExchange Question 2338491 – GitHub.

There is a test which compares the result to a reference calculated by CVX.

- Which $f \in L^\infty$ are the Fourier transform of a bounded complex measure?
- How to increase the correlation?
- pullback of density
- Deriving Maclaurin series for $\frac{\arcsin x}{\sqrt{1-x^2}}$.
- How can I solve $\sin(x)=\sin(2x)$?
- Max perimeter of triangle inscribed in a circle
- how to do such stochastic integration $dS = a S^b dt + c S dW$?
- Why can quotient groups only be defined for subgroups?
- Anybody knows a proof of Uniqueness of the Reduced Echelon Form Theorem?
- Proving that $\sin x \ge \frac{x}{x+1}$
- Maximum of an expression with four variables
- Sum the following $\sum_{n=0}^{\infty} \frac {(-1)^n}{4^{4n+1}(4n+1)} $
- $\frac{a+b-2c}{b+c} + \frac{b+c-2a}{c+a} + \frac{c+a-2b}{a+b} \geq 0$
- Explicitly finding the sum of $\arctan(1/(n^2+n+1))$
- The real numbers and the Von Neumann Universe