I have trouble understanding the topic of projection vs. least square approximation in an Introductory Linear Algebra class. I know this question has already been asked (Difference between orthogonal projection and least squares solution), but I want to check my understanding. PROJECTION ONTO SUBSPACE In projection, the purpose is to find the point where the […]

In an $n$-dimensional inner product space $V$, I have $k$ ($k\le n$) linearly independent vectors $\{b_1,b_2,\cdots,b_k\}$ spanning a subspace $U$. The $k$ vectors need not be orthogonal. Then I was told that the projection of an arbitrary vector $c$ onto $U$ is given by $$P_Uc=A(A^TA)^{-1}A^Tc$$ where $A$ is the $n\times k$ matrix with column vectors […]

I am looking for an intuitive reason for a projection matrix of an orthogonal projection to be symmetric. The algebraic proof is straightforward yet somewhat unsatisfactory. Take for example another property: $P=P^2$. It’s clear that applying the projection one more time shouldn’t change anything and hence the equality. So what’s the reason behind $P^T=P$?

If I have a projection $T$ on a finite dimensional vector space $V$, how do I show that $T$ is diagonalizable?

Intereting Posts

If $(M,d)$ is a compact metric space and $f:M\rightarrow M$ is an isometry ($d(x,y)=d(f(x),f(y))$ for any $x,y\in M$), then $f$ is a homeomorphism
how to minimize y in expression $(x^y) \bmod{n}$?
Indian claims finding new cube root formula
Homotopy groups of some magnetic monopoles
Finding invariant subspaces
Boundaries of finite intersections and unions of sets
Paradox: increasing sequence that goes to $0$?
How is it possible for the inverse function of a linear-continuous-bijective function to be not continuous?
multiplicative group of infinite fields
Derivation of the general forms of partial fractions
Pigeon hole principle with sum of 5 integers
Extra Square in Partial Fraction
If $f$ is continuous, $f(x) \to -\infty$ as $x \to -\infty$, and $f(x) \to \infty$ as $x \to \infty$, then $f(\mathbb{R}) = \mathbb{R}$.
Bounds on the average of the divisors of natural numbers.
A difference between a roller coaster and a ferris wheel.