# Linear Algebra - Norm (Length)

The norm of a vector v is written $\left \| v \right \|$

## Definition

The norm of a vector v is defined by: $$\left \| v \right \| = \sqrt{\left \langle v,v \right \rangle}$$

where:

### Euclidean space

$\begin{array}{crl} v & = &[v_1, v_2, \dots , v_n] \\ \left \| v \right \| & = & \left \| [v_1, v_2, . . . , v_n] \right \| \\ \left \| v \right \| & = & \sqrt{ {v_1}^2 + {v_2}^2 + \dots + {v_n}^2}\\ \left \| v \right \| & = & \sqrt{ \sum v^2_i }\\ \end{array}$

For a 2-vector:
$\begin{array}{crl} u & = & [u_1, u_2] \\ \left \| u \right \| & = & \sqrt{ {u_1}^2 + {u_2}^2 }\\ (\left \| u \right \|)^2 & = & {u_1}^2 + {u_2}^2 \\ \end{array}$
as the Pythagorean theorem, the norm is then the geometric length of its arrow.

## Property

Since it plays the role of length, it should satisfy the following norm properties:

• Property N1: $\left \| v \right \|$ is a non-negative real number.
• Property N2: $\left \| v \right \|$ is zero if and only if v is a zero vector.
• Property N3: for any scalar $\alpha, \left \| \alpha.v \right \| = |\alpha | \left \| v \right \|$
• Property N4: $\left \| u + v \right \| = \left \| u \right \| + \left \| v \right \|$ (triangle inequality).

Discover More
Linear Algebra - (Dot|Scalar|Inner) Product of two vectors

A dot Product is the multiplication of two two equal-length sequences of numbers (usually coordinate vectors) that produce a scalar (single number) Dot-product is also known as: scalar product or...
Linear Algebra - Closest Point on a Line

How to find the closest point on a line from a point ? How to find the vector on the line that best approximates the given vector b (the closest point on the line) Letb be a vector Leta be a...
Linear Algebra - Closest point in higher dimension than a plane

Solving closest point in the span of many vectors Goal: An algorithm that, given a vector b and vectors v1, . . . , vn, finds the vector in Span {v1, . . . , vn} that is closest to b. Special case:...
Linear Algebra - Distance between two vectors

The distance between two vectors p and b is the length of the difference p − b.
Linear Algebra - Inner product of two vectors

Inner products allow the rigorous introduction of intuitive geometrical notions such as the length of a vector or the angle between two vectors. They also provide the means of defining orthogonality between...
Linear Algebra - Normalization

Normalizing a vector means scaling it to make its norm 1. Just divide it by its norm.
Linear Algebra - Orthogonal complement Vector Space

Let U be a of W. For each vector b in W, we can write b as the following projections: where: is in U, and is orthogonal to every vector in U. Let V be the set . V is the orthogonal complement...
Linear Algebra - Vector

tuple in Linear algebra are called vector. A vector is a list of scalar (real number) used to represent a When the letters are in bold in a formula, it signifies that they're vectors, To represent...
Natural Language - Document (Cosine) Similarity

Cosine similarity applied to document similarity. Each document becomes a vector in some high dimensional space. To compare two documents we compute the cosine of the angle between their two document...
Statistics - Ridge regression

Ridge regression is a shrinkage method. It was invented in the '70s. The least squares fitting procedure estimates the regression parameters using the values that minimize RSS. In contrast, the...