Now for scalar multiplication. We know that if we take our same two vectors and the scale them by some scalar , that the distance between them also scales by . That is
Now there is a special type of function that satisfies these two properties, namely a function called the norm. A norm ()is a function that takes elements of our vector space to such that the following three axioms are satisfied:
where and , depending on what your field your vector space is over. This norm is similar to the length of a vector in Euclidean space, the distance it is from the origin, however, since we can deal with a lot more general spaces, such sequence spaces and function spaces, the norm is more of a generalisation of this idea rather than an extension. In fact, in , where all the nice vectors that we like live in, the way we measure the length of these vectors is just a norm!
So what we have right now is a normed vector space ; a vector space with some norm defined on it. So for the rest of this post, I’m just going to go through some examples of normed vector spaces, just to get a grip on things. If you would like to prove that each of these actually define norms, try it out!
The absolute value function on is a norm, making a normed space. Look at that, there was right under your nose your entire life!
Now, what’s the next simplest type of space you could think of? Well, what about ? We already know that these geometric vectors have the Euclidean norm defined as
However, what you have been calling the euclidean norm your life is also called the 2-norm, which is a specific case of the more general p-norm defined as
where . So as another example, here is the 1-norm:
The infinite norm is defined as
The next type of normed vector space we would like to deal with are sequence spaces. Sequences can be added together and multiplied by scalars and so naturally form a vector space. Before we baptise our sequence space with a norm, let us be clear on which sequences are allowed in our space. Well, this is all a lie, as I have only talked about a singular sequence space, but in reality there are many different sequence spaces. Take for example the space of all sequences whose series is absolutely convergent, , that is
and this has a norm very similar to the 1-norm
the difference being that since in our infinite sequence we have infinite terms, we sum from to , where as in , we only had to sum components up to . Just like the p-norm, we can have any space defined as
with the generalised p-norm
We also define the set of all bounded sequences, as
with the generalised infinite norm to be
Note that these are all different spaces! They all have different sequences and convergence is different in each. Before we can look at that, we have to define what we mean by convergence in a normed vector space, and unfortunately, that will happen in the next post!
The final type of normed vector space I would like to consider are function spaces. We can add functions together and multiply them by scalars (point wise at least) and so they form a vector space. Just like the sequence spaces, we have to be clear on functions are in each space that we want. Consider for example the space of all continuous functions on the interval , . We christen this space with the norm
There are also other types of function spaces such as where you are in the group (part of the cool kids) if
and if you are a cool kid, then your norm is given by
I could go on, but for now, this is sufficient for us to move on to the next stage of our wild ride. I hope you enjoyed the zoo of normed vector spaces, but as the cool kids said back in the day, “it’s not a party until Banach shows up.” Here is a picture of Banach for reference.