Vector - An arrow with a length and direction.
Vector Space Model - Represents data as vectors in high dimensional state
Vectors of data used to find relationship between data
Laymen understanding - Closer the vectors are, the closer they mean?
There are ML models specialised for creating embeddings, that is different embedding algorithms find different types of relationships
Positional Encoding
Preserve the order of words when processing natural language, transformers don’t process sequentially, hence it needs positional encoding to preserve the order of understading
