Distance Metrics
Created: 07 Feb 2023, 05:20 PM | Modified: =dateformat(this.file.mtime,"dd MMM yyyy, hh:mm a")
Tags: knowledge, GeneralDL
L1, L2, KL Divergence
- is KL divergence a similarity / distance metric?
Euclidean distance vs Cosine Similarity
https://cmry.github.io/notes/euclidean-v-cosine
Euclidean distance ⇒ smaller better
Cosine Similarity ⇒ larger better
While cosine looks at the angle between vectors (thus not taking into regard their weight or magnitude), euclidean distance is similar to using a ruler to actually measure the distance.
Cosine similarity is generally used as a metric for measuring distance when the magnitude of the vectors does not matter.