invariance

A function $f(x)$ is invariant to a transformation $t(x)$ if:

$$f(t(x))=f(x)$$

For example when training an object classifier, it should produce the same outputs, regardless of whether the image has been flipped, rotated, warped, …

Types of invariances:

• translation invariance
• permutation invariance