A function is invariant to a transformation if:
For example when training an object classifier, it should produce the same outputs, regardless of whether the image has been flipped, rotated, warped, …
Invariance Group
The set of transformations that leave a property/quantity unchanged.
Types of invariances: