A function is invariant to a transformation if:

For example when training an object classifier, it should produce the same outputs, regardless of whether the image has been flipped, rotated, warped, …

Invariance Group

The set of transformations that leave a property/quantity unchanged.

Types of invariances: