Ensemble Methods

Combining multiple models to produce a single prediction, typically achieving better generalization than any individual model.
→ Iff models make uncorrelated errors, combining them reduces overall error.