the.com/ensemble
Many mediocre guesses averaged together quietly outperform one brilliant one.
means A method where you combine multiple different models or predictions into one, because their blended average is usually more accurate and reliable than any single one alone.
from From French ensemble, meaning 'together,' descending from Latin insimul ('at the same time,' from in- + simul, 'at the same moment,' the same root that gives us 'simultaneous'). The word kept its 'togetherness' sense through French into English, first for groups performing together (a musical ensemble, a clothing ensemble), and later borrowed by statisticians and computer scientists for groups of models performing together — many voices, one combined output.
- origin
- French for together, borrowed by orchestras first
- ml trick
- random forest is just voting trees
- netflix prize
- won by blending hundreds of models, not one genius algorithm
- tradeoff
- accuracy up, interpretability nearly zero