The gradient boosting ensembles use lots of weak learners, built in a non-random way, to created a model that makes fewer and fewer mistakes as more trees added.