The idea of gradient boosting is to build a series of trees where each tree is trained to correct the mistakes of the previous trees in the series.