Introduction


Decision trees


Figure 1

Simple tree

Figure 2

Simple tree

Variance


Figure 1

Simple tree (depth 5)

Figure 2

Simple tree (depth 5)

Figure 3

Simple tree (depth 5)

Figure 4

Simple tree (depth 5)

Figure 5

Simple tree (depth 5)

Boosting


Figure 1


Figure 2

Boosted tree

Bagging


Figure 1


Figure 2


Random forest


Figure 1


Figure 2


Gradient boosting


Figure 1


Performance


Figure 1