Decision Tree

Modified on 2010/05/09 18:59 by Administrator — Categorized as: Data Mining

Training Dataset

This follows an example from Quinlan’s ID3

Image

Algorithm for Decision Tree Induction

Basic algorithm (a greedy algorithm)


Conditions for stopping partitioning


Attribute Selection Measure: Information Gain (ID3/C4.5)


Attribute Selection by Information Gain Computation


Image
Image means “age <=30” has 5 out of 14 samples, with 2 yes’es and 3 no’s. Hence Image

Similarly, Image

Output: A Decision Tree for “buys_computer”

Image