Capture
Artificial Intelligence

How best attribute is selected in a decision-tree? Select the root attribute of the decision-tree from given sample data.

How best attribute is selected in a decision tree? Select the root attribute of the decision tree from the given sample data.

Capture

Solutions

a) Entropy using the frequency table of one attribute:

e1

b) Entropy using the frequency table of two attributes:

e2

Information Gain: The information gain is based on the decrease in entropy after a data set is split on an attribute. Constructing a decision tree is all about finding
an attribute that returns the highest information gain (i.e., the most homogeneous
branches).

e3

e4

e5

e6

 

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.