Topic: Classification & Regression When selecting a decision tree split criterion, which is a reason to choose Gain Ratio over Information Gain? (Select ANY correct answer) A. you have polynominal attributes with many values. B. you need to get the fastest runtime (Gain Ratio always has a shorter runtime than Information Gain). C. you have a relatively small data set (they will both take similar time to run but Gain Ratio always gives better performance over Information Gain). D. you want a criterion that takes Information Gain, and adjusts it for each attribute based on the number of possible values.
Question
Topic: Classification & Regression
When selecting a decision tree split criterion, which is a reason to choose Gain Ratio over Information Gain? (Select ANY correct answer)
A. you have polynominal attributes with many values. B. you need to get the fastest runtime (Gain Ratio always has a shorter runtime than Information Gain). C. you have a relatively small data set (they will both take similar time to run but Gain Ratio always gives better performance over Information Gain). D. you want a criterion that takes Information Gain, and adjusts it for each attribute based on the number of possible values.
Solution
The correct answer is D.
The Gain Ratio is a modification of the Information Gain that reduces its bias on high-valued attributes. It takes into account not only the Information Gain, but also the split information value of each attribute, which is based on the number of possible values. Therefore, it adjusts the Information Gain for each attribute based on the number of possible values. This makes it a better choice when you want a criterion that considers this factor.
Similar Questions
How do we use classification?
Classification is the process of analyzing data to predict how to classify a new data element. Group of answer choicesTrueFalse
A Classification rule is said?*1 pointc. Probabilistic classificationa. Discriminative classificationd. Both a and cb. Generative classification
Classification of Entities
Which of the following is an example of the classification technique of Machine Learning?Categorizing customer reviews as positive or negativeRecommending movies based on user preferencesForecasting the seasons of the yearPredicting the blood pressure of patients
Upgrade your grade with Knowee
Get personalized homework help. Review tough concepts in more detail, or go deeper into your topic by exploring other relevant questions.