Entropy Vs. Gini Index (1) Difference In Entropy & Gini Index. Gini Index: It is the probability of misclassifying a randomly chosen element in a set. The range of the Gini index is [0, 1], where 0 indicates perfect purity and 1 indicates maximum impurity. The Gini index is a linear measure. It can be interpreted as the expected error rate in a classifier. It is sensitive to the distribution of classes in a set. The computational complexity of the Gini index is O(c). It is less robust than entropy. It is sensitive. Formula for the Gini index is Gini(P)

Read More