SCMI-TREE: SYNERGY-AWARE DECISION TREES VIA CONDITIONAL MUTUAL INFORMATION WITH ADAPTIVE LOOKAHEAD
Decision trees built with greedy axis-aligned splits perform well when individual features carry a meaningful signal about the target. They fail, often badly, in the setting where the useful information resides in the joint behaviour of two or more features rather than in any single one. The exclusive-or problem is the...