Feature Selection and Weighting

Random Mutation Hill Climbing

Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms (1994) (pdf)

Prototype Selection for Composite Nearest Neighbor Classifiers (1995)

Selection of Relevant Features and Examples in Machine Learning (1997)   Avrim L. Blum, Pat Langley
Check its 38 citations
 

Feature Subset Selection Using A Genetic Algorithm
                  (1997)  (Correct)  (48 citations)
      Jihoon Yang and Vasant Honavar Artificial Intelligence Research Group...
        Genetic Programming 1997: Proceedings of the Second Annual Conference
 

google: "random mutation hill climbing" 53 hits
google: "zero-temperature metropolis" 2 hits
google: "metropolis method" temperature 91 hits
google: "Monte Carlo" "metropolis method" temperature 76 hits



Data used:

Kohavi, Langley, Yun. The Utility of feature...
DIET: Anneal, Chess, Sgment, Soybean-Large, Vehicle, LED24, Breast, Hypothid, Mushroom, Vote, LED7
Feature weighting, no improvement using weights

John, Kohavi, Pfleger. 1994. Irrelevant features and the subset selection problem.

Kohavi, John. 1997. Wrappers for feature subset selction.
Breast, Cleve crx, DNA, Horse-colic, Pima, Sick euthyroid, soybean-large.

Scherf, Brauer. 1997. Feature selection by means of a feature weighting approach
RELIEF, EUBAFS
Vowel, Wisconsin Breast, Pima, Live, WIne, LED7, Mopnks1-3, LED&

Yang, Honavar. Feature subset selection using a genetic algorithm.
Various including wine and Reuters

Kudo, Sklansky. Classifier-indeoendent feature selection...
Mammogram, Sonar, Mushroom



Cross-validation:

Leave-one-out
N-fold
Bootstrap



Feature selection:

Forward selection
Backward selection
Best-first
Forward & Backward selection
Genetic algorithm
Random mutation hill climbing
Fractal dimensions (Traina, Traina, Wi, Faloutsos)
Correlation-based (Hall, Smith)



Feature weighting:

Genetic algorithm
WINNOW (Blum & Langley)
Rocchio
Widrow-Hoff