Alan P. Reynolds
ABSTRACT
This paper describes the application of a multiobjective GRASP to rule selection, where previously generated simple rules are combined to give rule sets that minimize complexity and misclassfication cost. As rule selection performance depends heavily on the diversity and quality of the previously generated rules, this paper also investigates a range of multiobjective approaches for creating this initial rule set and the effect on the quality of the resulting classifier.
- ]]R. J. Bayardo Jr. and R. Agrawal. Mining the Most Interesting Rules. In Proc. 5th Int'l. Conf. on Knowledge Discovery and Data Mining, pages 145--153. ACM Press, 1999. Google Scholar
Digital Library
- ]]C. L. Blake and C. J. Merz. UCI Repository of machine learning databases, 1998. http://www.ics.uci.edu/~mlearn/MLRepository.html.Google Scholar
- ]]T. A. Feo and M. G. C. Resende. Greedy Randomized Adaptive Search Procedures. Journal of Global Optimization, 6:109--133, 1995.Google ScholarCross Ref
- ]]P. Festa and M. G. C. Resende. An Annotated Bibliography of GRASP. Technical Report TD-5WYSEW, AT and T Labs, 2004.Google Scholar
- ]]H. Ishibuchi, I. Kuwajima, and Y. Nojima. Prescreening of Candidate Rules Using Association Rule Mining and Pareto-optimality in Genetic Rule Selection. In Knowledge-Based Intelligent Information and Engineering Systems: KES 2007 -- WIRN 2007, Part II, number 4693 in LNAI, pages 509--516. Springer--=Verlag, 2007. Google ScholarDigital Library
- ]]H. Ishibuchi, I. Kuwajima, and Y. Nojima. Use of Pareto-Optimal and Near Pareto-Optimal Candidate Rules in Genetic Fuzzy Rule Selection. In Analysis and Design of Intelligent Systems Using Soft Computing Techniques, number 41 in Advances in Intelligent and Soft Computing, pages 387--396. Springer-Verlag, 2007.Google Scholar
- ]]P. Jaccard. Etude comparative de la distribution florale dans une portion des Alpes et des Jura. Bulletin de la Societe Vaudoise de la Sciences Naturelles, 37:547--579, 1901.Google Scholar
- ]]L. Kaufman and P. J. Rousseuw. Finding Groups in Data: An Introduction to Cluster Analysis. Wiley Series in probability and mathematical statistics. John Wiley and Sons Inc., 1990.Google Scholar
- ]]H. R. Lourenco, J. P. Paixao, and R. Portugal. Multiobjective Metaheuristics for the Bus-Driver Scheduling Problem. Transportation Sciences, 35(3):331--343, 2001. Google ScholarDigital Library
- ]]R. A. Murphey, P. M. Pardalos, and E. Pasiliao. Multicriteria Optimization for Frequency Assignment. In Mobile Networks and Computing, volume 52 of DIMACS Series in Discrete Mathematics and Theoretical Computer Science, pages 203--219. American Mathematical Society, 2000.Google Scholar
- ]]E. L. Pasiliao. A Greedy Randomized Adaptive Search Procedure for the Multi-Criteria Radio Link Frequency Assignment Problem. Technical report, Department of Industrial and Systems Engineering, University of Florida, Gainesville, Florida, 1998.Google Scholar
- ]]L. Pitsoulis and M. G. C. Resende. Greedy Randomized Adaptive Search Procedures. In L. S. Pitsoulis and M. G. C. Resende, editors, Handbook of Applied Optimization, pages 168--181. Oxford University Press, 2001.Google Scholar
- ]]A. Reynolds and B. de la Iglesia. Rule Induction Using Multi-Objective Metaheuristics: Encouraging Rule Diversity. In Proc. 2006 Int'l. Joint Conf. on Neural Networks, 2006 IEEE World Congress on Computational Intelligence, pages 6375--6382, 2006.Google Scholar
- ]]A. P. Reynolds and B. de la Iglesia. Rule Induction for Classification Using Multi-Objective Genetic Programming. In Proc. 4th Int'l. Conf. on Evolutionary Multi-Criterion Optimization, number 4403 in LNCS, pages 516--530, 2007. Google ScholarDigital Library
- ]]A. P. Reynolds and B. de la Iglesia. A Multi-Objective GRASP for Partial Classification. Soft Computing, 13(3):227--243, 2009. Google ScholarDigital Library
- ]]A. P. Reynolds, G. Richards, B. de la Iglesia, and V. J. Rayward-Smith. Clustering Rules: A Comparison of Partitioning and Hierarchical Clustering Algorithms. Journal of Mathematical Modelling and Algorithms, 5(4):475--504, 2006.Google ScholarCross Ref
- ]]R. R. Sokal and P. H. A. Sneath. Principles of Numerical Taxonomy. Freeman, San Francisco, 1963.Google Scholar
- ]]D. S. Vianna and J. E. C. Arroyo. A GRASP Algorithm for the Multi-Objective Knapsack Problem. In Proc. XXIV Int'l. Conf. of the Chilean Computer Science Society, pages 69--75, 2004. Google ScholarDigital Library
Index Terms
- A multiobjective GRASP for rule selection
Recommendations
Multiobjective genetic rule selection as a data mining postprocessing procedure
GECCO '06: Proceedings of the 8th annual conference on Genetic and evolutionary computationIn this paper, we show the usefulness of multiobjective genetic rule selection as a postprocessing procedure in data mining for pattern classification problems. First we extract a prespecified number of rules using a data mining technique. Then we apply ...
A multi-objective GRASP for partial classification
Special Issue on Evolutionary and Metaheuristics based Data Mining (EMBDM); Guest Editors: José A. Gámez, María J. del Jesús, José M. PuertaMetaheuristic algorithms have been used successfully in a number of data mining contexts and specifically in the production of classification rules. Classification rules describe a class of interest or a subset of this class, and as such may also be ...
Rule Induction: Combining Rough Set and Statistical Approaches
RSCTC '08: Proceedings of the 6th International Conference on Rough Sets and Current Trends in ComputingIn this paper we propose the hybridisation of the rough set concepts and statistical learning theory. We introduce new estimators for rule accuracy and coverage, which base on the assumptions of the statistical learning theory. Then we construct ...
Comments