ABSTRACT
The conventional classification task of data mining can be called single-label classification, since there is a single class attribute to be predicted. This paper addresses a more challenging version of the classification task, where there are two or more class attributes to be predicted. We propose a new ant colony algorithm for the multi-label classification task. The new algorithm, called MuLAM (Multi-Label Ant-Miner) is a major extension of Ant-Miner, the first ant colony algorithm for discovering classification rules. We report results comparing the performance of MuLAM with the performance of three other classification techniques, namely the very simple majority classifier, the original Ant-Miner algorithm and C5.0, a very popular rule induction algorithm. The experiments were performed using five bioinformatics datasets, involving the prediction of several kinds of protein function.
- Bonabeau, E. and Theraulaz, G. Swam Smarts, Scientific American, March 2000, pp. 54--56.]]Google Scholar
- Bonabeau, E., Dorigo, M. and Theraulaz, G. Swarm Intelligence: from natural to artificial systems, Oxford University Press, 1999.]] Google ScholarCross Ref
- Clare, A. and King, R. D. Knowledge discovery in multi-label phenotype data, Proc. PKDD-2001, LNAI 2168, pp. 42--53. Springer, 2001.]] Google ScholarDigital Library
- Clark, P. and Niblett, T. The CN2 induction algorithm, Machine Learning, Vol. 3, pp 261--283, 1989.]] Google ScholarDigital Library
- Deneubourag, J. L., Aron, S., Goss, S. and Pasteels, J. M. The self-organizing exploratory pattern of the Argentine ant, Journal of Insect Behaviour, 3: 159--168, 1990.]]Google ScholarCross Ref
- Dorigo, M., Caro, G. D. and Gambardella, L. M. Ant Algorithms for Discrete Optimization, Artificial Life, Vol 5, No.3, pp. 137--172, 1999.]] Google ScholarDigital Library
- Freitas, A. A. Data Mining and Knowledge Discovery with Evolutionary Algorithms, Springer, 2002.]] Google ScholarDigital Library
- Goss, S., Aron, S., Deneuborg, J. L. and Pasteels, J. M. Self-organized shortcuts in the Argentine Ant, Naturwissenschaften, 76:579--581, 1989.]]Google ScholarCross Ref
- Grassé, P. P. La théorie de la stigmergie: essai d'interprétation du comportement des termites constructeurs, Insectes Sociaux, 6: 41--81, 1959.]]Google ScholarCross Ref
- Karalic, A. and Pirnat, V. Significance level based classification with multiple trees, Informatica, 15(5), 1991.]]Google Scholar
- Kendall, M. G. Multivariate Analysis, Second Edition, Charles Griffin, High Wycombe, England, 1980.]]Google Scholar
- McCallum, A. K. Multi-Label Text Classification with a Mixture Model Trained by EM, AAAI 99 Workshop on Text Learning, 1999.]]Google Scholar
- Parpinelli, R. S., Lopes, H. S. and Freitas, A. A. Data Mining with an Ant Colony Optimization Algorithm, IEEE Trans. On Evolutionary Computation, 6(4), Aug 2002, pp. 321--332.]]Google ScholarDigital Library
- Parpinelli, R. S., Lopes, H. S. and Freitas, A. A. An Ant Colony Algorithm for Classification Rule Discovery, In: Data Mining: a Heuristic Approach, pp. 191--208. Idea Group, 2002.]]Google Scholar
- Prosite, http://ca.expasy.org/prosite/ (visited 2005)]]Google Scholar
- Quinlan, J. R. C4.5: Programs for Machine Learning, Morgan Kaufmann, 1993.]] Google ScholarDigital Library
- Schapire, R. and Singer, Y. BoosTexter: A boosting-based system for text categorization, Machine Learning, 39(2/3): 135--168, 2000.]] Google ScholarDigital Library
- Suzuki, E., Gotoh, M. and Choki, Y. Bloomy Decision Tree for Multi-objective Classification, Proc. PKDD 2001, LNAI 2168, pp. 436--447, 2001.]] Google ScholarDigital Library
- Uniprot database, http://www.unirpot.org (visited 2005)]]Google Scholar
- Witten, I. H. and Frank, E. Data Mining -- Practical Machine Learning Tools and Techniques, 2nd Ed. Morgan Kaufmann, 2005.]] Google ScholarDigital Library
Index Terms
- A new ant colony algorithm for multi-label classification with applications in bioinfomatics
Recommendations
Improving the interpretability of classification rules discovered by an ant colony algorithm
GECCO '13: Proceedings of the 15th annual conference on Genetic and evolutionary computationThe vast majority of Ant Colony Optimization (ACO) algorithms for inducing classification rules use an ACO-based procedure to create a rule in an one-at-a-time fashion. An improved search strategy has been proposed in the cAnt-MinerPB algorithm, where ...
Classification rule discovery with ant colony optimization algorithm
IDEAL'12: Proceedings of the 13th international conference on Intelligent Data Engineering and Automated LearningAnt Colony Algorithms has been successfully applied to solve combinatorial optimization problems. Subsequently applications on Data Mining (DM) appeared, more specifically aiming to solve classification problems. The Ant-Miner [3] algorithm is a good ...
Improving the interpretability of classification rules discovered by an ant colony algorithm: Extended results
Most ant colony optimization ACO algorithms for inducing classification rules use a ACO-based procedure to create a rule in a one-at-a-time fashion. An improved search strategy has been proposed in the cAnt-Miner<inline-formula><inline-graphic xlink="...
Comments