A New Artificial Immune System Based on Continuous Learning for Pattern Recognition
Keywords:Pattern Recognition, Continuous Learning, Artificial Immune Systems, Negative Selection Algorithm, Clonal Selection Algorithm
AbstractThis paper presents a novel approach for pattern recognition based on continuous training inspired by the biological immune system operation. The main objective of this paper is to present a method capable of continually learn, i.e., being able to address new types of patterns without the need to restart the training process (artificial immune system with incremental learning). It is a useful method for solving problems involving a permanent knowledge extraction, e.g., 3D facial expression recognition, whose quality of the solutions is strongly dependent on a continuous training process. In this context, two artificial immune algorithms are employed: (1) the negative selection algorithm, which is responsible for the pattern recognition process and (2) the clonal selection algorithm, which is responsible for the learning process. The main application of this method is in assisting in decision-making on problems related to pattern recognition process. To evaluate and validate the efficiency of this method, the system has been tested on handwritten character recognition, which is a classic problem in the literature. The results show efficiency, accuracy and robustness of the proposed methodology.
ZADEH, L. A. Fuzzy sets. Information and Control, v. 8, p. 338–353, 1995.
HAYKIN, S. Neural networks: a comprehensive foundation. USA, New Jersey: Prentice-Hall, Upper Saddle, 842 p., 1994.
CASTRO, L. N. de. Immune engineering: development and application of computational tools inspired by artificial immune systems. Tese (Doutorado) — UNICAMP - Universidade Estadual de Campinas, Campinas, SP, Brasil, 2001.
BARROS, A. C. et al. Detection and classification of the voltage disturbances in electrical distribution systems using a neural network artmap euclidian modified with continuous training. In: Proceedings of the Brazilian Symposium of Intelligent Automation. Fortaleza, Brazil: [s.n.], p. 1–6, 2013.
JAVED, O.; ALI, S.; SHAH, M. Online detection and classification of moving objects using progressively improving detectors. In: Proceedings of the CVPR. [S.l.: s.n.], p. 696–701, 2005.
MARCHIORI, S. C. et al. Neural Network Based on Adaptive Resonance Theory With Continuous Training For Multi-Configuration Transient Stability Analysis of Electric Power Systems. Applied Soft Computing, v. 11, p. 706–715, 2011.
OZA, N. C.; RUSSELL, S. Online bagging and boosting. In: Proceedings of the 8th International Workshop on Artificial Intelligence and Statistics. Florida, USA: [s.n.], 105–112, 2001.
PHAM, M. T.; CHAM, T. J. Online learning asymmetric boosted classifiers for object detection. In: Proceedings of the CVPR. [S.l.: s.n.], 2007. p. 1–6.
FORREST, S. A.; PERELSON, A. L.; CHERUKURI, R. Self-non-self discrimination in a computer. In: Proceedings of the IEEE Symposium on Research in Security and Privacy. Oakland: [s.n.], p. 202–212, 1994.
CASTRO, L. N. de; ZUBEN, F. J. V. The clonal selection algorithm with engineering applications. In: Proceedings of the GECCO, Workshop on Artificial Immune Systems and Their Applications. Las Vegas: [s.n.], 1993. p. 36–39.
CARPENTER, G. A. et al. Fuzzy artmap: A neural network for incremental supervised learning of analogy multidimensional maps. IEEE Transactions on Neural Network, v. 3, p. 689–713, 1992.
CASTRO, L. N. de; TIMMIS, J. Artificial immune systems: a new computational intelligence approach. New York: Springer, p. 357, 2002.
DASGUPTA, D. Artificial immune systems and their applications. New York: Springer-Verlag, 1998.
LIMA, F. P. A.; LOTUFO, A. D. P.; MINUSSI, C. R. Disturbance detection for optimal database storage in electrical distribution systems using artificial immune systems with negative selection. Electric Power System Research, v. 109, p. 54–62, 2014.
LIMA, F. P. A.; LOTUFO, A. D. P.; MINUSSI, C. R. Artificial immune systems applied to voltage disturbance diagnosis in distribution electrical systems. In: Proceedings of the IEEE Powertech. Grenoble, France: [s.n.], p. 1–6, 2013.
BRADLEY, D. W.; TYRRELL, A. M. Immunotronics novel finite-state-machine architectures with built-in self-test using self-nonself differentiation. IEEE Transactions on Evolutionary Computation, v. 6, p. 227–238, 2002.
FRANC¸ A, F. O. de; ZUBEN, F. J. V.; CASTRO, L. N. de. An artificial immune network for multimodal function optimization on dynamic environments. In: Proceedings of the GECCO. Washington, DC, USA: [s.n.], 289–296, 2005.
LIMA, F. P. A. et al. Manuscripts character recognition using artificial immune systems. In: Proceedings of the Congress of Applied and Computational Mathematic. Curitiba, PR, Brazil: [s.n.], p. 1–6, 2014.
LIMA, F. P. A.; MINUSSI, C. R. Voltage disturbance analysis of electrical power systems based on artificial immune system with continuous learning. In: Internal Publication, Electrical Engineering Department, UNESP, Univ Estadual Paulista, Ilha Solteira (SP). Ilha Solteira, SP, Brazil: [s.n.], p. 1–12, 2014.
MATLAB 7.8 version. [S.l.], 2011.
PERWEJ, Y.; CHATURVEDI, A. Machine recognition of hand written characters using neural networks. International Journal of Computer Applications, v. 14, p. 6–9, 2011.
JUNIOR, J. J. O. et al. Evaluating NN and HMM classifiers for handwritten word recognition. In: Proceedings of the XV Brazilian Symposium on Computer Graphics and Image Processing. [S.l.: s.n.], 2002. p. 210–217.
GUANAPATHY, V.; LIEW, K. L. Handwritten characters recognition using multiscale neural networks training technique. Word Academy of Science, Engineering and Technology, v. 15, p. 32–37, 2008.
ZHAO, W. W.; CHELLAPPA, R. ace processing: advanced modeling and methods. In: Academic Press. San Diego, USA: [s.n.], 2009.