An Application of Evolutionary Computational Technique to Non-Linear Singular System Arising in Polytrophic and Isothermal Sphere

Table of contents

1. INTRODUCTION

he singular phenomenon arises in the modeling of physical structures, random processes, control theory, networks synthesis and other areas of the applied sciences and engineering [1][2]. These singular non-linear systems have substantial significance in classical and modern science, as it defines the dynamics of a system [3]. The singular non-linear system of polytrophic and isothermal sphere is represented by the following non-linear second order homogenous equation:

, 1 0 ) ( 2 ) ( 2 2 ? ? + ? ? ? ? ? ? ? = t y dt t dy t dt t y d ? (1)

The tropic index is taken to be

Author ? : Department of Electronic Engineering, International Islamic University Islamabad, Pakistan. E-mails : [email protected], [email protected] Author ? : Department of Electrical Engineering, Air University, Islamabad, Pakistan. E-mail : [email protected]

It is essentially a Poisson's equation applied is the various modeling application like radioactively cooling, self-gravitating clouds and in the clusters of galaxies [4]. The analytic solution of the model given in equation (1) has been considered by the authors in the recent years by handling the singularity having the index ? . In the recent years, the merging of Homotopy idea with perturbation is applied for non-linear systems. [5]. Optimal Homotopy Asymptotic Method (OHAM) is established very recently by Marinca et al [6]. The OHAM have built in convergence criteria like HAM but is more flexible. From the contribution of Marinca et al [7][8][9] and Iqbal et al. [10] have proved generalization, effectiveness and reliability of the method to important engineering applications. The linear/nonlinear singular initial value problems have been solved by Iqbal et al. by using OHAM method. But no one yet tried to solve the singular non-linear system of Polytrophic and Isothermal sphere by using artificial neural network optimized by evolutionary computation. The applicability of artificial neural network (ANN) is remarkable for problem involving singularity and convex nature.In the last decay various scientists exploited ANN along with stochastic computational techniques, some of them are provided as a reference. Radial Bases functions neural networks were exploited to design a moving mass attitude control system [11] to control a vehicle with three axis stabilization in intra-atmospheric space. C. Monterola and C. Saloma [12][13] works on non-linear system represented by Schrodinger equation, this system is also formulated by FFNN. The flexibility of neural network and GA can be seen in the work carried out by Stackelberg [14] where Nash equilibrium was achieved by a hybrid intelligent algorithm in which fuzzy simulation, neural networks and genetic algorithms were integrated. Bumps and ruts on the roads cause the abrupt change in the rectilinear motion of the vehicles and adhesion coefficient. For a stable movement of the vehicle an appropriate breaking torque is needed. The optimization of this required torque in this problem can also be accomplished using the neural networks and genetic algorithms [15].

In this paper the mathematical modeling for singular non-linear system is performed by ANN with log-sigmoid as activation function. The optimization of algorithm. The result of the GA is provided as a start point for rapid local search. The optimal Homtopy asymptotic method and exact solution of the problem are analyzed with the proposed scheme. The scheme is run for 100 independent runs to get a comprehensive statistical analysis based on the minimum fitness achieved, maximum fitness and spread in the results on the based of mean and standard deviation. The timing analysis is provided to see the computational complexity of the method along with the level of accuracy. According to best of the author knowledge this is the first article in which stochastic methods are incorporated with NN to optimize the non-linear singular systems of Polytrophic and Isothermal sphere.

The remainder of the paper is organized in the following way. The section 2 describes the importance of evolutionary techniques in optimization .In section 3 a mathematical modeling that contains neural network architecture of the singular system is explained. The numerical results along with discussion on the results are revealed in section 4. Finally section 5 presents some concluding remarks on the results along with directions to the future research.

2. II.

3. EVOLUTIONARY COMPUTATION

The term evolutionary computation (EC), used vigorously for all evolutionary algorithms (EAs) this describes field of investigations. The major advantage of these techniques can be seen in practical difficult optimization problems. The major benefits are multifold, simplicity of the concept, robustness in changing circumstances, flexibility and other facets [16]. By this the EC has received special interest in the researchers for its applications in science and engineering. Because it is conceptually simple so no gradient information needs to be presented to the algorithms. The domain of EC is for all those problems that can have a function optimization task. The phenomenon of EC depends upon a data structure to represent solutions, the index of performance to evaluate solutions, and operators to generate new solutions from old [17]. The operator should takes care a behavioral link between parents and offspring's. A disjoint state space for possible solutions is formed which encompass infeasible regions, and time varying index or a function of competing solutions in the population [18]. The procedure of applicability is same for problems like, continuous-valued parameter optimization problems, discrete combinatorial problems, mixed-integer problems, and so forth [19].

4. a) Genetic Algorithms

The modern researches in genetic algorithms (GAs) has outline that the initial proposals were incapable of solving hard problems in a robust and efficient way. In large-scale Optimization problems, the execution time of first-generation GAs increases dramatically whereas solution quality decreases.

Moreover the things such as encoding schemes, selection procedures, and self-adaptive and knowledgebased operators play a key role in the optimization of highly convex and stochastic ion nature problems. The birth of the GAs is also for optimization of various fields of interest [20][21]. Over and above the problems in which optimization itself is the final goal, it is also a way for achieving modeling, forecasting, control, simulation, and so forth. Traditional optimization techniques begin with a single candidate and search iteratively for the optimal solution by applying static heuristics. On the other hand, the GA approach uses a population of candidates to search several areas of a solution space, simultaneously and adaptively.The most popular methods that go beyond simple local search are GAs [22], simulated annealing (SA) [23], and tabu search (TS) [24]. Genetic algorithms operate on a population of individuals. Each individual is a potential solution to a given problem and is typically encoded as a fixed-length binary string, which is an analogy with an actual chromosome. After an initial population is randomly or heuristically generated, the algorithm evolves population through sequential and iterative application of three operators: selection, crossover, and mutation. A new generation is formed at the end of each iteration. The strongest aspect of the GA is, it does not get stuck in local minimum.

5. III. NEURAL NETWORK MATHEMATICAL MODELING

The linear combination of log-sigmoid functions can be used a mathematical model of feed-forward ANN. The log-sigmoid is used as universal function approximator [25][26] as it has the tendency to model the non-linear systems effectively and efficiently in diverse fields of engineering [27][28][29]. Any network suitably trained to approximate a mapping satisfying some ODE will have an output function that will also approximate the DE [30]. In this feed-forward ANN, the input and output layers used linear function as activation while log-sigmoid is used for hidden layers. The following continuous mapping is employed for the function, its first and second derivatives respectively, where the activation function is considered to be log-sigmoid and is given in expression ( 5)

), ( ) ( ?1 i i m i i b t w t y + = ? = ? ? (3) ) ( ) ( ?1 i i m i i b t w dt d dt t y d + = ? = ? ? (4) ), ( ) ( ?22D D D D I 2012 March t e t ? + =1 1 ) ( ? (6)

Therefore the error function formed by the neural networks given (3) to ( 5) is formed as

, 3 , 2 , 1 2 1 ? ? = + = j j j j ? ? ? (7)

where j is the number of generations.

j s i i i i i j t y dt t y d t dt t y d s ? = ? ? ? ? ? ? ? ? ? + = 1 2 5 2 2 1 ) ( ) ( 2 ) ( 1 ? (8)

while the error subject to initial condition is given in (9).

( ) ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? + ? = 2 2 2 ) 0 ( 1 ) 0 ( 2 1 y dt d y j ? (9)

The linear combinations of networks from (3) to (5) can approximately model the system given in (1). It is named as differential equation neural (DEN) network, whose architecture is given in the Fig. 1; the activation function used in this is log-sigmoid. The learning procedure adopted in GA and basic flow chart is provided in one of our last article [31].

w i 1 b i x + f(wit+bi) ?i d/dt[f(wit+bi)] d 2 /dt 2 [f(wit+bi)] ?(t) ?i d/dt [?(t)] ?i d 2 /dt 2 [?(t)] + 1 d 2 /dt 2 [?(t)] + 2/t d/dt [?(t)] - ?(t) 5

Input Hidden Layer Output

1 x m 1 x m (0,T) 2 /t -1 ?(t) 5

6. RESULTS AND DISCUSSION

In this section, we shell consider the solution of (1) by the proposed scheme. In order to prove the applicability and effectiveness of the proposed scheme for singular system the solution of OHAM and exact solution is compared with the results attained by the given approach. However, the statistical analysis is also carried out for the solvers to see the reliability and depth of the algorithm. Moreover, the time complexity of the scheme is also provided in the discussion.

The exact solution of expression ( 1) is [32]:

. 3 1 ) ( 2 1 2 ? ? ? ? ? ? ? ? ? + = t t y (10)

The OHAM method series solution is generated by taking zero-order, first-order and second-order solution respectively [10], and the final reported expression is as follow: Now, the singular non-linear system of Polytrophic and Isothermal sphere is solved by the proposed scheme as well, the number of neurons in each hidden layer of the DEN network are taken to be m = 10 that results in 30 unknown adaptive weights (? i , w i and b i ). The optimization of these weights is carried out using built-in function for GA in MATLAB. The parameter setting used for the execution of the algorithm is given in Table 1.

7. Table 1 : Parameters setting of the algorithms

The input of the training set is taken from time t ? (0, 1) with a step size of 0.1. It means that the total time steps m = 11 so the fitness function is formulated as:

( ) ? 3 , 2 , 1 , ) 0 ( 1 ) 0 ( 2 1 ) ( ) ( 2 ) ( 11 1 11 1 2 2 2 5 2 2 = ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? + ? + ? ? ? ? ? ? ? ? ? + = ? = j y dt d y t y dt t y d t dt t y d j i i i i i j ? (12)

where j be the iteration index, The scheme runs iteratively to find the minimum of fitness function ej, with stoppage criteria as 3000 number of runs or fitness value e j ? 10 -9 whichever comes earlier. One of the unknown weights learned by given scheme with fitness value 7.2039e-11 is provided in Table 2. These weights can be used in equation ( 3) to obtain the solution of the equation for any input time t between 0 and 1.

8. 2012

9. March

The comparison of the results is made with OHAM for the same ranges of the inputs as taken for stochastic numerical method. The results are summarized in Table 3 in comparison of the exact solution. It is clear from the results that the accuracy of the given method is in a good agreement with exact solution and also comparatively excellent with OHAM method. The absolute error of the OHAM is in the range 1.0e-5 to 1.0e-4 while the proposed scheme has the error from 1.0e-7 to1.0e-6.

The derivative of the system representing in expression ( 1) is also approximated by the given scheme to check the depth in the method. The results are summarized in Table 4 upto twelve decimal places. It is quite evident from the table that the results obtained by neural network optimized by evolutionary computation is cable to find the derivative of the systems as well by using the same weights as given in Table 2.

Moreover, the reliability of the stochastic algorithm is being tested by a comprehensive statistical analysis. The analysis is performed in the complete range of the time between 0 to 1 and the results are narrated in table 5. The references of the analysis are the mean, standard deviation, best and worst values of the absolute error of proposed method with exact solution. It is quite evident from the table 5, that the Best and Mean absolute error of both the system is in the range 1e-04 to 1e-06 and 1e-06 respectively. The value of the worst of the absolute error is 1e-04 that is even remarkable. 0.000000000000 0.000001840886 -0.000001840886 0.1 -0.033277916282 -0.033178401419 -0.000099514863 0.2 -0.066226617853 -0.065360105484 -0.000866512369 0.3 -0.098532927816 -0.095661581246 -0.002871346570 0.4 -0.129913960492 -0.123332491326 -0.006581469167 0.5 -0.160128153805 -0.147807897045 -0.012320256761 0.6 -0.188982236505 -0.168732906775 -0.020249329729 0.7 -0.216333959525 -0.185959935851 -0.030374023674 0.8 -0.242091013068 -0.199524924233 -0.042566088834 0.9 -0.266206952825 -0.209610660651 -0.056596292174 March Fig. 2 V. CONCLUSIONS AND FUTURE REMARKS

On the basis of simulation and results provided in the last section it can be concluded that:

The stochastic solvers based on DEN networks optimized with hybridized genetic algorithm can effectively provides the solution of the Non-Linear Singular System of Polytrophic and Isothermal sphere model. The mean of the absolute error lies in range of 10 -06 .

The reliability and effectiveness of proposed artificial intelligence techniques are validated from statistical analysis base on 100 independent runs. It is found that the confidence interval for the convergence of the given approach 100% to get an approximate solution in a acceptable error range.

It has been observed that the proposed scheme show the supremacy on the optimal Homotopy asymptotic method in comparison with the exact solution. Moreover, the proposed scheme can readily provide the solution on the continuous grid of time. Thus this provides an alternate approach to researchers to apply the solver to complex real life problems in engineering.

In future, one can look for application of other artificial intelligence techniques base on neural networks optimized with ant/bee colony optimization, genetic programming, particle swarm optimization and differential evolution etc. for solving such vast applications.

10. Global Journal of Researches in Engineering

11. References Références Referencias

The value of the fitness functions are computed for 100 independent runs to have a close look on the optimization behavior of various input times. The value of the functions for some of the input times are drawn the descending order. The results are plotted on the semi log scale as the difference between the results for various inputs times are merely negligible. The optimization behavior is drawn in the Fig. 2 in descending order for 100 independent runs. Finally it has been concluded from the figure that the convergence capability of the given scheme is 100% for all input times between 0 and 1. Moreover, the absolute error for 12% of the independent runs is in the range 10 -03 to 10 -05 while 88% lies in the range 10 -05 to 10 -09 .

Figure 1.
Journals Inc. (US)
Figure 2. Fig. 1 :
1Fig.1 : The DEN network of the Singular system
Figure 3. Table 2 :
2
GA
12
I
Volume XII Issue v v v v I Version
( )
Global Journal of Researches in Engineering
© 2012 Global Journals Inc. (US)
Figure 4. Table 4 :
4
Figure 5. Table 5 :
5
13
Volume XII Issue v v v v I Version I
( )
Global Journal of Researches in Engineering
Note: © 2012 Global Journals Inc. (US)
Figure 6. Table 3 :
3
t y exact y ohtm y GA-AsA | y exact -y ohtm | | y exact -y GA-ASA |
0.0 1.00000000 1.00000000 0.99999987 0.00000E+00 1.27568E-07
0.1 0.99833749 0.99837760 0.99833660 4.01135E-05 8.84555E-07
0.2 0.99339927 0.99354412 0.99339754 1.44856E-04 1.73096E-06
0.3 0.98532928 0.98560071 0.98532741 2.71434E-04 1.87168E-06
0.4 0.97435470 0.97471595 0.97435312 3.61242E-04 1.58756E-06
0.5 0.96076892 0.96112583 0.96076766 3.56912E-04 1.26070E-06
0.6 0.94491118 0.94513382 0.94491012 2.22638E-04 1.06611E-06
0.7 0.92714554 0.92711078 0.92714455 3.47643E-05 9.88417E-07
0.8 0.90784130 0.90749501 0.90784036 3.46293E-04 9.37937E-07
0.9 0.88735651 0.88679225 0.88735566 5.64264E-04 8.50186E-07
1.0 0.86602540 0.86557566 0.86602468 4.49742E-04 7.25942E-07

Appendix A

  1. Integrating genetic algorithms, tabu search and simulated annealing for the unit commitment problem. A H Mantawy , Y L Abdel-Magid , S Z Selim . IEEE Trans Power Systems 1999. 14 (3) p. .
  2. Direct solution of continuous time singular systems based on the fundamental matrix. B G Mertzios . Proc. Of the 8th IEEE Mediterrenean Conference on Control and Automation, (Of the 8th IEEE Mediterrenean Conference on Control and AutomationRio, Patras, Greece
    ) Med 2000. 2000. p. .
  3. Characterizing the dynamics of constrained physical systems with unsupervised neural network. C Monterola , C Saloma . Phys Rev E 1998. 57 p. .
  4. Computational complexity and observation of physical signals. C Saloma . J. Appl. Phys 1993. 74 p. .
  5. Schema processing under proportional selection in the presence of random effects. D B Fogel , A Ghozi . IEEE Trans Evol Computat 1997. 1 (4) p. .
  6. Evolutionary computation: Toward a new philosophy of machine intelligence, D B Fogel . 2000. Piscataway, NJ: IEEE Press. (2nd edition)
  7. Evolutionary Computation: Towar a new philosophy of machine intelligence, D B Fogel . 2006. Hoboken, New Jersey: John Wiley & Sons, Inc. (3rd Edition)
  8. Solving differential equations with unsupervised neural networks. D R Rarisi . J. Chemical Engineering and Processing 2003. 42 p. .
  9. Stability criteria for singular systems. F N Koumboulis , B G Mertzios . Journal of Neural, Parallel and Scientific Computations 2005. 13 (2) p. .
  10. Evolution and optimum seeking, H-P Schwefel . New York.
  11. Swarm Intelligence for the problems of Non-linear differential Equations and its application to Well Known Wessinger's Equation. J A Khan , M A Z Raja , I M Qureshi . EJSR 2009. 34 (4) p. .
  12. Stochastic Computational Approach for Complex Non-linear Ordinary Differential Equations. J A Khan , M A Z Raja , I M Qureshi . 10.1088/0256-307X/28/2/020206. Chin. Phys. Lett 2011. 28 (2) p. .
  13. Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark functions. J Brest , S Greiner , B Boskovic , M Mernik , V Zumer . IEEE Transactions on Evolutionary Computation 2006. 10 (6) p. .
  14. Fuzzy multilevel programming with a hybrid intelligent algorithm. J Gao , B Liu . Computers and Mathematics with applications 2005. 49 p. . Uncertainty Theory Laboratory, Department of Mathematical Sciences, Tsinghua University (Cited 12 times)
  15. Genetic Programming, J R Koza . 1992. Cambridge, MA: MIT Press.
  16. Generalized laguerre polynomials collocation method for solving Lane Emden equation. K Parand , A Taghavi . Applied Mathematical Sciences 2008. 2 (60) p. .
  17. Modern Huristic Optimization Techniques: Theory and application to power systems, K Y Lee , M A El-Sharkawi . 2008. Hoboken, New Jersey: John Wiley & Sons, Inc.
  18. Solving differential equations with constructed neural networks. L G Tsoulos , D Gavrilis , E Glavas . Neurocomputing 2009. 72 (10) p. .
  19. Neural Network Method for solving the partial Differential Equations. L P Aarts , P V D Veer . Neural Processing Letters 2001. 14 p. .
  20. Moving mass attitude law based on neural networks. L Qin , M Yang . Proceeding of the sixth International Conference on Machine Learning and Cybernetics, ICMLC, (eeding of the sixth International Conference on Machine Learning and Cybernetics, ICMLC) 2007. p. .
  21. Support Vector Machines: Theory and Application, L Wang . 2005. Springer-Verlag Berlin Heidelberg.
  22. A new Stochastic Approach for Solution of Riccati Differential Equation of Fractional Order. M A Z Raja , J A Khan , I M Qureshi . 10.1007/s10472-010-9222-x. Ann Math Artif Intell Jan, 2011. 13.
  23. A new analytical approach to nonlinear vibration of an electrical machine. Nicolae Herisanu , Vasile Marinca , Toma Dordea , Gheorghe Madescu . Proceedings of the Romanian Academy, Series A 2008. 9 (3) p. .
  24. Application of optimal homotopy asymptotic method for solving nonlinear equations arising in heat transfer. Nicolae Vasile Marinca , Herisanu . International Communications in Heat and Mass Transfer 2008. 35 p. .
  25. Iacob Nemes, optimal homotopy asymptotic method with application to thin film flow. Nicolae Vasile Marinca , Herisanu . Central European Journal of Physics 2008. 6 (3) p. .
  26. An optimal homotopy asymptotic method applied to the steady flow of a fourth grade fluid past a porous plate. Nicolae Vasile Marinca , Constantin Herisanu , Bogdan Bota , Marinca . Applied Mathematics Letters 2009. 22 p. .
  27. On the formation of singularities of solutions of non-linear differential systems in antistokes directions. O Costin , R D Costin . 10.1007/s002. Inventiones mathematicae, 2001.
  28. Some solutions of the linear and nonlinear Klein-Gordon equations using the optimal homotopy asymptotic method. S Iqbal , M Idrees , A M Siddiqui , A R Ansari . Applied Mathematics and Computation 2010. 216 p. .
  29. Application of optimal homotopy asymptotic method for the analytic solution of singular Lane-Emden type equation. S Iqbal , A Javed . Applied mathematics and computation 2011. 217 p. .
  30. On the proposed homotopy analysis teachnique for nonlinear problems and its, S J Liao .
  31. Evolutionary algorithms in theory and practice, T Back . New York: Oxford University Press.
  32. Genetic algorithm for non-linear mixed integer programming problems and it's application. T Yokota , M Gen , Y X Li . Computer & Industrial Engineering 1996. 30 (4) p. .
Date: 2012-03 2012-01-15