# INTRODUCTION he singular phenomenon arises in the modeling of physical structures, random processes, control theory, networks synthesis and other areas of the applied sciences and engineering [1][2]. These singular non-linear systems have substantial significance in classical and modern science, as it defines the dynamics of a system [3]. The singular non-linear system of polytrophic and isothermal sphere is represented by the following non-linear second order homogenous equation: , 1 0 ) ( 2 ) ( 2 2 ? ? + ? ? ? ? ? ? ? = t y dt t dy t dt t y d ? (1) The tropic index is taken to be Author ? : Department of Electronic Engineering, International Islamic University Islamabad, Pakistan. E-mails : Junaid.phdee17@iiu.edu.pk, asif.phdee10@iiu.edu.pk Author ? : Department of Electrical Engineering, Air University, Islamabad, Pakistan. E-mail : imqureshi@mail.au.edu.pk It is essentially a Poisson's equation applied is the various modeling application like radioactively cooling, self-gravitating clouds and in the clusters of galaxies [4]. The analytic solution of the model given in equation (1) has been considered by the authors in the recent years by handling the singularity having the index ? . In the recent years, the merging of Homotopy idea with perturbation is applied for non-linear systems. [5]. Optimal Homotopy Asymptotic Method (OHAM) is established very recently by Marinca et al [6]. The OHAM have built in convergence criteria like HAM but is more flexible. From the contribution of Marinca et al [7][8][9] and Iqbal et al. [10] have proved generalization, effectiveness and reliability of the method to important engineering applications. The linear/nonlinear singular initial value problems have been solved by Iqbal et al. by using OHAM method. But no one yet tried to solve the singular non-linear system of Polytrophic and Isothermal sphere by using artificial neural network optimized by evolutionary computation. The applicability of artificial neural network (ANN) is remarkable for problem involving singularity and convex nature.In the last decay various scientists exploited ANN along with stochastic computational techniques, some of them are provided as a reference. Radial Bases functions neural networks were exploited to design a moving mass attitude control system [11] to control a vehicle with three axis stabilization in intra-atmospheric space. C. Monterola and C. Saloma [12][13] works on non-linear system represented by Schrodinger equation, this system is also formulated by FFNN. The flexibility of neural network and GA can be seen in the work carried out by Stackelberg [14] where Nash equilibrium was achieved by a hybrid intelligent algorithm in which fuzzy simulation, neural networks and genetic algorithms were integrated. Bumps and ruts on the roads cause the abrupt change in the rectilinear motion of the vehicles and adhesion coefficient. For a stable movement of the vehicle an appropriate breaking torque is needed. The optimization of this required torque in this problem can also be accomplished using the neural networks and genetic algorithms [15]. In this paper the mathematical modeling for singular non-linear system is performed by ANN with log-sigmoid as activation function. The optimization of algorithm. The result of the GA is provided as a start point for rapid local search. The optimal Homtopy asymptotic method and exact solution of the problem are analyzed with the proposed scheme. The scheme is run for 100 independent runs to get a comprehensive statistical analysis based on the minimum fitness achieved, maximum fitness and spread in the results on the based of mean and standard deviation. The timing analysis is provided to see the computational complexity of the method along with the level of accuracy. According to best of the author knowledge this is the first article in which stochastic methods are incorporated with NN to optimize the non-linear singular systems of Polytrophic and Isothermal sphere. The remainder of the paper is organized in the following way. The section 2 describes the importance of evolutionary techniques in optimization .In section 3 a mathematical modeling that contains neural network architecture of the singular system is explained. The numerical results along with discussion on the results are revealed in section 4. Finally section 5 presents some concluding remarks on the results along with directions to the future research. # II. # EVOLUTIONARY COMPUTATION The term evolutionary computation (EC), used vigorously for all evolutionary algorithms (EAs) this describes field of investigations. The major advantage of these techniques can be seen in practical difficult optimization problems. The major benefits are multifold, simplicity of the concept, robustness in changing circumstances, flexibility and other facets [16]. By this the EC has received special interest in the researchers for its applications in science and engineering. Because it is conceptually simple so no gradient information needs to be presented to the algorithms. The domain of EC is for all those problems that can have a function optimization task. The phenomenon of EC depends upon a data structure to represent solutions, the index of performance to evaluate solutions, and operators to generate new solutions from old [17]. The operator should takes care a behavioral link between parents and offspring's. A disjoint state space for possible solutions is formed which encompass infeasible regions, and time varying index or a function of competing solutions in the population [18]. The procedure of applicability is same for problems like, continuous-valued parameter optimization problems, discrete combinatorial problems, mixed-integer problems, and so forth [19]. # a) Genetic Algorithms The modern researches in genetic algorithms (GAs) has outline that the initial proposals were incapable of solving hard problems in a robust and efficient way. In large-scale Optimization problems, the execution time of first-generation GAs increases dramatically whereas solution quality decreases. Moreover the things such as encoding schemes, selection procedures, and self-adaptive and knowledgebased operators play a key role in the optimization of highly convex and stochastic ion nature problems. The birth of the GAs is also for optimization of various fields of interest [20][21]. Over and above the problems in which optimization itself is the final goal, it is also a way for achieving modeling, forecasting, control, simulation, and so forth. Traditional optimization techniques begin with a single candidate and search iteratively for the optimal solution by applying static heuristics. On the other hand, the GA approach uses a population of candidates to search several areas of a solution space, simultaneously and adaptively.The most popular methods that go beyond simple local search are GAs [22], simulated annealing (SA) [23], and tabu search (TS) [24]. Genetic algorithms operate on a population of individuals. Each individual is a potential solution to a given problem and is typically encoded as a fixed-length binary string, which is an analogy with an actual chromosome. After an initial population is randomly or heuristically generated, the algorithm evolves population through sequential and iterative application of three operators: selection, crossover, and mutation. A new generation is formed at the end of each iteration. The strongest aspect of the GA is, it does not get stuck in local minimum. # III. NEURAL NETWORK MATHEMATICAL MODELING The linear combination of log-sigmoid functions can be used a mathematical model of feed-forward ANN. The log-sigmoid is used as universal function approximator [25][26] as it has the tendency to model the non-linear systems effectively and efficiently in diverse fields of engineering [27][28][29]. Any network suitably trained to approximate a mapping satisfying some ODE will have an output function that will also approximate the DE [30]. In this feed-forward ANN, the input and output layers used linear function as activation while log-sigmoid is used for hidden layers. The following continuous mapping is employed for the function, its first and second derivatives respectively, where the activation function is considered to be log-sigmoid and is given in expression ( 5) ), ( ) ( ?1 i i m i i b t w t y + = ? = ? ? (3) ) ( ) ( ?1 i i m i i b t w dt d dt t y d + = ? = ? ? (4) ), ( ) ( ?22D D D D I 2012 March t e t ? + =1 1 ) ( ? (6) Therefore the error function formed by the neural networks given (3) to ( 5) is formed as , 3 , 2 , 1 2 1 ? ? = + = j j j j ? ? ? (7) where j is the number of generations. j s i i i i i j t y dt t y d t dt t y d s ? = ? ? ? ? ? ? ? ? ? + = 1 2 5 2 2 1 ) ( ) ( 2 ) ( 1 ? (8) while the error subject to initial condition is given in (9). ( ) ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? + ? = 2 2 2 ) 0 ( 1 ) 0 ( 2 1 y dt d y j ? (9) The linear combinations of networks from (3) to (5) can approximately model the system given in (1). It is named as differential equation neural (DEN) network, whose architecture is given in the Fig. 1; the activation function used in this is log-sigmoid. The learning procedure adopted in GA and basic flow chart is provided in one of our last article [31]. w i 1 b i x + f(wit+bi) ?i d/dt[f(wit+bi)] d 2 /dt 2 [f(wit+bi)] ?(t) ?i d/dt [?(t)] ?i d 2 /dt 2 [?(t)] + 1 d 2 /dt 2 [?(t)] + 2/t d/dt [?(t)] - ?(t) 5 Input Hidden Layer Output 1 x m 1 x m (0,T) 2 /t -1 ?(t) 5 # RESULTS AND DISCUSSION In this section, we shell consider the solution of (1) by the proposed scheme. In order to prove the applicability and effectiveness of the proposed scheme for singular system the solution of OHAM and exact solution is compared with the results attained by the given approach. However, the statistical analysis is also carried out for the solvers to see the reliability and depth of the algorithm. Moreover, the time complexity of the scheme is also provided in the discussion. The exact solution of expression ( 1) is [32]: . 3 1 ) ( 2 1 2 ? ? ? ? ? ? ? ? ? + = t t y (10) The OHAM method series solution is generated by taking zero-order, first-order and second-order solution respectively [10], and the final reported expression is as follow: Now, the singular non-linear system of Polytrophic and Isothermal sphere is solved by the proposed scheme as well, the number of neurons in each hidden layer of the DEN network are taken to be m = 10 that results in 30 unknown adaptive weights (? i , w i and b i ). The optimization of these weights is carried out using built-in function for GA in MATLAB. The parameter setting used for the execution of the algorithm is given in Table 1. # Table 1 : Parameters setting of the algorithms The input of the training set is taken from time t ? (0, 1) with a step size of 0.1. It means that the total time steps m = 11 so the fitness function is formulated as: ( ) ? 3 , 2 , 1 , ) 0 ( 1 ) 0 ( 2 1 ) ( ) ( 2 ) ( 11 1 11 1 2 2 2 5 2 2 = ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? + ? + ? ? ? ? ? ? ? ? ? + = ? = j y dt d y t y dt t y d t dt t y d j i i i i i j ? (12) where j be the iteration index, The scheme runs iteratively to find the minimum of fitness function ej, with stoppage criteria as 3000 number of runs or fitness value e j ? 10 -9 whichever comes earlier. One of the unknown weights learned by given scheme with fitness value 7.2039e-11 is provided in Table 2. These weights can be used in equation ( 3) to obtain the solution of the equation for any input time t between 0 and 1. # 2012 # March The comparison of the results is made with OHAM for the same ranges of the inputs as taken for stochastic numerical method. The results are summarized in Table 3 in comparison of the exact solution. It is clear from the results that the accuracy of the given method is in a good agreement with exact solution and also comparatively excellent with OHAM method. The absolute error of the OHAM is in the range 1.0e-5 to 1.0e-4 while the proposed scheme has the error from 1.0e-7 to1.0e-6. The derivative of the system representing in expression ( 1) is also approximated by the given scheme to check the depth in the method. The results are summarized in Table 4 upto twelve decimal places. It is quite evident from the table that the results obtained by neural network optimized by evolutionary computation is cable to find the derivative of the systems as well by using the same weights as given in Table 2. Moreover, the reliability of the stochastic algorithm is being tested by a comprehensive statistical analysis. The analysis is performed in the complete range of the time between 0 to 1 and the results are narrated in table 5. The references of the analysis are the mean, standard deviation, best and worst values of the absolute error of proposed method with exact solution. It is quite evident from the table 5, that the Best and Mean absolute error of both the system is in the range 1e-04 to 1e-06 and 1e-06 respectively. The value of the worst of the absolute error is 1e-04 that is even remarkable. 0.000000000000 0.000001840886 -0.000001840886 0.1 -0.033277916282 -0.033178401419 -0.000099514863 0.2 -0.066226617853 -0.065360105484 -0.000866512369 0.3 -0.098532927816 -0.095661581246 -0.002871346570 0.4 -0.129913960492 -0.123332491326 -0.006581469167 0.5 -0.160128153805 -0.147807897045 -0.012320256761 0.6 -0.188982236505 -0.168732906775 -0.020249329729 0.7 -0.216333959525 -0.185959935851 -0.030374023674 0.8 -0.242091013068 -0.199524924233 -0.042566088834 0.9 -0.266206952825 -0.209610660651 -0.056596292174 March Fig. 2 V. CONCLUSIONS AND FUTURE REMARKS On the basis of simulation and results provided in the last section it can be concluded that: The stochastic solvers based on DEN networks optimized with hybridized genetic algorithm can effectively provides the solution of the Non-Linear Singular System of Polytrophic and Isothermal sphere model. The mean of the absolute error lies in range of 10 -06 . The reliability and effectiveness of proposed artificial intelligence techniques are validated from statistical analysis base on 100 independent runs. It is found that the confidence interval for the convergence of the given approach 100% to get an approximate solution in a acceptable error range. It has been observed that the proposed scheme show the supremacy on the optimal Homotopy asymptotic method in comparison with the exact solution. Moreover, the proposed scheme can readily provide the solution on the continuous grid of time. Thus this provides an alternate approach to researchers to apply the solver to complex real life problems in engineering. In future, one can look for application of other artificial intelligence techniques base on neural networks optimized with ant/bee colony optimization, genetic programming, particle swarm optimization and differential evolution etc. for solving such vast applications. # Global Journal of Researches in Engineering # References Références Referencias The value of the fitness functions are computed for 100 independent runs to have a close look on the optimization behavior of various input times. The value of the functions for some of the input times are drawn the descending order. The results are plotted on the semi log scale as the difference between the results for various inputs times are merely negligible. The optimization behavior is drawn in the Fig. 2 in descending order for 100 independent runs. Finally it has been concluded from the figure that the convergence capability of the given scheme is 100% for all input times between 0 and 1. Moreover, the absolute error for 12% of the independent runs is in the range 10 -03 to 10 -05 while 88% lies in the range 10 -05 to 10 -09 . ![Journals Inc. (US)](image-2.png "") 1![Fig.1 : The DEN network of the Singular system](image-3.png "Fig. 1 :") 2GA12IVolume XII Issue v v v v I Version( )Global Journal of Researches in Engineering© 2012 Global Journals Inc. (US) 4 513Volume XII Issue v v v v I Version I( )Global Journal of Researches in Engineering© 2012 Global Journals Inc. (US) 3ty exacty ohtmy GA-AsA| y exact -y ohtm | | y exact -y GA-ASA |0.0 1.00000000 1.00000000 0.99999987 0.00000E+001.27568E-070.1 0.99833749 0.99837760 0.99833660 4.01135E-058.84555E-070.2 0.99339927 0.99354412 0.99339754 1.44856E-041.73096E-060.3 0.98532928 0.98560071 0.98532741 2.71434E-041.87168E-060.4 0.97435470 0.97471595 0.97435312 3.61242E-041.58756E-060.5 0.96076892 0.96112583 0.96076766 3.56912E-041.26070E-060.6 0.94491118 0.94513382 0.94491012 2.22638E-041.06611E-060.7 0.92714554 0.92711078 0.92714455 3.47643E-059.88417E-070.8 0.90784130 0.90749501 0.90784036 3.46293E-049.37937E-070.9 0.88735651 0.88679225 0.88735566 5.64264E-048.50186E-071.0 0.86602540 0.86557566 0.86602468 4.49742E-047.25942E-07 * Stability criteria for singular systems FNKoumboulis BGMertzios Journal of Neural, Parallel and Scientific Computations 13 2 2005 * Direct solution of continuous time singular systems based on the fundamental matrix BGMertzios Proc. Of the 8th IEEE Mediterrenean Conference on Control and Automation Of the 8th IEEE Mediterrenean Conference on Control and AutomationRio, Patras, Greece Med 2000. 2000 * On the formation of singularities of solutions of non-linear differential systems in antistokes directions OCostin RDCostin 10.1007/s002 Inventiones mathematicae 2001 * Generalized laguerre polynomials collocation method for solving Lane Emden equation KParand ATaghavi Applied Mathematical Sciences 2 60 2008 * On the proposed homotopy analysis teachnique for nonlinear problems and its SJLiao * Computational complexity and observation of physical signals CSaloma J. Appl. Phys 74 1993 * Characterizing the dynamics of constrained physical systems with unsupervised neural network CMonterola CSaloma Phys Rev E 57 1998 * Fuzzy multilevel programming with a hybrid intelligent algorithm JGao BLiu Computers and Mathematics with applications 49 2005 Uncertainty Theory Laboratory, Department of Mathematical Sciences, Tsinghua University Cited 12 times * Support Vector Machines: Theory and Application LWang 2005 Springer-Verlag Berlin Heidelberg * Evolutionary computation: Toward a new philosophy of machine intelligence DBFogel 2000 IEEE Press Piscataway, NJ 2nd edition * Schema processing under proportional selection in the presence of random effects DBFogel AGhozi IEEE Trans Evol Computat 1 4 1997 * Genetic Programming JRKoza 1992 MIT Press Cambridge, MA * Evolution and optimum seeking H-PSchwefel New York * Evolutionary algorithms in theory and practice TBack Oxford University Press New York * Evolutionary Computation: Towar a new philosophy of machine intelligence DBFogel 2006 John Wiley & Sons, Inc Hoboken, New Jersey 3rd Edition * Genetic algorithm for non-linear mixed integer programming problems and it's application TYokota MGen YXLi Computer & Industrial Engineering 30 4 1996 * Modern Huristic Optimization Techniques: Theory and application to power systems KYLee MAEl-Sharkawi 2008 John Wiley & Sons, Inc Hoboken, New Jersey * Integrating genetic algorithms, tabu search and simulated annealing for the unit commitment problem AHMantawy YLAbdel-Magid SZSelim IEEE Trans Power Systems 14 3 1999 * Neural Network Method for solving the partial Differential Equations LPAarts PV DVeer Neural Processing Letters 14 2001 * Solving differential equations with constructed neural networks LGTsoulos DGavrilis EGlavas Neurocomputing 72 10 2009 * Swarm Intelligence for the problems of Non-linear differential Equations and its application to Well Known Wessinger's Equation JAKhan MA ZRaja IMQureshi EJSR 34 4 2009 * Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark functions JBrest SGreiner BBoskovic MMernik VZumer IEEE Transactions on Evolutionary Computation 10 6 2006 * A new Stochastic Approach for Solution of Riccati Differential Equation of Fractional Order MA ZRaja JAKhan IMQureshi 10.1007/s10472-010-9222-x Ann Math Artif Intell 13 Jan, 2011 * Solving differential equations with unsupervised neural networks DRRarisi J. Chemical Engineering and Processing 42 2003 * Stochastic Computational Approach for Complex Non-linear Ordinary Differential Equations JAKhan MA ZRaja IMQureshi 10.1088/0256-307X/28/2/020206 Chin. Phys. Lett 28 2 2011 * Application of optimal homotopy asymptotic method for the analytic solution of singular Lane-Emden type equation SIqbal AJaved Applied mathematics and computation 217 2011 * A new analytical approach to nonlinear vibration of an electrical machine NicolaeHerisanu VasileMarinca TomaDordea GheorgheMadescu Proceedings of the Romanian Academy, Series A 9 3 2008 * Application of optimal homotopy asymptotic method for solving nonlinear equations arising in heat transfer NicolaeVasile Marinca Herisanu International Communications in Heat and Mass Transfer 35 2008 * An optimal homotopy asymptotic method applied to the steady flow of a fourth grade fluid past a porous plate NicolaeVasile Marinca ConstantinHerisanu BogdanBota Marinca Applied Mathematics Letters 22 2009 * Iacob Nemes, optimal homotopy asymptotic method with application to thin film flow NicolaeVasile Marinca Herisanu Central European Journal of Physics 6 3 2008 * Some solutions of the linear and nonlinear Klein-Gordon equations using the optimal homotopy asymptotic method SIqbal MIdrees AMSiddiqui ARAnsari Applied Mathematics and Computation 216 2010 * Moving mass attitude law based on neural networks LQin MYang Proceeding of the sixth International Conference on Machine Learning and Cybernetics, ICMLC eeding of the sixth International Conference on Machine Learning and Cybernetics, ICMLC 2007