Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: there are many open problems of optimization in systems and control theory , often non - smooth , non - convex and np - hard or of unknown complexity . because of the success obtained with linear matrix inequalities ( lmis ) since the mid - nineties , a general tendency in the system and control literature is to formulate many of these problems with bilinear matrix inequalities ( bmis ) or lmis plus a non - convex rank constraint . once these formulations obtained , the usual techniques for trying to solve these problems are iterative linear matrix inequalities algorithms ( ilmis ) . such algorithms solve successively different lmi subproblems of the original bmi formulation . however , these algorithms loose the guaranteed polynomial time complexity of lmi solvers but more importantly most do not have guaranteed convergence to locally optimal solutions ( i.e. global convergence when starting from any feasible initial solution ) . such ilmis , heuristics without global convergence , are then likely to be outperformed by other methods like general purpose optimization solvers . this is the fact that we aim at putting forward with the current paper : much research work sticks to a unique approach , like bmis / lmis , and ignores alternative formulations which can however be much more appropriate .    the performance can be compared in three directions : 1 ) objective value , 2 ) computational time and 3 ) user time . more details will be given in the paper but we already outline here some key elements . 1 ) the methods that will be proposed are often found in the literature to behave well on non - smooth functions and some are proved globally convergent on smooth functions . this is not the case for many ilmis . 2 ) on non - smooth and non - convex problems there are no worst - case complexity bounds neither for the proposed methods nor for ilmis . thus , on this front , only experience will tell . 3 ) the time required by the user to implement the method is clearly smaller with general purpose optimization solvers , which are intended to minimize any user - defined function @xmath0 . formulating a problem under that form may be done in a matter of minutes or hours . but developing a theoretically consistent ilmi algorithm , along with a working implementation , can easily require several weeks . this is by the way admissible in fundamental research but clearly unacceptable in the industry .      to illustrate the point of the paper , we will consider a problem for which an ilmi approach was recently proposed @xcite . this problem is the design of a reduced - order positive filter for linear systems . positive systems , found in many areas ( see @xcite ) , are dynamic systems with state variables and outputs positive at all times . the filter to be designed has to estimate an unmeasured output ( @xmath1 ) of a system ( @xmath2 ) from the measurements ( @xmath3 ) , with minimum objective value chosen as the @xmath4 norm of the filtering error transfer function ( @xmath5 ) between the exogenous disturbance signal ( @xmath6 ) and the error ( @xmath7 ) : the difference between the output ( @xmath1 ) and its estimate ( @xmath8 ) . details on the problem motivations and challenges are given in the introduction of @xcite , here only the elements necessary to reproduce the contribution are recalled . consider the following asymptotically stable discrete - time system : @xmath9 the notations are classical and identical to those of @xcite , where all terms are more formally detailed . this system is positive if and only if the matrices @xmath10 have only positive entries @xcite . note also that in this paper we only require the positivity of the filter to be designed and not of the system @xmath2 , but it can be assumed because otherwise it is not necessary to design a positive filter .    the aim of the filter is to compute an estimation @xmath11 of the unmeasured signal @xmath12 in @xmath2 from the measured signal @xmath13 . more specifically , we want to build the following filter : @xmath14 where @xmath15 are the filtering parameters to be determined , matrices having only positive entries to ensure the positiveness of @xmath11 @xcite . the difficulty of designing this filter stems from that particular requirement , which prevents the application of methods normally used for this kind of problem ( see @xcite and ref . therein ) .    defining @xmath16^t$ ] and @xmath17 , we get from ( [ sys ] ) and ( [ filt ] ) the description of the filtering error system : @xmath18 where @xmath19 the transfer function of the filtering error system @xmath20 is given by : @xmath21 the problem considered is defined hereunder .    _ reduced - order minimal @xmath4 positive filtering problem : _ @xmath22 this problem is a generalization of the one in @xcite . the difference is that we do not only seek a filter respecting a given level @xmath23 but we rather wish to minimize this level . this objective is more meaningful and also more practical for the user who does not need to choose an arbitrary level @xmath24 beforehand . note that considering the expression of @xmath25 , since @xmath2 is stable we have that the filtering error system @xmath20 is stable iff the filter @xmath26 is stable . the problem above can be expressed as either of the two following optimization problems of minimizing an objective function @xmath0 : + _ the unconstrained problem : _ @xmath27 _ the constrained problem : _ @xmath28 where @xmath29 is the number of variables in @xmath30 , the vector containing the entries of @xmath31 . these problems can actually be dealt with many general - purpose optimization solvers . amongst these we outline some direct search ( ds ) methods , using the unconstrained formulation : the mesh adaptive direct search ( mads ) @xcite , the multidirectional search ( mds ) @xcite , the alternative directions @xcite , the nelder - mead algorithm ( nm ) @xcite , the particle swarm optimizer ( pso ) @xcite ( see @xcite for the latest survey on ds methods ) . we also mention gradient - based methods , which standard and widely known principles are implemented e.g. in the following two functions of matlab : ` fminunc ` for the unconstrained formulation and ` fmincon ` for the constrained formulation , both methods estimating numerical gradients when the expression of the gradient of @xmath32 is not given ( see the matlab help @xcite and references therein for detailed descriptions ) . all these methods can be used for the problem discussed here .    note that when the expression of an ( estimate ) of the gradient is known , more evolved techniques can be developed ( like @xcite ) to ( try to ) reduce the computational time , especially for problems with larger number of variables . for complex problems like the one considered , the gradient information is useful to accelerate the search but without guarantee to find better optima than methods which do not use this information ( see benchmarks in @xcite ) .      for illustration purposes we put forward one method in particular , the nelder - mead algorithm ( nm ) . this method is probably the most popular algorithm for unconstrained minimization of problems of moderate dimension ( e.g. @xmath33 50 to 100 variables ) . the central question is whether locally optimal solutions can be reached , which is not guaranteed for complex problems with most ( if not all ) iterative linear matrix inequality algorithms ( ilmis ) including the one proposed in @xcite , as motivated in the introduction . note that for further illustration , we will also use several other methods than nm in the next section . the nm algorithm does not appear often in ( recent ) systems and control literature . this algorithm was first proposed almost fifty years ago in @xcite and belongs to the class of ds methods . these methods , characterized by the fact that they do not build a model of the objective function , belong to the broader class of derivative - free optimization methods which do not use any gradient or hessian information . the reader is referred to the last survey on ds methods ( * ? ? ? 1.4 ) for a broader description . the basic ideas behind nm are briefly described in the next paragraph , detailed descriptions can be found in @xcite or @xcite . the first step is the generation of an initial simplex of @xmath34 solutions around and including the provided initial solution . the objective function is evaluated at each of these @xmath34 solutions and sorted from the best to the worst . then nm chooses iteratively between several possibilities ( or steps ) to change the shape of the simplex ( eventually displacing it ) , trying to find better solutions . for example the basic step is that the worst solution is reflected on the other side of the simplex , in order to create a ` downhill ' effect . two easily available implementations of nm are the ` fminsearch ` function in the optimization toolbox of matlab @xcite or the ` nmsmax ` function of @xcite . it must be noted however that these implementations may fail to converge to locally optimal solutions , starting from a feasible initial solution . indeed the original nm can fail because of the deterioration of the simplex geometry or lack of sufficient decrease . however the convergence of the method can be guaranteed on smooth functions by taking care of these situations , which is done for example in @xcite where an additional step ensuring the convergence is proposed . actually there is a third easily available implementation , the grid restrained nm algorithm @xcite . this algorithm enjoys , like @xcite , guaranteed convergence on smooth functions and will also be used in our tests .    an earlier method to improve the convergence of nm proposed in @xcite consists of an involved restarting strategy . here we suggest a method with easier implementation : restarting the algorithm until the latest obtained objective value is not better than the previous one to a given accuracy . this does not formally guarantee the convergence to local solutions on smooth objective functions but renders it much more likely . indeed , restarting nm regenerates its simplex and this allows in practice to properly span the space @xmath35 around the last solution . anyway , the hypothesis for convergence analysis in @xcite require that the function be smooth . and as pointed out in @xcite , the @xmath4 norm objective function is non - smooth and this may cause the algorithm -or any of the techniques cited above- to stop at suboptimal solutions . this is the reason why we will use not only @xcite but also try the idea of restarting nm in the results section . we summarize that the point is not to guarantee the convergence to locally optimal solutions for all optimizations , which require smooth objective functions , but instead to propose an easily implementable technique that performs well and in practice often reaches locally optimal solutions even for non - smooth objectives functions . nelder - mead with local restart(s ) can be more formally defined as :    @xmath36@xmath37 ; @xmath38 ; ( @xmath39 ) @xmath40 ; @xmath41@xmath42 ; @xmath43 ; * return * @xmath44    where @xmath44 is the solution after optimization @xmath45 , @xmath46 the initial solution , @xmath47 contains the stopping criteria and tolerances of the nelder - mead implementation , @xmath48 is the absolute value , @xmath49 is the stopping accuracy required for @xmath50 , the relative improvement between the last and the current objective value . we already mention another kind of useful restarts , also suggested e.g. in @xcite , the global restarts ( or multi - starts ) . these consist simply of running other optimizations from other different initial solutions @xmath46 . the aim of these global restarts allows to better span the search space which is useful to try to : 1 ) get around the non - smoothnesses that could have caused other optimizations to stall , for non - smooth objective functions 2 ) to find better local optima ( nearby ) , for multimodal objective functions 3 ) get away from suboptimal solutions against the infinite penalization barrier , which is an implicit constraint . by obtaining an increasing number of final solutions having the best objective value found so far ( to a given accuracy ) , we get increasing probabilities that these solutions are locally optimal and in a lesser measure globally optimal . this illustrating algorithm may compete with other methods , e.g. with @xcite using benchmarks of static output feedback optimization in @xcite . it can often find the same objective values or even better ones , possibly in shorter computational times although this is more an exception rather than the rule , the main drawback being the lack of explicit handling of non - smoothnesses as proposed in @xcite . the main advantage is the great flexibility to handle any objective function @xmath51 , only some of which can be written under other frameworks like lmis . moreover , even without using gradient information , it can often lead to locally optimal solutions . also , unlike usual quasi - newton methods , nm has the ability to explore neighboring valleys with better local optima and likewise this exploring feature may allow nm to overcome non - smoothnesses .    the flexibility is what makes it a candidate of choice for dealing with designs requiring particular structures or properties , such as ensuring the positivity of the solution like desired in this paper , while exploring a non - smooth objective function . more precisely , nm will be particularly efficient for optimization objectives as an alternative to ilmis , as motivated before and described further as follows . ilmis are often efficient for feasibility problems such as finding a stabilizing controller , possibly also ensuring a given performance level , even though they may fail to find a solution even if there exists one ( see @xcite ) . however when used for minimization problems , like minimizing a norm of a performance channel , ilmis have in general no guarantee of convergence to locally optimal solutions ( as discussed in @xcite and noted in @xcite ) . for instance in @xcite this stems essentially from the fact that the objective minimization would require a combinatorial optimization problem involving the objective ( @xmath24 ) and a parameter ( @xmath52 ) . considering this important drawback , other methods should be used instead of ilmis for objective minimizations . ilmis can be useful when obtaining feasible ( e.g. stable ) initial solutions is not trivial , which is not the case here ( the system is already stable ) . and then more suited methods should be used for optimizing the objective , like ds methods .    indeed using these methods can often lead to locally optimal solutions , unlike the algorithm of @xcite that produces suboptimal solutions under an a - priori defined level @xmath24 . although the non - smoothness prevents guarantees of local optimality for direct search methods , it is conjectured at places in the literature that this does not happen often ( see ref . in @xcite ) . how ` often ' depends on the density of non - smoothnesses in the objective function and in particular at ` partial ' optimal solutions , optimal in some but not all directions . this is actually a matter of debate , on which the reader is advised to consult e.g. @xcite and the references therein . and as noted before , global restarts can be used to try to reduce the likeliness of getting stuck at a suboptimal solution . many optimization problems in systems and control can be quickly implemented to be solved with ds methods . indeed the objective function is easily built and evaluated with adequate methods , for example the functions from the control system toolbox of matlab . so there is no need to modify or add cumbersome lmis , which are also especially large with the technique of @xcite ( see the matrix inequality ( 16 ) there ) . likewise the unhandy implementation of an ilmi is avoided , moreover often involving parameter(s ) for which no automatic a priori choice can be made . in short , the method can be implemented in a brief time even by non - expert users . also ds methods are useful for simulation - based optimization ( * ? ? ? 1.21 ) , where more intricate objective functions that could hardly be obtained from analytical expressions are computed using simulation results ( illustration given in next section ) . an important remark can be made regarding the worst - case computational complexity bounds . in @xcite we can read that mds and nm are not competitive with more sophisticated methods such as ( quasi-)newton methods when applied to smooth problems . indeed it seems clear that gradient expressions and moreover hessian information should accelerate the search . however a recent result @xcite proves that directional ds methods share the worst - case complexity bound of steepest descent for the unconstrained minimization of a smooth function . this gives further motivation to consider ds methods . let us also mention that the formulation of the problem in @xcite requires many matrix variables @xmath53 , @xmath54 and three scalars @xmath55 -with @xmath56 entering non - affinely the matrix inequalities , thus the need of an ilmi- whereas here we only need the original variables @xmath15 which put together lead to the same size as only @xmath57 in @xcite . using lmis leads to this typical key problem of inflation of size and number of variables for large systems ( @xmath2 and @xmath26 ) . instead , with general purpose solvers , only the original problem s variables ( @xmath26 ) are used . lmi problems are solved efficiently with interior point methods converging to the optimum in worst - case polynomial time . this is not guaranteed with the method proposed here , but also not with ilmis , since the iterative scheme does not preserve the polynomial time complexity . in practice nm deals well with problems with limited number of variables ( e.g. @xmath33 10 - 20 ) but its performances decrease notably for larger number of variables ( e.g. @xmath58 50 - 100 ) . as noted before , one should then use the advantage that ds methods can handle problems formulations with the least number of variables . the positive system considered is given by @xcite : @xmath59 & 0.0510\\          0.1021 & 0.1250          \end{bmatrix}w_k\ ] ] @xmath60 the objective is to estimate @xmath61x_k = x_k^1 $ ] . for the problem considered , any positive and stable filter can be used as initial solution . since like in @xcite we want to design a first order filter , we can choose the scalar @xmath62 in @xmath63 and the other variables in @xmath64 . we then simply use ` rand ` of matlab to generate the random initial solutions ( entries chosen uniformly in @xmath65 $ ] ) . performing three optimizations , each from a different random initial solution , gives us the best following solution :    @xmath66 , \hat{c } = 0.15218,\ \hat{d } = \left[0.15435\ 0.10931\right]\ ] ] instead of the solution in @xcite : @xmath67 , \hat{c } = 0.14130,\ \hat{d } = \left[0.17889\ 0.34404\right]\ ] ] let it be clear that we do not need the solution of @xcite as initial solution , indeed here we simply use independent random feasible solutions and therefore the proposed technique is self - standing . perhaps for some particular problems ilmis would be necessary to find initial solutions , but this is not the case here . we nevertheless give as further information what happens when using the solution of @xcite as initial solution , at the end of this section . note also that since linear systems admit an infinity of equivalent state - space representations , we can restrict the search space to one representation ( e.g. by fixing here @xmath68 ) . on the one hand , reducing the number of variables reduces the computational time . on the other hand , this removes the possibility for ds methods to explore different state - space coordinates , therefore reducing their ability to find better local optima and getting around non - smoothnesses or away from the border of ( implicit ) constraints . two of the three solutions found have a @xmath4 performance level around @xmath69 , significantly better than the level @xmath70 reached in @xcite . we present in fig . [ fig1 ] the same simulation as in @xcite of the actual state @xmath71 and its estimations , using the following initial condition of the error system : @xmath72^t$ ] and exogenous disturbance input : @xmath73^t$ ] . , estimations and corresponding errors @xmath74.,height=340 ]    the gain of performance level can be seen , with a maximum absolute error about three times smaller with the restarted nm . a third simulation response is also provided , obtained by minimizing an objective specific to this simulation : the sum of the absolute values of the errors @xmath74 . the obtained filter is given by : @xmath75 , \hat{c } = 0.3,\ \hat{d } = \left[0.000046\ 0.0607\right]$ ] . this gives an illustration of simulation - based optimization .    to give further illustration of the performance of the proposed method , we run 100 optimizations each starting from a different random initial solution . we then give the minimum and the average of all 100 obtained objectives values . also we give the percentage of objectives values that were smaller than 0.1415 and of those smaller than 0.0448 . as last indication , we give the average of the 100 computational times required in seconds . we perform these tests with the proposed technique as well as with other optimizations techniques , each using the same 100 random initial points . the results are given in table [ result100 ] . [ result100 ]    .comparison of objective values and computational times [ cols="<,<,<,^,^,^",options="header " , ]     the methods are named after their matlab implementation file : 1 ) ` fminsearch ` , the matlab optimization toolbox nm implementation 2 ) the same with local restart(s ) , as described in the previous section 3 ) ` nmsmax ` , n. higham nm implementation @xcite 4 ) the same with local restart(s ) 5 ) ` mdsmax ` n. higham mds implementation @xcite @xcite 6 ) the grid restrained nm algorithm ` gridnm ` @xcite , proved convergent on smooth functions 7 ) ` fminunc ` also using the unconstrained formulation ( using @xmath76 instead of @xmath77 for constraint penalization ) 8) ` fmincon ` , the only method using the constrained formulation of the problem . + all accuracies required : ` tolf ' , ` tolx ' , ` tolcon ' ( see matlab help @xcite for descriptions ) , @xmath49 and the accuracies in ` nmsmax , mdsmax , gridnm ` have been set to @xmath78 as well as the tolerance of the objective @xmath79 ( ` norm(g , inf , tol ) ` ) evaluation . also the numbers of iterations and functions evaluations were not limited ( e.g. ` maxiter ' and ` maxfunevals ' set to inf ) .    except for 7 ) , at least 96% of the trials give a better performance level than 0.1415 from @xcite . this is a first illustration of how general purpose optimization solvers might compete with ilmis . observe then the results 2 ) , 4 ) and 6 ) , obtained with improved nm . as can be seen these have high success rate at reaching objectives values very close to the best one found . 4 ) is especially good since it was 100 % successful . considering this , even though @xmath51 is non - smooth here , the solutions found with objective value @xmath80 are very likely locally optimal and probably globally as well . this illustrates the efficiency of the method put forward . the average computational times are under the minute , therefore the methods are not only convenient to encode but also reasonably fast to run . note that the computational times could be shortened by using gradient expressions like in @xcite or , as suggested in @xcite , by interrupting the bisection algorithm computing the @xmath4 norm once it is sure that the solution being evaluated is better or worse than the other solutions . according to one of the authors in @xcite the computational time required there was around a few seconds , which is comparable to those required here . we also run the different alternatives starting from the solution in @xcite , which gives the following improved objectives values : 1 ) 0.1395 2 ) 0.0565 3 ) 0.0455 4 ) 0.0447 5 ) 0.0466 6 ) 0.0449 7 ) 0.1391 8) 0.0454 . we see that two methods were unable to improve the solution of @xcite to be close to the objective value 0.0447 , which gives an indication that this solution is badly located . indeed its very small @xmath81 matrix , ` blocked ' near the positivity constraint , almost cancels the effect of the dynamical part of the filter : the solution in @xcite can be approximated by a static filter ( the @xmath82 matrix ) with almost no impact ( 0.003@xmath83 ) on the objective in ` norm ` instead of the default @xmath84 . on this matter we also mention that an important element for the performance of ilmis is to try to stay away from the borders of the bmi feasible set ( using e.g. ( * ? ? ? 4.3 ) ) , otherwise the algorithm may stall early at partial optimal solutions . considering the heuristical nature of ilmis , which can be efficient for feasibility problems but have in general no guarantee of convergence to locally optimal solution for minimization objectives nor a bound on the worst - case complexity , many other methods can be used as competitors of such techniques . the problem of @xcite , designing a reduced - order positive filter to estimate the output of a positive system under a given maximum @xmath4 error level @xmath24 , is dealt with in that paper using an ilmi and indeed it can be read there that the convergence of the algorithm is not guaranteed . this motivates us to propose techniques where the @xmath4 error level is minimized . we then consider a less restrictive approach than ( i)lmis and reformulate the problem so as to be solvable by general purpose optimization solvers . in particular , we put forward the nm algorithm improved with local restarts that can behave well even with non - smooth objective functions . this approach has apparently only advantages compared to that of @xcite . it is easy to encode and use even by non - expert users . it is more flexible , i.e. straightforward to modify for example to 1 ) handle continuous - time systems 2 ) change the objective into @xmath85 minimization or multi - objectives 3 ) take into account complex requirements such as a structure of the solution . the inflation of size of the system -but not necessarily of the filter- will have a smaller impact on the computational time than techniques using lmis , since the only variables are those of the filter to be designed ( no additional variables needed , like lyapunov matrices ) . also the technique often leads to locally optimal solutions , where ` often ' depends on the objective to be minimized , whereas this should be seldom the case with most ilmis ( see @xcite and references therein , in particular @xcite ) . finally since it is generally fast for moderate size problems , it can be run multiple times from several feasible initial solutions . and so by getting several times the same best solution one gets an increasing probability that this solution is indeed locally optimal or even globally optimal .    in the end our claim is that most open optimization problems in systems and control should not be handled with conservative lmi formulations , except for providing an initial suboptimal solution . indeed conservative lmi formulations or ilmis to deal with bmi problems typically do not have guaranteed convergence to local optima . to get locally optimal solutions one will need to use other approaches , the best two methods being probably @xcite , which use gradient expressions and take non - smoothnesses into account . nevertheless the method proposed can be a competitor to these techniques by finding the same or better objectives . also the set of problems that can be solved by ds methods is broader than those dealt with the methods in @xcite , thanks to the great flexibility offered by the general objective formulation @xmath51 and without need of gradient expression . the authors thanks ping li for comments on the manuscript and rpd brmen for providing the grid restrained nm implementation @xcite . this research is supported by the belgian network dysco ( dynamical systems , control , and optimization ) funded by the interuniversity attraction poles programme of the belgian state , science policy office . e.  simon , p.  rodriguez - ayerbe , c.   stoica , d.  dumur , and v.  wertz . lmis - based coordinate descent method for solving bmis in control design . in _ 18th ifac world congress _ , august 2011 .
Abstract:

Answer: the motivation of this work is to illustrate the efficiency of some often overlooked alternatives to deal with optimization problems in systems and control . in particular , we will consider a problem for which an iterative linear matrix inequality algorithm ( ilmi ) has been proposed recently . as it often happens , this algorithm does not have guaranteed global convergence and therefore many methods may perform better . we will put forward how some general purpose optimization solvers are more suited than the ilmi . this is illustrated with the considered problem and example , but the general observations remain valid for many similar situations in the literature . optimization ; linear systems ; positive filtering


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: since their discovery by iijima in 1991,@xcite carbon nanotubes and their fascinating properties have attracted the attention of both theoretical and experimental physicists.@xcite nanotubes are basically long cylinders , their walls being formed from one ( single - walled carbon nanotubes , swcn ) or several ( multiple - walled ones , mwcn ) graphite sheets . one of its more important features is its extremely narrow width , with diameters in the nanometer scale , ranging from @xmath2 7 to 40  , compared to its length , thousands of times larger . the enormous length to diameter ratio and the narrowness of the tube make nanotubes excellent systems to hold inside nearly perfect one - dimensional fluids . moreover , as a consequence of its narrowness , the adsorption energy of an atom or molecule inside a carbon nanotube is several times greater than on planar graphite . this feature ensures that any particle of adequate size will be swallowed inside carbon nanotubes , provided that the half - fullerene caps at their ends are removed . its use as a possible solution to the packing of h@xmath0 in fuel cells has been discussed in the literature . @xcite    apart from its technological interest , the quasi - one dimensionality of these carbon tubes is itself an interesting property from a purely theoretical point of view . in the same way that a sheet of graphite provides an almost perfectly 2d experimental environment , the small transversal room available to the particles adsorbed in a narrow carbon nanotube creates a proper setup to extract experimental information of quasi - one - dimensional systems . additionally , if the temperature is low enough , quantum effects become important , and an experimental realization of a quasi - one - dimensional quantum fluid is realized . a first step in that direction has been recently given by teizel _ et al_,@xcite who unambiguously observed the quasi - one dimensional behaviour of @xmath1he adsorbed inside swcn bundles . the helium intake could be directed either to the inside of the nanotubes , to the interstitial channels between the several tubes constituting a bundle , or to the external surface of the nanotube bundle . the occupation probability in the three regions depends on the geometry of the bundle , on the _ size _ of the atom / molecule to be adsorbed and , finally , on the interatomic potential between the carbon atom and each particular species . @xcite in all cases , an almost perfect alignment of the atoms is granted . encouraged by this experimental accessibility , some theoretical work about the adsorption of quantum liquids inside nanotubes has been carried out . the most studied case is @xmath1he , which has been considered both in 1d and inside a ( 5,5 ) nanotube . in the limit of zero temperature , both 1d and quasi - one - dimensional @xmath1he are self - bound systems , with a binding energy ranging the milikelvin scale.@xcite    molecular hydrogen inside nanotubes is also a very appealing system . in fact , the confinement of h@xmath0 in swcn , in the limit of zero temperature , has recently deserved theoretical work . its mass is approximately half the @xmath1he one , but the hydrogen - hydrogen interatomic potential has a potential well three times deeper than the helium - helium one . this prevents the existence of a liquid phase at zero temperature in both 2d and 3d , but diffusion monte carlo ( dmc ) calculations@xcite have shown that it is not enough to preclude it in 1d . this result is due to the reduced number of neighbours of each atom . in fact , this liquid state could be produced also in higher dimensions when the number of molecules surrounding a particular one is artificially reduced , as in small clusters@xcite ( 3d ) and in surfaces doped with the right kind of impurities@xcite ( 2d ) .    in the present work , the dmc method is used to study the influence of both the interparticle potential and mass on the thermodynamic behavior of the isotopes of molecular hydrogen , especially h@xmath0 and d@xmath0 , adsorbed inside a carbon nanotube . since the electronic structure of molecular deuterium and hydrogen is the same , the d@xmath0-d@xmath0 interparticle potential is identical to the h@xmath0-h@xmath0 one . this is equally true for the particle - tube interactions . moreover , the mass of the d@xmath0 molecule is very similar to that of a @xmath1he atom . thus , by comparing the deuterium results with those for helium , the effect of the respective potential wells can be inferred . on the other hand , the influence of the zero - point energy in the thermodynamic behavior of a quasi - one dimensional array can be drawn from the comparison between the deuterium and hydrogen results . in the last part of the paper , we present results for the equation of state of h@xmath0 , d@xmath0 , and @xmath1he when they are adsorbed in the interstitial channels of a nanotube bundle . the influence of neighbouring arrays in a particular one , as a function of the interchannel separation , is studied using the dmc equation of state of purely 1d systems . the attractive van der waals tails between the arrays increase the binding energy of the adsorbed liquid in a quantity which decreases with the interchannel separation . using the dmc method , it is verified that a _ mean field _ approximation , as suggested in ref . , is very accurate at realistic separations . the outline of the paper is as follows . in the next section , we briefly introduce the dmc algorithm used to study both the fluid adsorbed in a nanotube and the purely one - dimensional model . in sec . iii , we compare results of the equation of state and spatial structure for the two isotopes , h@xmath0 and d@xmath0 . predictions for the equations of state of both isotopes , when the adsorbtion is in the interstitial channels , are also reported . finally , sec . iv comprises the summary and the main conclusions of our work . the diffusion monte carlo method , @xcite is a theoretical tool that has proved its accuracy in a large variety of systems and physical scales . it solves in a stochastic way the schrdinger equation , providing results for the ground state which are exact for boson systems like the present one . the @xmath3-body schrdinger equation is solved in imaginary time after the introduction of importance sampling , a standard technique to reduce the variance and make the algorithm operative . explicitely , @xmath4 with @xmath5 , where @xmath6 denotes a trial wave function used for importance sampling and @xmath7 the imaginary - time - dependent wave function . in eq . ( [ dmc1 ] ) , @xmath8 , @xmath9 is the local energy , and @xmath10 is the so - called drift force which guides the diffusion movement to regions where @xmath6 is large . dmc calculations have been carried out for two different situations : _ i _ ) a pure 1d array of d@xmath0 molecules , and _ ii _ ) d@xmath0 filling a tube of radius @xmath11 = 3.42  , corresponding to the ( 5,5 ) armchair nanotube in the standard nomenclature.@xcite this structure has been chosen because it is one of the narrowest nanotubes experimentally obtained , and therefore it is expected to be close to an ideal 1d arrangement .    in the present calculation , we have considered the d@xmath0 molecules interacting via the silvera and goldman ( sg ) pair potential.@xcite this semiempirical interaction is the same that has been used in ref . in the study of h@xmath0 in tubes , and has become the standard approach in molecular hydrogen and molecular deuterium calculations . the sg interaction is a spherically averaged model , even though the pair of molecules involved are ellipsoids . however , the eccentricity of the ellipsoids is so small ( @xmath12 = 0.94 , in the h@xmath0 case ) that it produces results of remarkably accuracy , even at low temperatures . for the d@xmath0-tube interaction we have used the stan and cole ( sc)@xcite h@xmath0-tube interaction this is a cylindrically averaged potential , i.e. , the potential felt by a molecule inside the tube is a function only of its distance to the center of the tube . we have verified that the differences between the results obtained with this averaged interaction and the ones derived by explicitely summing up all the c - d@xmath0 interactions inside the tube are negligible . the sc potential depends only on three parameters : @xmath13 , @xmath14 , and the radius of the tube . for the ( 5,5 ) tube considered , @xmath15  , and the parameters @xmath13 and @xmath14 correspond to the lennard - jones c - h@xmath0 interaction ( @xmath16   and @xmath17 k).@xcite in fig . 1 , the h@xmath0-tube sc potential is displayed and compared to the @xmath1he potential inside the same cylinder . the two curves reflect the differences between the pair ( @xmath13 , @xmath14 ) for @xmath1he and h@xmath0 ; the larger values of @xmath14 and @xmath13 in the case of h@xmath0 originates a deeper well and a shorter range , respectively . the trial wave function @xmath18 used in the 1d system is    @xmath19    with @xmath20 a jastrow wave function with a mcmillan two - body correlation factor .    for the simulation of d@xmath0 inside the tube , an additional one - body factor is introduced in order to avoid the hard core of the tube - molecule interaction , @xmath21 with @xmath22 , @xmath23 being the radial distance of the particle to the center of the cylinder . the parameters @xmath24 and @xmath25 entering in @xmath26 and @xmath27 , respectively , have been determined by means of a variational monte carlo ( vmc ) optimization . near the equilibrium density we find the optimal value @xmath28  , gradually increasing with the linear density @xmath29 ( at @xmath30 @xmath31 , @xmath32  ) . the parameter @xmath25 , inversely proportional to the width of the gaussian defined in @xmath27 , has been fixed to @xmath33 @xmath34 due to its negligible dependence on the density . it is worth mentioning that these parameters are different from the ones used for h@xmath0 in the same setup@xcite ( @xmath35  , @xmath36 @xmath34 ) . in order to study the behavior of the several isotopes of molecular hydrogen inside nanotubes , the dependence of the adsorption energy on the mass species constitutes a first relevant point . since the interparticle and tube - molecule potentials do not distinguish between isotopes , their different masses play the central role . at low densities , the dominant effect is due to the binding energy of single independent molecules . from our dmc calculations the binding energy of a single molecule inside a carbon tube turns out to be , for the ( 5,5 ) tube , @xmath37 k for h@xmath0 , and @xmath38 k and @xmath39 k for d@xmath0 and t@xmath0 , respectively . the increase in the binding energy with the mass comes from the combination of two features : a decrease in the kinetic energy , mainly due to a direct effect of the mass ( @xmath40 , @xmath41 ) , and a simultaneous increase of the potential energy . although those energies correspond to the ground state of single molecules at 0 k , they constitute a very good estimation in the limit of infinite dilution at nonzero temperatures . from the above binding energies one can extract information on the selectivity in the adsorption inside the nanotube . following ref . , the selectivity of isotope 2 with respect to isotope 1 can be defined by the quotient @xmath42 with @xmath43 ( @xmath44 ) the nanotube ( bulk ) mole fractions . it has been proved that in the limit of zero pressure the selectivity @xmath45 is very well approximated by @xmath46 where @xmath47 is the binding energy of isotope @xmath48 . considering @xmath49 k , as in ref . , we obtain @xmath50 and @xmath51 for the ( 5,5 ) tube . the selectivity is especially high in the case t@xmath0/h@xmath0 due to the sizeable difference in binding energies between the two isotopes , @xmath52 k. that large selectivity , which is a purely quantum effect , has been proposed in ref . to achieve an efficient isotopic sieving . the ground - state properties of an array of hydrogen molecules , in a one- and in a quasi - one - dimensional environments , have also been studied using the dmc method . in a previous work,@xcite we had studied the case of h@xmath0 : the equilibrium state in 1d corresponds to a liquid phase with a density @xmath53 @xmath31 and an energy per particle @xmath54 k. a first approach to determine the equation of state of 1d d@xmath0 is based on the use of the average correlation approximation ( aca ) . this approximation , which has been widely used in the @xmath55he-@xmath1he isotopic mixture in the limit of zero @xmath55he concentration,@xcite consists in the present case in evaluating the expectation value of the hamiltonian for d@xmath0 using the _ exact _ wave function of the other isotope ( h@xmath0 ) . thus , the energy per particle of d@xmath0 in aca is given by @xmath56 where @xmath57 is the kinetic energy of the h@xmath0 molecule . aca corresponds , obviously , to a variational estimate and thus the d@xmath0 energies obtained from eq . ( [ acaener ] ) are upper bounds to the exact values . using the dmc kinetic energies of 1d h@xmath0 reported in table i , and the total energies published in ref . , we have calculated the aca equation of state for d@xmath0 . the results obtained are shown in fig . 2 and compared with the exact solution derived from a dmc calculation of 1d d@xmath0 . both equations of state ( lines ) correspond to a least squares fit to the data in the usual form @xmath58 the parameters @xmath59 , @xmath60 , @xmath61 , and @xmath62 are given in table ii . the upper bounds provided by aca appear clearly reflected in fig . 2 , its _ quality _ being quite reasonable taking into account its straightforward estimation ( [ acaener ] ) . in fact , the discrepancies between aca and the exact results are less than 2 % for the equilibrium density value , and around 3 % for the binding energies . aca can also be used to estimate the equation of state of the t@xmath0 fluid , a system that we have not studied here using the explicit dmc calculation . for 1d t@xmath0 , aca predicts @xmath63 @xmath31 and @xmath64 k.    on the other hand , the equation of state of d@xmath0 inside a tube can also be estimated by aca , since the tube - molecule sc potential does not depend on the particular isotope . using the h@xmath0 equation of state ( ref . ) and the h@xmath0 kinetic energies reported in table i , the aca results compare with the corresponding dmc ones with an accuracy similar to the 1d case . dmc energy results for both 1d d@xmath0 and d@xmath0 adsorbed in the ( 5,5 ) nanotube are displayed in fig . in order to show the two equations of state with the same energy scale , we have subtracted to the tube results the adsorption energy of a single molecule . in fig . 3 , the curves are polynomial fits ( [ eqestat ] ) to the dmc data , the optimal parameters for the tube being reported in table ii . it can be seen that the equilibrium density for 1d d@xmath0 and d@xmath0 adsorbed in the ( 5,5 ) nanotube are almost identical . this is also true for the location of the spinodal points of d@xmath0 , @xmath65 @xmath31 and @xmath66 @xmath31 , which can be derived from the data contained in table ii . the binding energies , in the respective equilibrium points ( @xmath59 ) , are slightly different : the additional transverse degree of freedom only amounts to an increase of 0.091 k. this increase in the binding energy is nearly a factor two smaller than the one drawn from the dmc calculations for h@xmath0 ( 0.172 k ) . in relative terms , the increase of the binding energy is only a 0.85 % for d@xmath0 versus a 3.5 % for h@xmath0 . therefore , one can conclude that the effects of the additional degree of freedom of the d@xmath0 molecules in the radial direction inside the nanotube , which account for the enhancement of the binding energy , are reduced by the greater mass of the d@xmath0 molecule with respect to the h@xmath0 one . as a matter of comparison , it is illustrative to compare the effects observed in d@xmath0 with the ones previously studied in @xmath1he using the same methodology and geometry . it is worth noticing that the masses of d@xmath0 and @xmath1he are nearly the same whereas the interatomic potentials are sizeably different . the dmc results show that the latter effect is completely determinant : in @xmath1he the relative difference mentioned above is 90 % , two orders of magnitude larger than in d@xmath0 . another minor effect that contributes to the one - dimensionality of molecular deuterium adsorbed inside the tube , is the larger hard - core size of the c - d@xmath0 interaction ( @xmath67  ) , versus the c - he one ( @xmath68  ) . the mass versus potential effects can also be seen in the value of the equilibrium density . inside the tube , @xmath60 goes from @xmath69 @xmath31 in @xmath1he , to @xmath70 @xmath31 in h@xmath0 , to reach @xmath71 @xmath31 in d@xmath0 . that sequence clearly indicates that the main influence in @xmath60 comes from the potential , since the isotopic change varies the location of the energy minimum less than 15 % . most probably , the features observed in these systems have a more general character and one can guess that if the well of the interatomic potential is increased and/or the mass of the particle adsorbed inside a tube is enlarged , the effect would be an increase in the @xmath60 value .    in fig . 4 , the density dependence of the pressure for both 1d d@xmath0 and d@xmath0 inside the tube is reported from the equilibrium density up to 0.30 @xmath31 . for the sake of comparison , the same results for h@xmath0 are also plotted . in both h@xmath0 and d@xmath0 , the pressures for the 1d systems ( solid lines ) are greater than the ones for the tubes ( dashed lines ) at the same @xmath29 , the difference being quite similar for the two isotopes . for the same geometry and at equal density , the pressure of h@xmath0 is always larger , a fact that is basically due to its slightly smaller equilibrium density . complementary and useful information on the system can be obtained from the microscopic study of the spatial structure of the molecules in the array . in fig . 5 the radial distribution functions , @xmath72 , along the @xmath73 axis , are shown . they correspond to the quantum fluids adsorbed in the tube at their respective equilibrium densities @xmath60 . the 1d counterparts are nearly identical and are not displayed . being the denser of the three systems , d@xmath0 exhibits accordingly the most pronounced oscillations in the @xmath72 function . the shift in the positions of the maxima for the two molecular isotopes arises basically from the difference in their respective @xmath60 s . a comparison of the radial distributions of h@xmath0 and d@xmath0 at the same linear density , not shown for simplicity , indicates so . in the @xmath1he case , the much lower equilibrium density , direct consequence of the different potential , explains the smoothness of the @xmath72 obtained . the radial densities inside the ( 5,5 ) tube have been also studied . in fig . 6 , the radial densities for @xmath1he , h@xmath0 , and d@xmath0 for the same linear density @xmath29 = 0.245 @xmath31 are shown . the trends shown in the figure are common to all densities studied : the particle with the largest mass ( d@xmath0 ) is the one which spends more time in regions closer to the center of the tube , i.e. , d@xmath0 in the tube is the closest to a one - dimensional system . the change in the mass and in the interatomic potential work in the same direction : the radial densities of h@xmath0 and @xmath1he are quite similar . both curves show a decrease in the radial localization and larger fluctuations in the transverse direction .      the absorption of different species inside the interstitial channels of bundles , formed when several nanotubes are staked together , has been theoretically predicted@xcite and experimentally observed.@xcite the staking of the nanotubes allows for the formation of an hexagonal network of quasi - one dimensional channels separated by distances which depend on the diameter of the nanotubes themselves . for instance , when the nanotube ropes are made out of ( 5,5 ) constituents , the distance between two adjacent tubes is 10.26  , whereas the closest interstitial channels are located @xmath74   apart . the interstitial channels are very narrow , with effective diameters oscillating between 3 and 3.5  . @xcite this size is considerably smaller than the diameter ( 6.8  ) of the ( 5,5 ) tube considered in the previous subsection . therefore , it is plausible to assume that if molecular hydrogen or deuterium is introduced inside one of this channels , its behavior would have even a more one dimensional character than in the inner part of a single tube .    considering the previous arguments , a quantum fluid adsorbed in the intersites can be well modelled by hexagonal arrangements of purely 1d systems , mutually separated by the real interchannel distance in the bundle . to a large extent , the additional consideration of the interactions between the adsorbed atoms / molecules and the carbon atoms of the nanotube walls would simply introduce a constant shift in the energy scale . the influence of neighbouring channels in the binding energy of @xmath1he adsorbed in one of them has been estimated in ref . considering a _ mean field _ approximation . in this approach , the neighbouring channels are seen as uniform arrays that only contribute to increase the potential energy in the form @xmath75 where @xmath76 is the distance between the reference channel and one of its neighbours . the total energy correction is obtained by summing up the contribution of the nearest neighbours , the next - nearest neighbours , and then on up to a desired accuracy . from its definition ( [ mfield ] ) it is clear that the energy per particle in this approximation , @xmath77 is an upper bound to the exact energy .    in order to test the _ _ approximation ( [ enermf ] ) , we have performed full dmc calculations of a system formed by an hexagonal array of 1d h@xmath0 channels . since the distances between channels depend on the diameter of the tubes , the calculations have been made in the more challenging case for eq . ( [ enermf ] ) , a bundle of ( 5,5 ) nanotubes . that tube is one of the narrowest experimentally obtained , and therefore the interchannel distance is one of the smallest in nature . actually , that is an unrealistic case since the corresponding interstitial channels are too narrow to adsorb h@xmath0 . the dmc energies are displayed in fig . 7 , and compared with the approximated estimations ( [ enermf ] ) . as it is evident in the figure , both results are nearly identical , at least in the density range considered . the conclusion is that correlations between hydrogen molecules located in different channels suppose a negligible contribution to the energy , even in this case where the channels are very close . 7 , there is also reported the equation of state of 1d h@xmath0 . as one can see , the increase of the binding energy of the system , when the array is immersed in a bundle , is as large as a factor two . having checked the validity of the _ mean field _ approach ( [ enermf ] ) in an exigent case , one can use that approximation to study the equation of state of molecular hydrogen and helium adsorbed in other more appropriate bundles . it is worth mentioning that the number of neighbours to be included in @xmath78 has to be larger than ten , otherwise the binding energy is underestimated in a 5 % . besides the ( 5,5 ) bundle , with an interchannel distance @xmath79  , we have analyzed the following cases : ( 6,6 ) , @xmath80  ; ( 8,8 ) , @xmath81  ; ( 10,10 ) , @xmath82  . the fluids that have been analyzed are @xmath1he , d@xmath0 , and h@xmath0 . in fig . 8 , the differences between the equilibrium density in the bundles and in the purely 1d system are shown for the three cases . there is a clear difference ( an order of magnitude ) between the increase of @xmath60 , when @xmath1he is adsorbed in the intersites , and the density shift experimented by the two hydrogen isotopes . in h@xmath0 and d@xmath0 the change in density is small but one can distinguish a slightly larger effect in the lighter isotope . in all cases , the density difference decreases when the interchannel separation increases . however , h@xmath0 and d@xmath0 have already reached the 1d equilibrium density in the ( 10,10 ) geometry whereas @xmath1he still shows a sizeable effect . the increase of the binding energies with respect to the one - dimensional systems are reported in fig . the different points correspond to the same bundles reported in fig . 8 . in absolute terms , that increase is much larger in molecular hydrogen than in @xmath1he , the effect being slightly larger in d@xmath0 than in h@xmath0 for all the bundles . the energy difference between h@xmath0 and d@xmath0 is very small and decreases when the interchannel distance increases . it is clear , from the _ mean field _ correction ( [ mfield ] ) , that the difference in energy between the two isotopes arises from their different densities since the interatomic potential is the same . in @xmath1he the shift in energy is comparatively small but , taking into account that the 1d @xmath1he binding energy@xcite is only @xmath83 k , one concludes that the bundle effects are much larger in @xmath1he than in molecular hydrogen . in this work , we have studied the zero - temperature equation of state of molecular deuterium , and compared the results with those previously obtained@xcite for @xmath1he and molecular hydrogen.@xcite the results show that the different masses of the two isotopes do influence both the energetic and structural properties . as a general trend , d@xmath0 appears as a slightly denser liquid , a fact that is observed in its equation of state and also in the radial distribution functions . the comparison between d@xmath0 and @xmath1he , two _ particles _ with the same mass but with very different interatomic potentials , has shed light on the influence of the potential in one - dimensional systems . concerning the mass and potential changes , the dmc results show unambiguously that the potential effects are manifestly dominant . bundles of carbon nanotubes have also been studied by modelling them as hexagonal one - dimensional arrays . the explicit dmc calculation of the system has allowed to check the accuracy of a previously suggested _ mean field _ approximation.@xcite once verified the validity of that approximation , we have analyzed the effects of the neighbouring channels on the 1d equation of state . our results show that those effects are much more relevant in @xmath1he than in molecular hydrogen .    in the tube and bundle calculations , we have assumed that the interparticle potential is not modified by the existence of nearby carbon atoms . recently , cole and coworkers@xcite have estimated the effective correction in the two - body potential due to three - body interactions between two particles and the carbon atoms of the nanotube wall . this three - body interaction has been modelled by the well - known triple - dipole interaction derived by axilrod and teller,@xcite a potential energy contribution that is mostly repulsive . in the case of molecular hydrogen in the interstitial channels , the well of the effective silvera and goldman potential is reduced by approximately a factor two . this unexpected and big effect would modify some of the results presented in our work . nevertheless , it is well - known that , in spite of the fact that axilrod - teller is the dominant contribution to @xmath84 , at short interparticle distances an attractive force emerges . this short - ranged three - body interaction , known as exchange interaction,@xcite is due to the influence of a third particle in the charge densities of two interacting atoms . due to the short interparticle distances h@xmath0-c - h@xmath0 in the channel , that attractive term would partially cancel the repulsion introduced by axilrod - teller . we have preferred to ignore the three - body corrections@xcite until a better knowledge of the nonadditive terms of this particular system is achieved . we plan , in the near future , to introduce in the simulation the possibility of the swelling of the channels when molecular hydrogen is adsorbed . the aim would be to test , by a microscopic calculation , the recent theoretical result@xcite that h@xmath0 forces the nanotube bundles to slightly spread upon adsorption . we hope our calculations , and the ones carried out by other theoretical groups , can stimulate new experiments on molecular hydrogen adsorption in carbon nanotubes and bundles , especially at low - temperature where quantum effects become macroscopic . the authors gratefully acknowledge prof . m. w. cole for stimulating discussions . this research has been partially supported by dgesic ( spain ) grant n@xmath85 pb98 - 0922 , and dgr ( catalunya ) grant n@xmath85 1999sgr-00146 . m. c. g. thanks the spanish ministry of education and culture ( mec ) for a postgraduate contract . we also acknowledge the supercomputer facilities provided by the cepba .
Abstract:

Answer: we present diffusion monte carlo calculations of d@xmath0 adsorbed inside a narrow carbon nanotube . the 1d d@xmath0 equation of state is reported , and the one - dimensional character of the adsorbed d@xmath0 is analyzed . the isotopic dependence of the constitutive properties of the quantum fluid are studied by comparing d@xmath0 and h@xmath0 . quantum effects due to their different masses are observed both in the energetic and the structural properties . the influence of the interatomic potential in one - dimensional systems is also studied by comparing the properties of d@xmath0 and @xmath1he which have nearly the same mass but a sizeably different potential . the physics of molecular hydrogen adsorbed in the interstitial channels of a bundle of nanotubes is analyzed by means of both a diffusion monte carlo calculation and an approximate mean field method .


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: the successful applications of game theory in the area of economics and political decisions initiated its increasing development after the second world war @xcite . originally , the game theory is devoted to find the optimal strategy for a given game between two intelligent players . the straightforward developments involve the generalization toward the iterated games of @xmath4 players with assuming local interactions among the spatially distributed players . the spatial evolutionary prisoner s dilemma games ( sepdg ) has attracted a particular attention because of its applicability in the human and behavior sciences as well as in biology @xcite . nowadays the prisoner s dilemma game is considered to be the metaphor for studying the emergence of cooperation among selfish individuals . the emerging cooperation appears to be crucial at many transitions in evolution @xcite . the first numerical investigations have shown that the cooperation can be maintained by very simple strategies in the iterated games @xcite . very recently it is demonstrated that the players can be as simple as bacteriophages ( viruses that infect bacteria)@xcite .    in these systems the players wish to maximize their individual income coming from games with other players . the prisoner s dilemma game is a simple version of the two - player matrix games where the players income depend on their simultaneous choice between two options . following the widely accepted expressions each player can choose defection or cooperation with the other player . the defector reaches the highest payoff @xmath5 ( called temptation to defect ) against the cooperator , which receives then the lowest reward @xmath6 ( called sucker s payoff ) . for mutual cooperation [ defection ] each player receives the same payoff @xmath7 ( reward for mutual cooperation ) [ @xmath8 ( punishment ) ] . the game is symmetric in the sense that player s income is independent of the player itself , it depends only on their choice . the mentioned payoff values satisfy the inequalities @xmath9 and @xmath10 . these assumptions provide the largest total payoff for the mutual cooperators . comparing to this situation the defector reaches extra income against the cooperator whose loss exceeds the defector s benefit . consequently , the choice of defection can be interpreted as an exploiting behavior . these are the main features for which the prisoner s dilemma games are used to study the emergence of mutual cooperation , altruism and ethic norms among selfish individuals @xcite . the rational players should defect as this choice provides the larger income , independently of the partner s decision . however , this situation creates a dilemma for intelligent players as mutual cooperation would result in higher income for each of them than mutual defection does .    in the iterated round - robin prisoner s dilemma games we can introduce some simple evolutionary processes without assuming intelligent players ( who are capable to find the best strategy if it exists ) . these games are started from an initial set of strategies , which defines the player s decision in the knowledge of their previous choices . the evolutionary process is devoted to model the darwinian selection principle among @xmath4 ( selfish ) players whose total income comes from @xmath11 games within a given round . in the simplest evolutionary models the worst player adopts the winner s strategy round by round . the numerical simulations have demonstrated the crucial role of the so - called `` tit for tat '' strategy in the emergence of mutual cooperation . despite of its simplicity the `` tit for tat '' strategy won the computer tournaments conducted by axelrod @xcite . the `` tit for tat '' strategy cooperates in the first step and then always repeats his co - player s previous decision . this strategy cooperates forever with all the other so - called nice strategies which never defect first . furthermore , its defection and cooperation can be interpreted as a punishment and forgiveness when reacting to the previous decision for other strategies . the most remarkable feature of this strategy is that it is capable to sustain the mutual cooperation among themselves in the presence of defectors . early numerical investigations have also indicated the importance of local interactions because it favors the formation of cooperating colonies . in the simplest models the players are distributed on a lattice and the interaction ( the games between two player as well as the strategy adoption ) is limited to a given neighborhood . evidently , the short range interactions enhance the role of fluctuations at the same time . these models can be well investigated by sophisticated methods of non - equilibrium statistical physics .    for the numerical investigation of the spatial effects nowak and may  @xcite have introduced an sepdg model , which is equivalent to a two - state cellular automaton . each lattice site can be in one of the two states @xmath0 and @xmath1 , representing the two simple strategy `` always cooperate '' and `` always defect '' respectively . the income for a given player ( site ) comes from games with its neighbors ( and also with itself in some version of the model ) . according to the cellular automaton rule the players modify their strategy simultaneously in discrete time steps . namely , each player adopts the best strategy found in its neighborhood . the step by step visualization of the strategy distribution on a two - dimensional lattice exhibits different spatio - temporal patterns ( homogeneous and coexisting strategies , transitions between these states , competing interfacial invasions , etc . ) depending on the payoff matrix , which is characterized by a single parameter . in these models the randomness is restricted to the initial states . in a subsequent work nowak _ @xcite have extended the former models by allowing irrational strategy adoptions with some probability . the simulations indicated that the randomness favors the spreading of @xmath1 strategies . these results have initiated systematic numerical investigations of many stochastic cellular automata @xcite . the study of spatio - temporal patterns observed in nature , however , requires continuous time description @xcite . moreover , it is difficult to analyze the above mentioned stochastic cellular automata in the framework of generalized mean - field approximation , which is often used in non - equilibrium physics . to reduce the technical difficulties szab and tke have suggested a simplified dynamics @xcite . the systematic investigations of this model have justified that when tuning the model parameters the stationary state undergoes two consecutive phase transitions which belong to the directed percolation ( dp ) universality class@xcite . very recently this sepdg model has been extended by allowing three strategies for the players @xcite . in the present work this three - strategy model will be compared with its simplified version . during the model descriptions and discussion , our attention will be focused on the motivations , the elementary processes and their consequences as well as on the universal features relating the sepdgs to the area of complex systems . in the present spatial evolutionary prisoner s dilemma game the players are located on the sites @xmath12 of a square lattice , where @xmath13 . to avoid the undesired boundary effects we assume periodic boundary conditions . each player follows one of the three strategies : @xmath1 defects always ; @xmath0 cooperates unconditionally ; @xmath2 accommodating to the partner s strategy chooses defection against @xmath1 and cooperation with @xmath0 and @xmath2 . in fact the name @xmath2 refers to the strategy `` tit for tat '' which first cooperates and later repeats the partner s previous decision . consequently , after the first step the decisions of these two strategies are equivalent against @xmath0 , @xmath1 and themselves . the consequences of the different first decisions become irrelevant if the strategy changes ( defined below ) are rare comparing to the frequency of games . at the site @xmath14 the player s strategy is denoted by a three - component unit vector whose possible values are @xmath15 corresponding to the @xmath1 , @xmath0 , and @xmath2 strategies respectively . at a given time the state of the whole system is described by the variables @xmath16 .    for each player the total payoff comes from the games with its four nearest neighbors . using the above formalism the total payoff @xmath17 for the player at site @xmath14 is given as @xmath18 where @xmath19 is the transpose matrix of @xmath16 and the summation runs over the four nearest neighbors ( @xmath20 ) . accepting the simplified payoff matrix suggested by nowak and may @xcite @xmath21 is given by the following expression : @xmath22 where the only free parameter @xmath23 ( @xmath24 ) measures the temptation to defect . in the above mentioned notation the present payoff matrix corresponds to the choices : @xmath25 , @xmath26 , @xmath27 , and @xmath28 in the limit @xmath29 .    to model the darwinian selection rule the players are allowed to modify their strategy . in the simplest case the system evolution is governed by random sequential updates . it means that a randomly chosen player ( e.g. at site @xmath14 ) adopts one of its neighboring strategy , @xmath30 , if @xmath31 and this elementary process is iterated many times . here it is worth mentioning that a state consisting only of @xmath0 and @xmath2 strategies leads to a uniform payoff distribution [ @xmath32 and the above dynamics leaves this state unchanged . an example of a more complicated situation is given in figure [ fig : podistrn ] . the payoffs associated with the three different strategies , @xmath1 , @xmath0 and @xmath2 , are explicitly given . the reader can easily check that inside a @xmath1 region the defectors receive zero payoffs . the same is true for a solitary @xmath2 surrounded by defectors . in the absence of @xmath0 strategies , however , two ( or more ) neighboring @xmath2 strategies will invade the @xmath1 territories because their mutual cooperation gives them some incomes , while the defectors payoff remain zero .    in the presence of @xmath0 strategies , however , the above situation becomes quite different as the exploitation provides large incomes for the defectors . as a result , the defectors can invade the neighboring @xmath0 or @xmath2 sites for some configurations . this process dominates the time evolution for small @xmath2 and large @xmath0 concentrations as illustrated in a ternary diagram ( see figure  [ fig : flowp ] ) . note that the trajectories are two dimensional projections of a many dimensional space . accordingly , there can be crossing of trajectories . as the average defector s payoff decreases with the @xmath0 concentration , sooner or later the @xmath33 invasion processes will govern the system evolution and , finally , all the @xmath1 strategies extinct . figure  [ fig : flowp ] shows clearly that the ratio of @xmath0 and @xmath2 strategies in the final ( frozen ) state depends on the initial state . it is emphasized that in the absence of @xmath2 strategies the defectors will dominate the present system in the final state . it is not evident as in figure  [ fig : podistrn ] one can find many @xmath1-@xmath0 pairs where @xmath0 beats @xmath1 . in general , these pairs are located along the horizontal and vertical straight fronts separating the @xmath1 and @xmath0 domains . the random sequential invasions , however , makes the smooth fronts irregular and this situation generally prefers the @xmath34 invasion to the opposite one . as a result , the `` sharp '' @xmath1 fronts cut the @xmath0 s domains into small pieces and finally all the @xmath0s will be eliminated . the reader can easily recognize that in most of the @xmath0-@xmath1 ( or @xmath2-@xmath1 ) confrontations the direction of dominance is not affected by the value of @xmath23 within the prescribed region ( @xmath24 ) . the systematic analysis shows that there is only one situation when the value of @xmath23 becomes important . namely , if a defector has a payoff of @xmath35 while its @xmath0 ( or @xmath2 ) counterpart has 3 . in this case , @xmath1 wins if @xmath36 , otherwise @xmath1 will be invaded . these types of elementary processes , however , do not modify the system behavior drastically @xcite , therefore the subsequent investigations will be focused on the case @xmath36 . the above dynamical rules introduce some noises ( irrational choices ) in the system evolution . now an additional ( superimposing ) noisy term is introduced by allowing the appearance of mutants with probability @xmath3 . in fact , the effect of two different external constraints ( mutation mechanisms ) will be studied in models a and b as a function of @xmath3 .      in the first model , the above evolutionary rule is modified as follows . each randomly chosen player adopts with probability @xmath3 a randomly chosen strategy among the two other strategies . with probability @xmath37 it follows the old rule . this model can describe the behavior of those biological and economical problems where the appearance of mutants can not be neglected @xcite . the main feature of this model is that this mutation mechanism does not allow the extinction of any strategy .      in the second model the mutation mechanism is restricted to the adoption of @xmath0 strategies @xcite . in other words , the randomly chosen player adopts the @xmath0 strategy with probability @xmath3 , otherwise it adopts one of its neighboring strategy if this neighbor has higher income . note that in this case the extinction of the @xmath1 and/or @xmath2 strategies is permitted . model b is devoted to describe the effect of an external constraint which enforces the cooperative behavior naively by supporting an unconditional cooperation . such a phenomenon can be observed in human societies in which any kind of social pressure enforces the @xmath1 and @xmath2 players to choose the @xmath0 strategy . furthermore , a @xmath2 player surrounded by only cooperating strategies ( @xmath0 or @xmath2 ) is motivated to adopt the @xmath0 strategy also because of its convenience . in fact , playing @xmath0 is simpler than playing @xmath2 , which requires the knowledge of the previous decision of your neighbors . in the classical mean - field approximation the system is described by the strategy concentrations which satisfy the normalization condition @xmath38 . in this approach the average payoffs are given as : @xmath39 for model a , the time dependent concentrations satisfy the following equations of motion : @xmath40 where the upper ( lower ) signs are valid if @xmath41 ( @xmath42 ) . in these expressions the first terms describe the effect of external constraint , the second terms come from the darwinian selection mechanism .    after some algebraic manipulations one can easily get the following stationary solution ( for @xmath43 ) : @xmath44 here all the three strategies are present for arbitrary values of @xmath3 . notice that the concentrations of @xmath0 and @xmath2 strategies are the same due to the symmetries of eqs . ( [ eq : mfa ] ) . in the limit @xmath45 , however , the concentration of @xmath1 strategy vanishes . evidently , the concentration of the three strategies becomes equal when the evolution is governed exclusively by the mutation ( @xmath46 ) .    for model b the corresponding equations of motion are similar to those given by eqs . ( [ eq : mfa ] ) , the differences appear in the first terms proportional to @xmath3 . namely , @xmath47 where the average payoff values are given by eqs . ( [ eq : mfpayoff ] ) and the conditions of validity of the upper and lower signs are defined as above . the analytical solution of these equations predicts strikingly different behavior in the stationary state @xcite , that is , for @xmath48 @xmath49 while the system goes to the absorbing state ( @xmath50 and @xmath51 ) for @xmath52 . the most surprising result is the extinction of @xmath2 strategy if @xmath53 . we have to emphasize the non - analytical behavior in the limit @xmath45 . as illustrated in the upper plot of figure  [ fig : flowzab ] , without the mutation ( @xmath54 ) the system evolves toward either a homogeneous @xmath1 state ( @xmath55 ) or a mixed state composed of @xmath0 and @xmath2 strategies with a ratio depending on the initial conditions . however , the homogeneous @xmath1 state is unstable against @xmath2 invasions , therefore in the close vicinity of this state some small perturbations can drive the system toward the state of @xmath0+@xmath2 . conversely , this mixed state becomes unstable at a given concentration ( where @xmath56 ) against small perturbations increasing @xmath57 and @xmath58 simultaneously . in other words , the system evolves toward the @xmath1 dominance when the state is positioned on the right hand side of dashed line ( see the upper plot in figure  [ fig : flowzab ] as a results of fluctuations . this feature explains why the system is so sensitive to applied external constraints . figure  [ fig : flowzab ] illustrates that for model a the mutation drives the ( concentration ) trajectories away from the boundaries . on the right hand side of the dashed line ( @xmath59 ) , @xmath57 and @xmath60 decrease while @xmath58 and @xmath61 increase until one crosses the dashed line . on the left hand side all the initial states tend toward the only fixed point given by eq . ( [ eq : mfsola ] ) . for model b , however , there is no fixed point on the left hand side . in this region the external insertion of @xmath0 strategies increases the value of @xmath57 until @xmath60 becomes larger than @xmath62 and then the @xmath1 invasion drives the system toward the fixed point defined by eq . ( [ eq : mfsolb ] ) . during the @xmath1 invasion the external constraint can compensate only the loss of @xmath0 strategies . consequently , the @xmath2 strategies die out exponentially fast . notice that the variation of @xmath23 leaves the fixed points unchanged , but modifies only the slope of the dashed line separating the two regions mentioned above .    within the framework of mean - field theory , the extinction of @xmath2 strategies is a consequence of the fact that here @xmath63 [ see eq . ( [ eq : mfpayoff ] ) ] in contrary to the spatially extended case , as illustrated in figure  [ fig : podistrn ] . systematic monte carlo simulations have been performed on a square lattice consisting of @xmath64 sites with periodic boundary conditions , @xmath65 varying from 200 to 1500 . the larger sizes were used in the vicinity of the critical points . each run started from a random initial state . during the simulations we have monitored the number of players playing a given strategy ( @xmath66 ; @xmath67 , @xmath0 or @xmath2 ) and the payoffs related to a given strategy . after some relaxation time we have determined the average concentrations @xmath68 and the fluctuations @xmath69 by averaging over a sampling time varying between @xmath70 and @xmath71 monte carlo steps ( mcs ) per sites . the results obtained respectively for model a and b are the following . figure [ fig : assp02 ] shows a typical strategy distribution for the stationary state at a small value of @xmath3 . in contrary to the mean - field prediction [ see eqs .  ( [ eq : mfsola ] ) ] the system is dominated by the @xmath2 strategies . the randomly inserted @xmath1 and @xmath0 strategies form small islands . occasionally the larger @xmath0 islands are occupied by @xmath1s , however , a consecutive @xmath2 invasion will eliminate the larger @xmath1 territories and maintains the @xmath2 dominance . at the same time this process prevents the formation of large @xmath0 islands inside a @xmath2 domain . one can observe in figure  [ fig : s3mmc ] that when increasing the value of @xmath3 , the concentration of @xmath1 and @xmath0 strategies increases monotonously . in the limit @xmath72 , the strategy distribution on the lattice tends toward a random ( uncorrelated ) one @xmath73 in agreement with the classical mean - field theory [ ( [ eq : mfsola ] ) ] . in this case , instead of the neighbor invasions , the system evolution is ruled by the stochastic mutation mechanism .    as shown in figure [ fig : s3mmc ] , the monte carlo data agree remarkably well with the results of the pair approximation . this pair approximation is considered as a generalized mean - field theory taking the nearest - neighbor correlations explicitly into account . the details of this calculation are available in many previous works @xcite . the good agreement refers to the absence of long - range correlations which is observable in the `` homogeneous '' strategy distribution ( see figure  [ fig : assp02 ] ) . it is worth mentioning that the pair approximation is capable to describe the dominance of @xmath2 strategies in the limit @xmath45 .      in order to visualize the relevant differences between the two models at small @xmath3 values the strategy distribution for model b is displayed in figure  [ fig : bssp02 ] . when comparing the corresponding snapshots ( figures  [ fig : assp02 ] and [ fig : bssp02 ] ) the reader can easily recognize the most striking differences . namely , the appearance of a strongly correlated spatial structure for model b. in this case the formation of large @xmath0 domains inside the sea of @xmath2 strategies is not prevented by the random appearance of @xmath1 mutants as happened in the previous case . the large @xmath0 domains ( white areas in figure  [ fig : bssp02 ] ) , however , are unprotected against the @xmath1 invasion . figure  [ fig : bssp02 ] shows some @xmath1 domains ( black areas ) invading the @xmath0 s territories . these @xmath1 domains are `` strip - like '' because their territories are invaded simultaneously by the @xmath2 strategies . this invasion process is similar also for larger values of @xmath3 ( but @xmath74 , see later ) , and only the average invasion velocity changes . on the other hand , the randomly inserted @xmath0 strategies survive and accumulate in the @xmath2 domains . consequently , far behind the @xmath2-@xmath1 invasion front the @xmath2 s territory will be occupied by the externally inserted @xmath0s and then this area becomes unprotected against the @xmath1 invasion . sooner or later this area will be invaded by @xmath1s and the above process repeats itself . this means that the cyclic invasion maintains a self - organizing domain structure . here we have to emphasize that this cyclic ( rock - scissors - paper game like ) dominance is provided by this external constraint . similar processes are observed in the forest - fire models @xcite introduced by bak et al . @xcite to model the phenomenon of self - organized criticality . in these models each cell can be in one of the following three states : non - burning tree , burning tree and ash . the dynamics are governed by cyclic dominance , similarly to our model b. note that the consequence of cyclic invasion with three ( or more ) states are studied in lotka - volterra models @xcite and in cyclically dominated voter models @xcite .    in model b the transition from the @xmath2 to @xmath0 state introduces a characteristic length and time unit , both proportional to @xmath75 . in other words , this length unit is characteristic to the typical ( linear ) size of the @xmath2+@xmath0 domain , and the time unit corresponds to periodic time of cyclic invasion processes at a given site .    when increasing the value of @xmath3 , the typical size of @xmath2+@xmath0 domains decreases and the concentration of @xmath1 s increases . it is found that the @xmath2 strategies die out if @xmath76 . figure  [ fig : bssp13 ] shows a typical snapshot in the vicinity of this critical value . in this case the external support is sufficiently strong to maintain small @xmath0 clusters inside the @xmath1 domains . the most remarkable feature of this snapshot is that the @xmath2 s form non - uniformly distributed small ( isolated ) colonies . the observation of time evolution of configuration shows that these @xmath2 colonies walk randomly , they can extinct spontaneously , a single colony can split into two , or two colonies can merge . this phenomenon is analogous to the branching annihilating random walks ( barw ) exhibiting a critical transition when varying the control parameters @xcite . the corresponding critical transitions , both for our model b and for barw , belongs to the so - called directed percolation universality class @xcite .    for @xmath77 , the concentration of @xmath1 decreases monotonously if @xmath3 is increased and vanishes at @xmath78 . this extinction process is similar to the previous one , i.e.  it also belongs to the dp universality class . the similarity in the correlations is recognizable in the spatial distribution of the extincting strategies when comparing the snapshots displayed in figures  [ fig : bssp13 ] and [ fig : bssp366 ] .    for @xmath79 , any initial state evolves toward the absorbing state where all the players follow the @xmath0 strategy . the results of our systematic investigations are summarized in figure  [ fig : s3mc ] . systematic numerical investigations in the close vicinity of the critical points show that the vanishing concentrations follow the same power law behavior . namely , @xmath80 in the limits @xmath81 and @xmath82 respectively and @xmath83 in both cases @xcite . within the statistical error this value of the exponent @xmath84 agrees with the one of the 2 + 1 dimensional directed percolation @xcite . as expected , these critical transitions are accompanied with the divergence of concentration fluctuations , i.e. @xmath85 in the vicinity of the corresponding critical points . the numerical fitting yields @xmath86 in agreement with the dp values @xcite .    despite the same universal behavior there is a remarkable difference between the two extinction processes . the second extinction process ( at @xmath87 ) results in a frozen ( time independent ) absorbing state . conversely , the transition at @xmath88 is an example where the extinction of @xmath2 strategies happens on a fluctuating background . in other words , the properties of the absorbing state ( frozen or fluctuating ) do not affect the critical behavior of our model . as demonstrated in figure  [ fig : s3mc ] the results of monte carlo simulations are reproduced qualitatively well by the pair approximation @xcite . the striking differences are related to the long - range correlations accompanying the critical transitions at @xmath88 and @xmath89 . due to the strongly correlated domain structure , illustrated in figure  [ fig : bssp02 ] , the largest deviation can be observed for small @xmath3 values . we note that the concentration fluctuations , defined by eq . ( [ eq : chi ] ) , also diverge in the limit @xmath45 . unfortunately , in this particular case , we could not deduce a reliable value for the exponent @xmath90 because of the significant size effects . further systematic analyzes are required to clarify what happens in this limit . we have studied quantitatively the effect of external constraints on the emergence of cooperation in an evolutionary prisoner s dilemma game with three possible strategies ( cooperation , defection and tit for tat ) . in the present spatial model the players are distributed on a square lattice and their interactions are restricted to nearest neighbors . the darwinian selection rule is modeled by the adoption of the neighboring successful strategies . this evolutionary process is superimposed by two types of mutation mechanisms ( external constraints ) whose strength is characterized by a control parameter @xmath3 .    the choice of these three possible strategies yields non - analytical behavior in the limit @xmath45 for both the mean - field approximation and monte carlo simulation . the time - dependent predictions of mean - field theory are sensitive to the small perturbations .    according to the monte carlo simulations , in the absence of external constraint the system tends toward a frozen state composed from @xmath0 and @xmath2 strategies whose ratio depends on the initial concentrations . for both types of external constraints ( models a and b ) the system evolves toward a stationary state independently of the initial condition , and the defector concentration vanishes linearly as @xmath91 . in the limit @xmath45 , however , model a and b will exhibit different ratio of @xmath0 and @xmath2 strategies . this difference is related to the appearance of self - organizing patterns for model b. the present investigation indicates that such a society of strategies ( or species ) are very sensitive to the type of external supports ( or the ration of mutation rates ) . the measure of mutual cooperation can be well characterized by the average payoff whose maximum ( 4 ) can be reached only in the absence of defectors . figure  [ fig : apayoff ] compares the monte carlo results for the models a and b. surprisingly , for weak external support ( small @xmath3 ) the average payoff is larger for model a than for model b. in contrary to the naive expectation , the weak support of defenseless cooperators results in opposite consequence . namely , this mechanism feeds the defectors and simultaneously prevents their elimination by the retaliatory ( @xmath2 ) strategies . examples from the political and economical world justifies the above conclusions . in general , the exploiters are preferred by the governmental support for the defenseless layer of a society . the most dangerous effect is the reduction in the @xmath2 type population which can maintain the mutual cooperation against the exploiters . from the view point of cooperation , it is better to help those individuals who are able to prevent themselves against the exploitation . evidently , for sufficiently large @xmath3 values the random insertion of @xmath0 strategies can provide their dominance . in this case the a type external support is preferred to the b one if we wish to improve cooperation . above a threshold value this type of external constraints yields a homogeneous @xmath0 state which is defenseless against any defector appearing occasionally in a real system . further systematic research is required to clarify what happens in those models where the mutation mechanism is characterized by three independent control parameters . the present study confirms that the @xmath2 strategy is able to prevent the spreading of defection in the spatial models . we have to emphasize , however , that according to the simplest mean - field theory , @xmath2 dies out if the external support is of b type . consequently , the defectors will dominate those systems where the mean - field theory is exact ( e.g. infinite range of interaction , or randomly chosen partnership ) . in these mean - field like systems , the games between the  parent  and `` its offspring '' is not emphasized ( they are not neighbors ) , which is an advantage for the defectors comparing to spatially extended models . in the light of this feature our investigations imply many interesting questions related to the transition from the `` short range '' spatially extended systems to the `` long range '' of mean - field like ones .
Abstract:

Answer: we study the emergency of mutual cooperation in evolutionary prisoner s dilemma games when the players are located on a square lattice . the players can choose one of the three strategies : cooperation ( @xmath0 ) , defection ( @xmath1 ) or `` tit for tat '' ( @xmath2 ) , and their total payoffs come from games with the nearest neighbors . during the random sequential updates the players adopt one of their neighboring strategies if the chosen neighbor has higher payoff . we compare the effect of two types of external constraints added to the darwinian evolutionary processes . in both cases the strategy of a randomly chosen player is replaced with probability @xmath3 by another strategy . in the first case , the strategy is replaced by a randomly chosen one among the two others , while in the second case the new strategy is always @xmath0 . using generalized mean - field approximations and monte carlo simulations the strategy concentrations are evaluated in the stationary state for different strength of external constraints characterized by the probability @xmath3 .