Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: cooperation and defection are the two strategies that are usually at the heart of every social dilemma @xcite . while cooperative individuals contribute to the collective welfare at a personal cost , defectors choose not to . due to the resulting lower individual fitness of cooperators the selection pressure acts in favor of the defectors , thus designating the evolution of cooperation as a dilemma standing on its own . established by @xcite , evolutionary game theory @xcite provides a competent theoretical framework to address the subtleties of cooperation among selfish and unrelated individuals . the prisoner s dilemma game in particular , is considered a paradigm for tackling the problem of cooperation @xcite . the game promises a defecting individual the highest fitness if facing a cooperator . at the same time , the exploited cooperator is worse off than a defector playing with another defector . according to the fundamental principles of darwinian selection , cooperation extinction is therefore inevitable . this unadorned scenario is actually realized in the well - mixed prisoner s dilemma game , where defectors reign supreme @xcite . relaxing the inevitability of a social downfall constituted by the well - mixed prisoner s dilemma is the snowdrift or hawk - dove game @xcite , where mutual defection is individually less favorable than a cooperation - defection pair - up . accordingly , the snowdrift game allows for stable coexistence of cooperators and defectors in well - mixed populations @xcite . completing the triplet is the stag - hunt game @xcite , which together with the prisoner s dilemma and the snowdrift game , forms the standard set of social dilemmas that is frequently explored in the current literature [ see _ e.g. _ @xcite ] . compared with the prisoner s dilemma , the stag - hunt game offers more support for cooperative individuals in that the reward for mutual cooperation is higher than the temptation to defect . still , cooperation in the stag - hunt game is compromised by the fact that mutual defection is individually more beneficial than being an exploited cooperator , as recently highlighted by @xcite . an important realization by the pursuit of cooperation in the context of social dilemmas was the fact that the outcome of evolutionary games in structured populations can be very different from the well - mixed case . in a pioneering work , @xcite showed that the introduction of spatial structure via nearest neighbor interactions enabled the cooperators to form clusters on the square lattice and so protect themselves against the exploitation by defectors . following this discovery , the impact of the spatial structure on the evolution of cooperation has been investigated in detail @xcite , and the subject has since been reviewed comprehensively on different occasions @xcite . notably , the theoretical conjecture that spatial structure may promote cooperation , or at least sustain a multitude of competing strategies has been confirmed experimentally @xcite , but there also exist evidences that spatial structure may not necessarily favor cooperation @xcite . since the impact of the spatial structure on the evolution of cooperation depends on the governing social dilemma , and due to the difficulties associated with the payoff rankings in experimental and field work @xcite , it is certainly good practice to test new mechanisms aimed at promoting cooperation on different evolutionary games . the recent shift from evolutionary games on regular grids to evolutionary games on complex networks [ for the latter see _ e.g. _ @xcite ] can be considered a step towards more realistic conditions . indeed , the shift is by no means trivial and bears fascinating results , as recently reviewed by @xcite . quite remarkably , scale - free networks @xcite turned out to sustain cooperation by all three above - described social dilemmas @xcite , owing predominantly to the heterogeneity that characterizes their degree distribution . following this seminal discovery , several studies have since elaborated on different aspects of cooperation on scale - free networks , as for example its dynamical organization @xcite , evolution under clustering @xcite , mixing patterns @xcite , memory @xcite and payoff normalization @xcite , as well as its robustness in general @xcite and under intentional attack and error @xcite . the body of literature devoted to the study of evolutionary games on complex network is extensive , aside from the scale - free architecture hosting the prisoner s dilemma @xcite and the snowdrift game @xcite , covering also small - world @xcite , social as well as other real - world networks @xcite . notably , the impact of different interaction topologies has also been studied for evolutionary games outside the realm of the above - described social dilemmas . examples include the rock - paper - scissors game @xcite , the ultimatum game @xcite or the public goods game @xcite , and indeed many more studies of the latter games on complex network are expected in the near future .    besides the conditions generated by spatiality and complex interaction networks , many different mechanisms have been identified that can promote or otherwise affect the evolution of cooperation , and we mention them here briefly . aside from network reciprocity inherent to games on graphs and complex networks , other prominent rules promoting cooperative behavior are kin selection @xcite , direct reciprocity @xcite , indirect reciprocity @xcite and group selection @xcite , as recently reviewed in @xcite . moreover , voluntary participation @xcite , social diversity @xcite , asymmetric influence of links and partner selection @xcite , heterogeneous teaching activity @xcite , and the impact of long - term learning @xcite have been suggested as interesting possibilities that may emerge in real - life systems . the necessary overlap between interaction and replacement graphs @xcite has also been recognized as an important agonist in the evolution of cooperation . furthermore , the importance of time scales in evolutionary dynamics @xcite , the role of finite population size @xcite , and the impact of noise and uncertainties on evolution in general @xcite have been investigated as well . very recently , random explorations of strategies @xcite and simultaneous adoptions of different strategies depending on the opponents @xcite have also been identified as potent promoters of cooperation . some of these mechanisms will be described more accurately in the subsequent sections , but otherwise the reader is referred to the original works for details .    in the focus of this mini review are evolutionary games with coevolutionary rules . initiated by @xcite and by @xcite , and in some sense motivated by then very vibrant advances in network growth and evolution @xcite , the subject has evolved into a mushrooming avenue of research that offers new ways of ensuring cooperation in situations constituting a social dilemma . coevolutionary rules constitute a natural upgrade of evolutionary games since in reality not only do the strategies evolve in time , but so does the environment , and indeed many other factors that in turn affect back the outcome of the evolution of strategies . coevolutionary rules can affect the links players make ( or brake ) @xcite ( see section  [ interactions ] ) , the size of the network ( or population ) @xcite ( see section  [ growth ] ) , the teaching activity ( or reproduction capability ) @xcite ( see section  [ teaching ] ) and mobility of players @xcite ( see section  [ mobility ] ) , their age @xcite ( see section  [ aging ] ) , as well as several other factors @xcite ( see section  [ related ] ) that eventually affect the outcome of the underlying evolutionary game . although the majority of coevolutionary rules studied so far affects the network architecture and size , it is important to distinguish these studies from previous , partially closely related works where networks also change or evolve in the course of time @xcite ; in particularly so , since the term ` coevolution ' has in the past been used quite frequently and for rather different processes .    in the continuation of this paper we will review recent advances on evolutionary games with coevolutionary rules , affecting , as mentioned above , the interaction network , the reproduction capability of players , their reputation , mobility or age , more thoroughly . before that , however , we give in section  [ games ] a more technical description of the evolutionary games and strategy adoption rules that we will encounter throughout the paper . following the main body of the review given in section  [ rules ] , we conclude our work and give an outlook in section  [ final ] . as noted in the first paragraph of section  [ intro ] , the three main social dilemmas involving pairwise interactions are constituted by the prisoner s dilemma game , the snowdrift game and the stag - hunt game . at least one of these three games is employed in the majority of the works we will review below , and hence we give a more accurate description of them in what follows . irrespective of which game applies , players can choose either to cooperate or to defect . notably , other strategies , such as loners [ see _ e.g. _ @xcite ] or punishers [ see _ e.g. _ @xcite ] are also possible , but their inclusion to evolutionary games with coevolutionary rules has not yet been considered . in general , mutual cooperation yields the reward @xmath0 , mutual defection leads to punishment @xmath1 , and the mixed choice gives the cooperator the sucker s payoff @xmath2 and the defector the temptation @xmath3 . the standard scaled parametrization entails designating @xmath4 and @xmath5 as fixed , while the remaining two payoffs can occupy @xmath6 and @xmath7 . then , if @xmath8 we have the prisoner s dilemma game , @xmath9 yields the snowdrift game , and @xmath10 the stag - hunt game , as schematically depicted in fig . [ fig : schematic_games ] . without much loss of generality , this parametrization is often further simplified for the prisoner s dilemma game , so that @xmath11 is the only free parameter while @xmath4 and @xmath12 are left constant ( thick red line in fig . [ fig : schematic_games ] ) . however , since then the condition @xmath13 is not strictly fulfilled , this version is traditionally referred to as the weak prisoner s dilemma game @xcite . an option is also to use @xmath11 , @xmath14 , @xmath5 and @xmath15 , thus strictly adhering to the prisoner s dilemma payoff ranking @xmath8 while still having a single tunable parameter in the form of the ratio @xmath16 . for the snowdrift game one can , in a similar fashion , introduce @xmath17 $ ] such that @xmath18 and @xmath19 [ see _ e.g. _ @xcite ] , thereby again decreasing the effective dimensionality of the parameter space by one . note also that @xmath20 characterizes the cost - to - benefit ratio @xcite and in fact constitutes a diagonal in the snowdrift quadrant of the @xmath21 parameter plane , as shown in fig . [ fig : schematic_games ] by the dotted blue line . it is worth mentioning that other types of parametrization of two - strategy games are possible as well @xcite , but we focus on the one presented above since it is the most widely used , thus enabling an efficient comparison of different works . parameter plane encompassing the stag - hunt ( sh ) , the prisoner s dilemma ( pd ) and the snowdrift ( sd ) game . borders between games are denoted by dashed green lines . dotted blue diagonal depicts the @xmath20-parametrization of the snowdrift game , while the thick red line shows the span of the weak prisoner s dilemma game having @xmath11 as the only main parameter . the upper left quadrant represents the so - called harmony game ( hg ) . the latter , however , does not constitute a social dilemma because there cooperation is always the winning strategy.,width=283 ]    the most frequently employed setup entails that initially each player @xmath22 is designated either as a cooperator @xmath23 or defector @xmath24 with equal probability , and is placed on one of the nodes of the network with degree @xmath25 . evolution of the two strategies is then performed in accordance with a pairwise comparison rule , during which players accumulate their payoffs @xmath26 by playing the game with their neighbors . subsequently , player @xmath22 tries to enforce its strategy @xmath27 on player @xmath28 in accordance with some probability @xmath29 to be specified below . during the simulation procedure the player @xmath22 and one of its neighbors @xmath28 are chosen randomly , whereby in accordance with the random sequential update each player is selected once on average during @xmath30 ( network size ) such elementary steps , together constituting one full monte carlo step @xcite . alternatively , players can be selected sequentially , albeit this may cause artificial effects . independently on whether synchronized or the random sequential update is used , however , the time evolution is always discrete . the probability of strategy adoption @xmath29 can be defined in several ways . if the degree @xmath25 of all players is the same and does not change in time , the fermi function @xmath31 } \label{fermi}\ ] ] is a viable option , as proposed by @xcite . in eq . [ fermi ] @xmath32 denotes the amplitude of noise @xcite , or equivalently its inverse ( @xmath33 ) the so - called intensity of selection @xcite . in the @xmath34 limit player @xmath22 always succeeds in enforcing its strategy to player @xmath28 if only @xmath35 but never otherwise . for @xmath36 , however , strategies performing worse may also be adopted based on unpredictable variations in payoffs @xcite or errors in the decision making , for example . importantly , if the degree distribution of the interaction network ( note that this is a property that may likely change due to a coevolutionary rule ) , at any instance of the game , deviates from the case where all players have the same degree , the application of the fermi function may introduce additional effects since then the impact of the same value of @xmath32 effectively varies from one player to the other . indeed , if the degree distribution characterizing the interaction network is heterogeneous , a more successful player ( _ i.e. _ having a larger payoff ) can pass its strategy with the probability @xmath37 where @xmath38 is the largest of the two degrees @xmath25 and @xmath39 , and @xmath40 for the prisoner s dilemma game , @xmath41 for the snowdrift game and @xmath42 for the stag - hunt game ( note that the ranking of payoff elements for each specific game ensures the positive sign of eq . [ pach ] . ) introduced by @xcite , it is still a popular choice surpassing the difficulties associated with the fermi function described above , albeit with the downside of being unable to adjust the level of uncertainty by strategy adoptions .    finally , we mention another frequently used strategy adoption rule in coevolutionary models ; namely the so - called richest - following ( or ` learning from the best ' ) rule @xcite , where the focal player always imitates the strategy of its most successful neighbor @xcite . contrary to the preceding two strategy adoption rules , the richest - following is completely deterministic , in fact exercising the strongest selection between players . naturally , there also exist other microscopic strategy adoption rules , such as the win - stay - lose - shift rule where the focal player has restricted information on its neighbors , for which the reader is advised to consult the comprehensive review by @xcite for more details .    we will use the notation introduced above throughout this work unless explicitly stated otherwise . also , any deviations with respect to the employed initial setup , simulation procedure or the definition of strategy adoption probability will be noted when applicable . while it is obvious that strategies of players engaging in evolutionary games evolve in time , the fact that other properties characterizing either their individual attributes or the environment in which the game is staged may simultaneously evolve as well gained foothold only in recent years . yet the preceding transitions from well - mixed populations to spatial grids and further to complex networks , and in particular their success in explaining the evolution of cooperation , are inviting to further extensions of the theoretical framework , and indeed , the introduction of coevolutionary rules seems like the logical next step . it should need little persuasion to acknowledge that links we make with others change in time , that all of us age , that our roles in life evolve , and that the society we are part of may itself be subject to transformations on a global scale . coevolutionary rules aim to integrate these processes into the framework of evolutionary games . perhaps the biggest challenge thereby is , how to do this without directly ( or obviously ) promoting cooperation . for example , if one introduces a rule that , in the course of time , cooperators should aim to link only with cooperators and defectors only with defectors , it should come as no surprise that such a coevolutionary rule will likely favor the evolution of cooperation . it is demanding , however , to explore and identify successful mechanisms that do not attribute special , not to say fictitious , cognitive skill to players , and do not use a discriminative set of rules for every participating strategy . thus , coming up with plausible coevolutionary rules is not straightforward , and care must be exercised in order to give both strategies equal credentials . simply because a strategy is bad for social welfare it should not be assumed that the individuals adopting it are less skilful or sly than their opponents . in fact , rather the opposite seems to apply . for example , defectors should be assumed being just as skilful by selecting appropriate partners as cooperators .    in the following we will review coevolutionary rules affecting the interactions between players ( section  [ interactions ] ) , population growth ( section  [ growth ] ) , teaching activity ( section  [ teaching ] ) , mobility ( section  [ mobility ] ) and aging ( section  [ aging ] ) of players , as well as related aspects ( section  [ related ] ) of individual and global characteristics that may affect strategy dominance in evolutionary games . coevolutionary rules frequently affect how players link with one another and this section reviews examples thereof . as we have mentioned above , the result of a game with a partner may influence the durability of such a connection . in particular , an unsatisfied player can easily brake a link to look for a more beneficial interaction with another partner . notably , the network itself does thereby not shrink or grow in size ( for the latter see section  [ growth ] ) . instead , our aim in this subsection is to explore possible rearrangements of an existing network that is driven by the success of players participating in the governing evolutionary game . since coevolutionary rules affecting the interactions between players were proposed first @xcite , the pertaining literature that has accumulated thus far is rather extensive . works can be partitioned into those that employed strategy independent rules for link adaptations @xcite and those that considered strategies or their performances as factors potentially affecting the rewiring @xcite . notably , the latter distinction is rather crude and sometimes not completely accurate since the rewiring can be performed based on a secondary player property , like reputation @xcite , attractiveness @xcite or satisfaction @xcite , which are typically related with strategy performance over time . it is indeed possible to further distinguish the proposed coevolutionary rules introducing dynamical interactions to those by which the change of the interaction network is driven by the urge to increase the payoff of the focal player directly @xcite , and those by which the rewiring serves also the increase of the payoff but on a global scale , _ i.e. _ independently of the payoff of the focal player that is affected by the link adaptation @xcite . in the latter case it is thus not necessary to calculate the players payoff prior to rewiring because solely its strategy determines the ` life ' of a link .    [ ! ht ]        summarizing the above , a simplified but useful classification of interaction - updating rules is presented in fig . [ fig : class_of_updates ] . as suggested in the works mentioned last in the preceding paragraph , the lifetime of a link may depend primarily on the strategies of the players that are connected with it ( type a ) . from this point of view it is straightforward to establish that defector - defector links are short - lived if compared to cooperator - cooperator links since the former are not beneficial for neither of the two involved players , while the later yield mutual gains for both . the second set of coevolutionary rules evaluates the payoffs originating from the investigated link prior to its potential deletion , while the actual removal takes place only if a new neighbor may yield higher benefits ( type b ) @xcite . and finally , the third set of coevolutionary rules considers the strategy adoption process as pivotal for deciding which links to delete and which to keep ( type c ) . an example thereof is that the invaded player looses all its links except the one with the donor of the new strategy @xcite , as depicted in fig . [ fig : class_of_updates](c ) . there are several real - life situations that can be modeled by the latter rule . from a biological viewpoint , the coevolutionary rule can be linked with an invasion of the subordinate species and the subsequent replacement by a newborn of the victor . a similar phenomenon can be observed in human societies when one changes a job . typically then the links to former coworkers fade and eventually brake , and new ties are formed primarily with the coworkers from the new working place . notably , it falls within the same logical set of rules if the player that has successfully passed its strategy is allowed to increase the number of neighbors that are directly connected to it , as was proposed by @xcite . it should not be overlooked , however , that the strategy adoption process , triggering the deletion and/or addition of links , is itself inherently routed in the payoff difference of the considered players . an important feature of coevolutionary rules molding the interactions among players is also the time scale separation between link and strategy adaptations , as reported in @xcite . as the cited works suggest , the time scale separation can drastically influence the final output of coevolutionary games . this effect will also be discussed in the present review . in what follows , we will review the coevolutionary rules presented in some of these works more accurately .    in agreement with the actual time - line we start with the work of @xcite , who proposed a coevolutionary rule in which a randomly chosen player @xmath22 is connected to a new neighbor at random . if the new link increases the average payoff of the focal player the latter accepts it and disconnects from the neighbor it scores worst against . note that this coevolutionary rule indirectly favors the establishment of cooperator - cooperator links ( this pair - up yields the highest average payoff ) and at the same time facilitates the deletion of defector - defector links . the coevolutionary rule was paired up with strategy mutation @xcite , by which a mutation is accepted if it yields a higher payoff for player @xmath22 than the initial strategy [ type b ; see fig .  [ fig : class_of_updates](b ) ] . starting from a random network with poissonian degree distribution , it was shown that this coevolutionary rule leads to cooperative nash equilibria in an iterative prisoner s dilemma game with the additional property that no agent can improve its payoff by changing its neighborhood . according to the authors , the later may be interpreted as a sort of ` network nash equilibrium ' @xcite . notably , this coevolutionary rule also affects the initial network structure in that the later evolves to a statistically stationary state with a broad degree distribution , suggesting scale - free behavior and giving rise to small - world properties , among others . following their preceding seminal contribution [ see @xcite ] , @xcite proposed a coevolutionary rule affecting only defector - defector pairs with the motivation that in this pair - up _ both _ players might be better off if searching for a new partner in the context of the prisoner s dilemma game [ type a ; see fig . [ fig : class_of_updates](a ) ] . it was shown that , starting from a random network with a given average degree and the richest - following strategy adoption rule , even a small probability @xmath43 of searching for a new partner from a defector - defector configuration may substantially promote cooperation . indeed , as low as @xmath44 were shown to uphold practically complete cooperator dominance across the whole span of the weak prisoner s dilemma game ( see fig . [ fig : schematic_games ] ) . with respect to the network topology , it was reported that the coevolutionary rule facilitates the formation of a hierarchical interaction structure and may also introduce small - world properties if the search for new partners is constrained to the neighbors of the neighbors . however , unlike as shown by @xcite , the occasional ( depending on @xmath43 ) break - up of defector - defector pairs has not been found leading to broad or even scale - free degree distributions . these findings were subsequently extended @xcite , where it was elaborated on the spontaneous emergence of cooperators with extremely high payoffs and the important role of this so - called ` leaders ' for the global sustenance of cooperation . as such , these works can be considered as an important prelude to the realization of the fact that scale - free networks constitute an extremely favorable environment for the evolution of cooperation irrespective of the governing social dilemma @xcite . a simple but still plausible coevolutionary rule affecting links between players has been proposed by @xcite . exemplifying type a class of interaction updating [ see fig . [ fig : class_of_updates](a ) ] , players adopting either the strategy @xmath45 ( cooperate ) or @xmath46 ( defect ) were designated a propensity to form new links denoted by @xmath47 and @xmath48 , such that @xmath49 links were formed at rates @xmath50 , where @xmath51 $ ] . moreover , each link was assigned a specific lifetime depending on the strategy of the two connected players given by @xmath52 , where @xmath53 is the corresponding link death rate . with these definitions the authors were able to specify mean field equations governing the so - called active linking dynamics of the network . this coevolutionary rule has been tested on the prisoner s dilemma and the snowdrift game subject to the fermi function ( see eq . [ fermi ] ) governing the strategy adoption [ for additional set - ups see @xcite ] . it was shown that if the time scale associated with active linking is much smaller than the one associated with strategy updating the proposed coevolutionary rule leads to an effective rescaling of the governing payoff matrix , and thus a shift in the played evolutionary game . for example , the prisoner s dilemma game transforms to the coordination game , while the snowdrift game transforms to the harmony game [ for details on the coordination game see _ e.g. _ @xcite ] . in both cases the cooperation is promoted , in turn designating the proposed coevolutionary rule as a simple and analytically tractable means of understanding how selfish and unrelated individuals may be led to adopting the cooperative strategy . on the other hand , if the ratio between the time scales associated with active linking and strategy updating is not small , the interplay between these two dynamical processes leads to a progressive crossover between the analytic results obtained for very fast active linking and the evolutionary dynamics of strategies taking place on static graphs . the latter were found to exhibit different degrees of heterogeneity depending on the parameters determining active linking , yet in general complying well with real social networks having fast decaying tails in their degree distributions . notably , compared to the earlier works reviewed above , an important observation made in the two papers by @xcite was that the impact of coevolutionary rules may depend significantly on the time scales associated with the strategy and structure ( link ) evolution . for example , @xcite too commented on the time scale separation in their model , yet the promotion of cooperation was thereby not notably affected [ both slow ( @xmath54 ) and fast ( @xmath55 ) rewiring of @xmath56 links was found to be highly effective ] . active linking dynamics has also been investigated in repeated games incorporating direct reciprocity @xcite , where additionally the productivity of every link connecting two players was evaluated prior to potential rewiring . moreover , the active linking model proposed by @xcite was recently extended by @xcite to account for the impact of different reactions to adverse ties . in particular , @xcite additionally introduced individual behavioral types of players through different values of @xmath57 , separating those that tend to break their links frequently ( @xmath57 close to @xmath58 ) from those that tend to break them rarely ( @xmath57 close to @xmath59 ) . in this way both topology and strategy dynamics become interrelated it was shown that populations in which individuals are allowed to handle their social contacts diversely are more prone to cooperative behavior than those in which such diversity is absent . similarly as in @xcite , it was shown that by an appropriate time scale separation between strategy and network dynamics the diverse behavioral preferences can also introduce a transformation of the governing social dilemma , yet so that each individual perceives the same game differently . also building on the time scale separation between rewiring and strategy updating is another paper by @xcite , where players are able to decide which links they want to maintain and which they want to change based on local information about their neighbors [ type b ; see fig . [ fig : class_of_updates](b ) ] . a link change is initiated if player @xmath22 is dissatisfied with its connection to player @xmath28 , which is the case if the strategy of player @xmath28 is to defect . however , player @xmath28 also assesses the quality of its link to @xmath22 in the same fashion . if both @xmath22 and @xmath28 are satisfied ( which practically means that both are cooperators ) the link between them remains intact . if @xmath22 wants to remove the link and @xmath28 not ( @xmath60 and @xmath61 ) , the probability @xmath62 given by the fermi function ( see eq .  [ fermi ] ) is invoked . if realized , player @xmath22 is allowed to redirect to a random neighbor of @xmath28 . if not , @xmath22 stays linked with @xmath28 . if both @xmath22 and @xmath28 are defectors , and thus both want to remove the link , then rewiring takes place such that the new link keeps attached to @xmath22 with probability @xmath62 or to @xmath28 with probability @xmath63 . finally , the authors introduce a ratio defined as the time scale associated with the evolution of strategies @xmath64 ( for simplicity equal to one ) divided by the time scale associated with the rewiring of the network @xmath65 , showing that there exists a critical value for this ratio above which cooperators wipe out defectors . moreover , the emerging networks exhibit an overall heterogeneity that is maximal at the critical value and can be compared well with diversity associated with realistic social networks . the coevolutionary rule proposed by @xcite was extended by allowing individuals to adjust their social ties @xcite , with the extension that each player was assigned an individual willingness @xmath66 to rewire unwanted social interactions . accordingly , players with small @xmath67 can be considered as loyal to their partners and resilient to change , while those with @xmath68 are swift in altering their links . it was shown that the highest cooperation levels can be achieved when the propensity to change links is highly strategy - dependent . more precisely , it was found very beneficial for the evolution of cooperation if defectors changed their partners frequently while cooperators behaved oppositely , _ i.e. _ kept their partners for as long as possible . this is indeed expect since defectors are unable to establish social ties under mutual agreement with their partners . on the other hand , cooperators are typically much more prone to establishing long - term relations and loyalty . ultimately , these two facts lead to the evolution of heterogeneous interactions networks where cooperators are known to prevail over defectors [ see _ e.g. _ @xcite ] .    related to the work of @xcite is the recent paper by @xcite , the difference being that in the latter only cooperators are allowed to switch their partners if they act as defectors , and moreover , the new partner is sought randomly from the whole population . it is found that under such a coevolutionary rule there exists an optimal , rather than critical [ compare with @xcite ] , time scale separation between rewiring and strategy updating for which cooperation thrives best . also , the resulting interaction topology is different in that the network typically becomes divided into isolated communities of cooperators and defectors due to the selective coevolutionary rule targeting only mixed strategy pairs . notably , a preceding study by @xcite considered partner switching also with the aid of reputation , which was defined similar to image scoring proposed a decade earlier by @xcite . it was found that coevolutionary switching of partners based on the reputation of nearest and next - nearest neighbors , _ i.e. _ preferentially targeting players with a higher reputation , is significantly more effective in promoting cooperation than seeking a new partner randomly from the whole population . thus , these results underline the importance of indirect reciprocity @xcite also when individuals can adjust their social ties . links are beneficial for all involved ) , can pass its strategy to a defector that is weakened by neighboring defectors ( panel a ) . subsequently , the invaded player looses its links to other players , except the one with the donor of the new strategy ( panel b ) . due to random link additions , the successful invasion of cooperators will repeat itself sooner or later depending on @xmath69 ( panel c ) , ultimately resulting in the disintegration of the defector cluster ( panel d ) . note that this process can not work in the opposite direction , _ i.e. _ defectors can not invade a cluster of cooperators . the necessary condition for this mechanism to work is the emergence of quasi - homogeneous groups , which occur if strategy adoptions happen frequently between new link additions , _ i.e. _ if @xmath69 is large enough.,width=283 ]    in addition to the studies reviewed above , similar coevolutionary rules were used to study how scale - free networks emerge in social systems @xcite , how cooperation in the prisoner s dilemma game can be established via the interplay between dynamical interactions and game dynamics @xcite or interaction stochasticity @xcite , how social dilemmas in general can thereby be resolved @xcite , as well as other sophisticated models @xcite were considered . we refer the interested reader to the original works for further details , while here we proceed with the review of some of the studies that employed strategy independent rules for link adaptations @xcite . belonging to the third type of interaction - updating coevolutionary rules [ type c ; see fig . [ fig : class_of_updates](c ) ] is the model proposed by @xcite , where whenever player @xmath22 adopts a new strategy all its links , except from the one with the donor of the new strategy , are deleted ( see fig .  [ fig : multilevel_selection ] ) , and moreover , all individuals are allowed to form a new link with a randomly chosen player with which they are not yet connected after every @xmath69 full monte carlo steps . note that the random additions of links counteract the deletions following each strategy adoption , in turn largely preserving the initially random topology and the heterogeneity of the interaction network @xcite . it was shown that at a sufficiently large time scale separation between link deletions and additions , constituted by @xmath69 , this coevolutionary rules evokes the spontaneous emergence of a powerful multilevel selection mechanism , which despite the persistent random topology of the evolving network , maintains cooperation across a substantial portion of the @xmath21 parameter plane . importantly , the promotion of cooperation is thereby not realized by some final outcome of a coevolutionary rule , as is for example the case in @xcite , but is the consequence of a dynamical processes that affects the adoption of strategies on the macroscopic level of evolutionary game dynamics . as fig . [ fig : multilevel_selection ] illustrates , the latter manifests as multilevel selection @xcite that strongly promotes cooperation in all major types of social dilemmas .    [ ! ht ]     grid , obtained at an optimal ( @xmath70 ; top panel ) and a too large ( @xmath71 , bottom panel ) connectivity originating from the coevolutionary rule proposed by @xcite . full black ( open green ) boxes depict the positions of influential defectors ( cooperators ) while yellow ( white ) pixels depict the players who are within ( out of ) their range of influence . if the influential players are separated by large disjunct territories of influence ( bottom panel ) the network reciprocity is not functioning well.,width=264 ]    conceptually fitting to the third type of interaction - updating coevolutionary rules [ type c ; see fig . [ fig : class_of_updates](c ) ] is also the model introduced by @xcite , where each player @xmath22 that successfully passes its strategy ( _ i.e. _ reproduces in a biological scenario ) is allowed to form a new link with one randomly selected neighbor from its current neighborhood , thereby increasing its degree @xmath25 by one . thus , successful players are allowed to grow compact large neighborhoods that are centered around their initial four nearest neighbors . as it is generally assumed , the payoff of any given player is accumulated from all the links with its neighbors . hence , without the normalization by degree , the more links a player has the higher its payoff is expected to be . for the sake of an easier depiction of player distributions , we start from an interaction graph that can be represented by a square lattice . evidently , the additions of new links will drive the initial topology away from two dimensions , yet still allowing us to capture relevant details of strategy distributions via a square lattice representation , as shown in fig . [ fig : coev_range ] . notably , the coevolutionary rule is independent on whether @xmath60 or @xmath46 , and can hence be considered as strategy independent . however , since the performance of the strategies is clearly definitive for who gets to make new links , the rule has at least conceptual similarities with some of the above - reviewed works that considered strategies as more directly decisive for the outcome of dynamical interactions . since the coevolutionary rule would eventually result in a fully connected graph ( the latter constitutes well - mixed conditions ) , the parameter @xmath72 was introduced as the maximal degree a player is allowed to obtain . accordingly , the process of making new connections is stopped as soon as the degree @xmath73 of a single player within the whole population reaches @xmath72 , whereby this limit prevents the formation of a homogeneous system and indeed constitutes the main parameter affecting the impact of the coevolutionary rule . starting from a square lattice , it was shown that intermediate values of @xmath74 substantially promote cooperation in the weak prisoner s dilemma game ( see fig . [ fig : schematic_games ] ) governed by eq . [ pach ] , which was attributed to the formation of highly heterogeneous interactions networks ensuring optimal transfer of information between influential players , _ i.e. _ those that have the highest degree among any other players that can adopt the strategy from the influential player via an elementary process . the coevolutionary rule was also tested against robustness to time scale separation between neighborhood growth and strategy adoption via the introduction of a parameter @xmath75 , defining the probability of degree extension after a successful strategy pass . evidently , @xmath76 recovers the originally proposed model while decreasing values of @xmath75 result in increasingly separated time scales . although the impact of @xmath75 was found depending somewhat on the temptation to defect @xmath77 , in general values of @xmath78 yielded insignificantly different results if compared to the @xmath76 case . note that @xmath79 corresponds to the spatial model without coevolution , and hence it is natural that as @xmath80 the promotion of cooperation was found fading . the success of intermediate values of @xmath72 in promoting cooperation can be explained based on the emergence of heterogeneous interaction networks and the disassortative mixing of high - degree nodes @xcite . in particular , while intermediate values of @xmath72 result in a highly degree - diverse mixture of players , which generally promotes cooperation [ see also @xcite ] , too large values of @xmath72 yield just a few influential players with disjunct clouds of homogeneous regions surrounding them , as shown in the bottom panel of fig . [ fig : coev_range ] . in the later case , the lack of information exchange between hubs ( influential players having large degree ) defectors can easily survive , thus resulting only in moderate cooperation levels . the top panel of fig . [ fig : coev_range ] , on the other hand , features an optimal distribution of influential players ( _ i.e. _ those having large degree ) , where high - degree cooperators can make cooperation prevail practically across the whole system . it is worth mentioning that the optimal level of cooperation observed for an intermediate value of @xmath72 in @xcite is conceptually similar to the case when an intermediate strength of information exchange between influential players yields the optimal environment for cooperation @xcite , as is illustrated in fig . [ fig : restricted ] . in the later case a fraction @xmath81 of players that are characterized with a larger teaching capability are allowed to temporarily link with distant opponents of the same kind with probability @xmath43 , thus introducing shortcut connections among the distinguished . these additional temporary connections are able to sustain cooperation throughout the whole range of the temptation to defect @xmath77 ( see fig . [ fig : schematic_games ] ) . as fig . [ fig : restricted ] demonstrates , only minute values of @xmath43 , constituting a moderate intensity of information exchange between influential players , warrant the best promotion of cooperation .     as a function of @xmath43 in the ` connected influential players ' model @xcite . parameter @xmath43 determines the intensity of the information exchange between influential players . the fraction of influential players is @xmath82 and the temptation to defect is @xmath83 . the line is just to guide the eye.,width=283 ]    strategy - independent coevolutionary rules affecting the interactions between players have also been considered in the context of distinguished players populating a square lattice @xcite , in the context of dynamically changing random and scale - free networks @xcite , as well as in the context of random networks with different assortative mixing emerging due to links adaptations @xcite . again , the interested reader is referred to the original works for further details , while here we proceed with a new section devoted to the review of coevolutionary rules introducing network growth . first , it is worth noting that coevolutionary rules giving rise to population growth have been considered much less frequently than the above - reviewed rules affecting solely how players link with one another . indeed , only three works fit into this subsection , the latter being the arxiv contribution by @xcite and two recent papers by @xcite . closely related to the rather general and broad interest in network growth @xcite , the networks formed by the players participating in evolutionary games can be subject to growth as well , with motivations equivalent to those of the broader research field . although never officially published , the work by @xcite should be acknowledged as being pioneering in raising the question how the dynamics of an evolutionary game might affect network growth , and how in turn the latter affects back the prevalence of the competing strategies . for this purpose , the authors proposed a so - called payoff - based preferential attachment rule under the guidance of the @xmath20-parameterized snowdrift game ( see fig . [ fig : schematic_games ] ) and the fermi strategy adoption rule given by eq . [ fermi ] . indeed , the preferential attachment rule by @xcite is practically identical to the seminal growth and preferential attachment model proposed by @xcite , only that in the former the probability of linking a new player to an existing player @xmath22 is not determined by its degree @xmath25 but rather by its accumulated payoff until that time . not surprisingly then ( note that in the absence of normalization , similarly as the degree of a player , its payoff will typically also increase by one during an update ) , the coevolutionary rule was found leading to the emergence of scale - free interaction networks that are characterized by the degree distribution @xmath84 ; the coefficient @xmath57 thereby depending on the scaling of the probability of linking a new player to an existing player . in accordance with an earlier study by @xcite , the emerging scale - free topology due to the coevolutionary rule was found highly beneficial for the evolution of cooperation in the snowdrift game . notably , the authors also investigated the average path length and the assortative mixing of the emerging networks , as well as the wealth distribution of players . the former two were found to be in agreement with observations from realistic social networks , while the latter was found consistent with the pareto law . the work by @xcite also introduces an evolutionary preferential attachment rule that is based on the payoffs of existing players , albeit the weak prisoner s dilemma is employed as the governing game and the strategy adoption probability is quantified according to eq . more precisely , the network growth starts with @xmath85 fully connected players and proceeds by adding a new player with @xmath86 links to the existing ones at equally spaced time intervals @xmath87 . the probability that any player @xmath22 , ( having payoff @xmath26 ) in the network receives one of the @xmath88 new links was defined as @xmath89 } \label{attach}\ ] ] where the sum runs over all the players forming the network at time @xmath90 . moreover , the parameter @xmath91 controls the weight of the payoffs during the network growth . for @xmath92 all nodes are equiprobable , corresponding to the weak selection limit [ see _ e.g. _ @xcite for recent works related to the latter ] , while for @xmath93 the players with the highest payoffs are much more likely to attract the newcomers . the authors also specified the time interval @xmath94 for payoff evaluations and potential strategy adoptions , focusing explicitly on @xmath95 ( typically @xmath96 , although smaller and larger values were also commented on ) , so that accordingly the network growth was considered to be faster than the evolutionary dynamics . it was shown that the weak selection limit results in networks having degree distributions with exponentially decaying tails , while the strong selection limit ( @xmath93 ) yields highly heterogeneous scale - free interaction networks . in agreement with the earlier findings obtained on static graphs @xcite , it was confirmed that higher levels of cooperation are attainable on heterogeneous rather than homogeneous topologies , albeit that the distribution of strategies with respect to the degree of nodes forming the network is different . more precisely , cooperators were not found occupying the main hubs as on static graphs , but rather the nodes with an intermediate degree , thus indicating that the interplay between the local structure of the network and the hierarchical organization of cooperation is guided by the competition between the network growth and the evolutionary dynamics . notably , similar differences in the microscopic organization of the steady state composition of strategies were found on static scale - free networks when the payoffs were subjected to normalization @xcite , although the discrepancies reported by @xcite were solely the consequence of the coevolutionary growth process . indeed , in a recent study @xcite this coevolutionary rule has been studied further to confirm that the reported promotion of cooperation hinges not only on the final heterogeneity of the resulting network but also vitally on the particularities of the growth process itself . in addition , it was shown that under strongly payoff dominated growth conditions so - called super - hubs can emerge , which attract most of the links from the other nodes . although under such conditions cooperation was found thriving even for high temptations to defect , it was also noted that the robustness of these findings may be compromised , or at least not so strong as on static scale - free networks @xcite , due to the extreme heterogeneity of the star - like structures that can be brought about by the coevolutionary network growth .    with the above we conclude the review of coevolutionary rules affecting the interaction network , either in terms of links players form with one another ( see section  [ interactions ] above ) or the actual number of players participating in the game and the related network size . we proceed with the review of coevolutionary rules affecting individual properties of players , such as their teaching activity ( see section  [ teaching ] ) , mobility ( see section  [ mobility ] ) or age ( see section  [ aging ] ) . note , however , that some of the above - reviewed coevolutionary rules already incorporated and/or affected personal features of players , such as for example the loyalty to their partners @xcite or influence @xcite , albeit always in conjunction with the coevolution of the interaction network . in what follows , the links and the size of the network are not affected by the coevolutionary rules unless explicitly noted otherwise . heterogeneity of players has been explored as a beneficial condition for cooperation in several forms @xcite . it can be easily accepted that players are not perfectly identical within a population . some have higher reputation or stronger influence than others . these differences can be detected via a biased direction of strategy adoptions . more precisely , players with higher reputation can spread their strategy more easily than if having an average or low reputation . in other words , their activity to teach a neighbor a new strategy is higher . it turned out that one of the individual quantities that influences the evolution of cooperation most effectively is the teaching activity @xcite . notably , teaching activity can also be referred to as the influence or reproduction rate @xcite , with the logical assumption that influential individuals are much more likely to reproduce , _ i.e. _ have a higher teaching activity , than players with low influence . teaching activity ( or the synonyms we pointed out ) can be introduced into the framework of evolutionary game theory via a modified fermi strategy adoption rule @xmath97 } \label{teachfermi}\ ] ] where @xmath98 characterizes the strength of influence ( or teaching activity ) of player @xmath22 . obviously , @xmath99 for all @xmath22 returns eq . [ fermi ] , whereby it is important to acknowledge that even if @xmath100 but the same for all @xmath22 the evolutionary outcome of strategy abundance remains the same , only the relaxation times lengthen . quenched ( non - evolving ) distributions of @xmath98 may promote cooperation even on homogenous lattice - type interaction topologies @xcite , while their application on complex networks reveals further that players with large teaching activity play a similar role as hubs in highly degree heterogenous graphs , such as scale - free networks @xcite . we refer the reader to the original works for further details on models using quenched distributions of @xmath98 , while here we proceed with the review of the two papers by @xcite that thus far considered the teaching activity as an evolving property of individual players .    ) , which were found beneficial for the evolution of cooperation irrespective of the underlying interaction network.,width=283 ]    in a social context the strategy adoption can be considered as learning from the more successful player . accepting this point of view , it is straightforward to consider a player who has successfully passed a strategy as the one having a higher reputation , and thus a higher teaching activity than other players . implementing this idea into a coevolutionary rule , we proposed that whenever player @xmath22 successfully passes its strategy the influence @xmath98 increases by a constant positive value @xmath101 according to @xmath102 @xcite . this coevolutionary rule is illustrated in fig . [ fig : rule_evol_teach ] . it should be noted that in this model the term ` reputation ' does not necessarily have a positive meaning , and thus may be in contradiction with the same term used elsewhere @xcite , where players who cooperated were awarded a higher reputation , which expectedly yielded higher levels of cooperation . moreover , for the sake of simplicity it was assumed that the evolution of @xmath103 stops as soon as the highest @xmath98 reaches @xmath58 @xcite . starting from a nonpreferential setup , initially assigning @xmath104 to every player irrespective of its strategy , it was found that there exists an optimal intermediate value of @xmath105 for which cooperation in the weak prisoner s dilemma as well as the @xmath20-parameterized snowdrift game ( see fig . [ fig : schematic_games ] ) is enhanced best . it is in fact understandable that only an intermediate value of the increment @xmath106 was found warranting the optimal heterogeneity of the distribution of @xmath98 . namely , if @xmath106 is small then the values of @xmath98 simply increase homogeneously for all the players , while large values of @xmath106 result in a very quick halt of the coevolutionary process , either way resulting in a rather homogeneous distribution of the teaching activity . indeed , for both considered evolutionary games it was found that using moderate @xmath106 the final distribution of @xmath103 is exponential , in turn attributing the promotion of cooperation to the spontaneously emerging highly heterogenous plethora of differently influential players , as shown in fig . [ fig : teaching_dist ] . it was also shown that the effectiveness of the coevolutionary rule increases with the increasing uncertainty by strategy adoptions @xmath32 , and that the rule is robust to variations of the updating scheme . for example , it was verified that an alternative coevolutionary rule , by which @xmath98 was allowed to grow also past @xmath58 only that then @xmath98 was normalized according to @xmath107 ( @xmath108 being the maximal out of all @xmath98 at any given time ) to ensure that the teaching activity remained bounded to the unit interval , yielded similar results as the halted version .     as a result of the coevolutionary rule introduced by @xcite . results were obtained for the weak prisoner s dilemma game staged on a square lattice . parameter values were : @xmath109 , @xmath110 and @xmath111.,width=283 ]    a two - fold extension of the above work was made in @xcite . first , the coevolutionary rule was no longer considered to be strategy independent . note that in the preceding work @xmath102 was executed irrespective of the strategy of player @xmath22 . conversely , in @xcite this rule was applied separately either only for @xmath60 ( cooperators ) or only for @xmath112 ( defectors ) . second , the evolution of cooperation was examined in all three major social dilemma types defined on the @xmath21 parameter plane ( see fig .  [ fig : schematic_games ] ) . it was shown that both versions of the coevolutionary rule promote cooperation irrespective of the underlying game . opposite to intuitive reasoning , however , it was revealed that the exclusive coevolutionary promotion of players spreading defection is more beneficial for cooperation than the likewise direct promotion of cooperators . this was attributed to the fact that the coevolutionary promotion of defectors results in a larger fraction of players that are at least once affected by the coevolution , ultimately leading to a stronger segregation of the population into active ( those having @xmath113 ; note that the latter is the initial teaching activity assigned to all ) and virtually ( or comparably ) inactive ( those having @xmath114 ) players than the coevolutionary rule affecting cooperators . according to previous findings on the impact of static distributions of heterogeneity @xcite , the stronger expressed segregation was found directly responsible for the better promotion of cooperation when defectors rather than cooperators were subjected to coevolution . as we have already mentioned ( see _ e.g. _ section  [ interactions ] ) , the time scale separation of coevolutionary processes may decisively affect the final output of such models . this was observed for the coevolution of teaching activity as well . more precisely , the time scale separation between the coevolution of teaching activity and strategy adoption can be tuned via the introduction of a parameter @xmath75 , defining the probability of increasing @xmath98 after a successful strategy pass . evidently , @xmath76 recovers the two originally proposed models while decreasing values of @xmath75 result in increasingly separated time scales . although the impact of @xmath75 was found depending somewhat on the type of the considered coevolutionary rule , in general , values of @xmath115 yielded insignificantly different results if compared to the @xmath76 case , thus indicating that the findings are robust to this type of alterations [ note that , as in @xcite , @xmath79 corresponds to the model without coevolution , and hence it is natural that as @xmath80 the promotion of cooperation was found fading ] . more precisely , however , since the fraction of cooperators was found increasing rather steadily with increasing values of @xmath75 , especially for the coevolutionary rule affecting defectors , it is optimal to keep the coevolutionary process affecting the teaching activity of players paced similarly fast as the main evolution of strategies , _ i.e. _ @xmath116 . we thus emphasize , that the above - reviewed coevolutionary models affecting the teaching activity have revealed that a simple ` successful become more successful ' principle can result in a heterogenous hierarchy of individual properties of players , such that optimal conditions for the evolution of cooperation are warranted . a similarly positive impact of heterogeneity on the spread of the cooperative strategy was also detected on heterogenous interaction networks @xcite , hence conceptually linking these two seemingly disjoint promoters of cooperation . it was acknowledged already by @xcite that players finding themselves in an unprofitable or undesirable situation frequently choose moving in order to free themselves from the negative consequences of that situation . accordingly , mobility can be considered as being a coevolutionary process in the sense of strategy and/or position alterations that ultimately determine the environment of players . although we were unable to locate coevolutionary terminology associated with mobility , we review here advances on this topic made during the last decade , and indeed consider movements of players during the evolution of strategies as being guided by rules of coevolution .    the impact of diffusion on the outcome of a spatial prisoner s dilemma game via empty sites was questioned first by @xcite . therein , weak quenched disorder introduced in the form of empty sites on a square lattice was found beneficial for cooperation in the prisoner s dilemma game subject to the richest - following strategy update rule . in a follow - up paper @xcite the approach was extended to allow diffusion of players to nearest - neighbor empty sites with a certain probability . in particular , two ways of implementing the mobility were considered . first , each player was allowed to make an attempt at moving only after payoff accumulation and potential strategy adaptations were executed in parallel , or second , the moving was attempted prior to the evolution of strategies . importantly , the moving of players was considered to be brownian random walk like , _ i.e. _ diffusive , not relying on any type of explicit , genotypic or phenotypic assortment , and also being strategy - independent . due to this minimalist set - up the study provided rather general insights into possible effects of mobility . it was shown that mobility may indeed promote cooperation since it increases the ability of cooperator clusters to invade and overtake isolated defectors . on the other hand , mobility may also allow defectors to escape retaliation from a former partner and lead to stronger mixing in a population due to increasing interaction ranges of players , both of which are known to damp the evolutionary success of cooperators . thus , the impact of mobility in the form introduced by @xcite is not clear cut . as noted by the authors , further work on this is in progress . importantly , it was also emphasized that mobility may be subject to more deliberate coevolutionary rules , taking into account personal preferences of players , their strategies , as well as aims . an example of the latter was studied by @xcite , who introduced success - driven migration as a possible mediator leading towards cooperation in populations of selfish and unrelated individuals even under noisy conditions . in particular , success - driven migration [ see also @xcite ] was implemented so that , before the strategy adoption , player @xmath22 was allowed to explore potential payoffs that it would receive if occupying one of the empty sites in the migration neighborhood . the latter was typically restrained to nearest and next - nearest neighbors of player @xmath22 . if the potential payoff was found to be higher than in the current location , player @xmath22 moved to the site offering the highest payoff and , in case of several sites with the same payoff , to the closest one . on the other hand , if the current location offered the highest payoff among all the empty sites within the migration neighborhood , player @xmath22 did not move . it was found that this fairly simple and very plausible migration rule promotes cooperation in the prisoner s dilemma game on a square lattice ( with a fraction of empty sites to accommodate moving ) irrespective of the noise introduced to the system . in fact , three types of noise were considered to attest to the robustness of cooperation facilitation due to the introduced mobility of players . first was the introduction of mutation with probability @xmath75 , second was the introduction of random movements not considering the expected success ( payoff ) with probability @xmath20 , while third was the combination of the two . additionally , different update rules , adding birth and death processes , as well as introducing a small fraction of individuals defecting unconditionally were considered as well . irrespective of all these factors cooperation was found prevailing in a large region of the parameter space defining the prisoner s dilemma game if only the players were allowed to execute success - driven migration . recently , mobility is getting increasing attention as a means to promote cooperation in social dilemmas @xcite . in the model of @xcite two types of players are introduced , and a random walk of the influential individuals is possible irrespective of their strategies . the mobility of influential cooperators can have two positive impacts on the evolution of cooperation . first , they can spread the cooperative strategy among the non - influential players having a lower teaching activity , and second , when two influential players with opposite strategies meet , the cooperator can prevail and thus ensure an effective information exchange between cooperating hubs . note that the importance of the latter has as already been emphasized in section  [ interactions ] ( see _ e.g. _ fig . [ fig : restricted ] and the pertaining text ) . as expected based on preceding works considering mobility as a coevolutionary process , the final outcome of the competition between mobile , and thus influential , cooperators and defectors is highly sensitive to changes in the speed of moving . when the latter is too high the influential cooperators can not benefit from their cooperative neighborhoods because they abandon them too soon . similarly , influential defectors eschew the negative feedback effect originating from defecting neighbors ( note that @xmath56 links are nonprofitable for both players ) because they leave them too fast as well . indeed , high moving speeds generate conditions mimicking the well - mixed regime which is damning for cooperators . thus , only moderate mobility of influential players has been found effectively supporting the evolution of cooperation . we refer the reader to the original works for further details , noting that mobility seems a promising avenue of research for future explorations of coevolutionary rules .      as the last coevolutionary process we consider aging . indeed , aging is always present , tailoring our interactions with others and postulating a finite lifespan during which we are able to exercise them . it thus seems natural to consider aging as an integral part of every evolutionary development , and certainly evolutionary games constitute a prime example thereof . nonetheless , studies taking aging explicitly into account within this realm of research are few . @xcite recently noted that lifespan might play an important role in the evolution of cooperation , albeit their study focused on the coevolution of choosiness ( see also section  [ related ] ) rather than age . moreover , concepts similar to aging were recently introduced in the voter model @xcite , showing that age and memory - dependent transition rates can have a positive effect on consensus formation . a recent work focusing on aging within evolutionary games is due to @xcite , and in the following we present a summary of the proposed coevolutionary rules for aging as well as their main implications . the newborn is not supported by its ancestor ( the @xmath56 link is detrimental for both ) , and hence a neighboring cooperator with high age can conquer the site of the newborn defector . this procedure occurs repeatedly , ultimately resulting in a practically blocked ( more precisely an oscillating ) front between @xmath45 and @xmath46 regions ( left panel ) . importantly , a similar blocking is not present around old ( and thus influential ) cooperators because their cooperator - cooperator links help newborn cooperators to achieve higher age , in turn supporting the overall maintenance of cooperative behavior ( right panel ) . in both panels the size of players is proportional to their age ( _ i.e. _ their teaching activity ) . dashed ( solid ) arrows denote attempted ( successful ) strategy adoption processes.,width=283 ]    since age is often associated with knowledge and wisdom an individual is able to accumulate over the years , it was introduced through a simple tunable function that maps age to teaching activity ( see section  [ teaching ] ) of the corresponding player . more precisely , @xmath98 in eq . [ teachfermi ] was related to the integer age @xmath117 in accordance with the function @xmath118 , where @xmath119 , denoting the maximal possible age of a player , serves the bounding of @xmath98 to the unit interval , and @xmath120 determines the level of heterogeneity in the @xmath121 mapping . evidently , @xmath122 corresponds to the classical ( homogeneous ) spatial model with @xmath99 characterizing all players , @xmath123 ensures that @xmath98 and @xmath124 have the same distribution , whereas values of @xmath125 impose a power law distribution of strategy transfer capability . although different age distributions of players were considered also as quenched system states , the focus was on the study of aging as a coevolutionary process , entailing death and newborns . two rules were considered separately , both starting with @xmath124 being assigned randomly from a uniform distribution within the interval @xmath126 $ ] to all players , and subsequently increasing all @xmath124 by @xmath58 after each full monte carlo step . also inherent to both was that @xmath124 was set to zero for all players whose age exceeded @xmath127 ( effectively this means that a newborn follows the dead player ) . the difference was in the way age of players that have just adopted a new strategy from one of their neighbors was handled . in the coevolutionary model a their age was left unchanged , while in the coevolutionary model b they were considered as newborns , _ i.e. _ as soon as player @xmath22 adopted a new strategy its age was set to @xmath128 . notably , rules a and b can be interpreted rather differently . from a purely biological viewpoint the more successful player replaces the neighbor with its own offspring , who therefore initially has a limited strategy transfer capability , which corresponds to rule b. on the other hand , especially in social systems , strategy adoptions may not necessarily involve death and newborns , but may indicate solely a change of heart , preference , or way of thinking , whereby this situation corresponds to rule a. nevertheless , newborns in a social context can be considered those that changed their strategy recently , and therefore have a low reputation initially . interestingly , it was found that the small difference between coevolutionary rules a and b may have significant consequences for the evolution of cooperation . foremost , it was found that rule b promotes cooperation remarkably better than rule a. however , the difference could not be explained by the resulting heterogeneity of the distributions of @xmath98 , for example via a similar reasoning as introduced by @xcite , since both rules return power law distributed values with rather similar slopes ( @xmath129 for a and @xmath130 for b ) . in fact , it was shown that the coevolutionary rule b introduces a new powerful mechanism for promotion of cooperation acting solely on a microscopic player - to - player basis , and as such is thus virtually not detectable by statistical methods assessing the heterogeneity of the system . the mechanism was found relying on a highly selective promotion of cooperator - cooperator and defector - defector pairs , which hinders influential defectors ( those having @xmath124 close to @xmath127 ) to spread their strategy effectively across the spatial grid . in particular , rule b always leads to influential players being surrounded by newborns . thereby it is important to note that whenever an old defector , with a high strategy transfer capability @xmath98 , is imitated by one of the neighbors , further spreading of defection is blocked because the newborn defector has no chance to pass strategy @xmath46 further . at that time a neighboring cooperator with high age can strike back and conquer the site of the newborn defector . as a result the whole procedure starts again , which ultimately results in a practically blocked ( more precisely an oscillating ) front between @xmath45 and @xmath46 regions . crucially , a similar blocking mechanism is not present around old ( and thus influential ) cooperators because their cooperator - cooperator links help newborn cooperators to achieve higher age , in turn supporting the overall maintenance of cooperative behavior . the main differences in the propagation of different strategy pair - ups are summarized in fig . [ fig : blocked ] , while an example of the resulting spatial distribution of players is presented in fig . [ fig : aging_dist ] . in the latter a player is considered as influential if its age exceeds that of any of its neighbors by at least @xmath131 ( qualitatively similar snapshots can be obtained by choosing different thresholds as well ) .     square lattice , obtained by considering players who have adopted a new strategy as newborns [ coevolutionary rule b in @xcite ] . full black ( open green ) boxes depict influential defectors ( cooperators ) while yellow and white are all other non - influential defectors and cooperators , respectively . the snapshot demonstrates clearly that the propagation of defectors is blocked in space as a consequence of age - related teaching activity.,width=264 ]    in model a the situation is significantly different since cooperative domains , created around old players with high @xmath98 , can not prevail long . namely , the central cooperator who built up the cooperative domain eventually dies , and the arriving newborn with an accordingly low strategy transfer capability simply can not maintain this domain further , thus giving defectors an opportunity to win it over . as a consequence of the dynamical origin of the observed cooperation - promoting mechanism brought about by rule b , it is expected that it will work in other cases too , for example when the interaction graph is characterized by a different topology , by other evolutionary games , or by separated time scales between aging and strategy adaptations , as was shown already by @xcite .    finally , it is important to note that the observed cooperation - promoting mechanism relying on a dynamical process is robust even if non - monotonous mappings between @xmath124 and @xmath98 are considered ( the oldest individuals may not necessarily be the most influential ) . indeed , the promotion of cooperation remains intact as long as the plausible assumption that very young players should have none or very little influence is adhered to . similarly as mobility reviewed in section  [ mobility ] , we note that aging as a coevolutionary process seems very liable to further studies as well , and we hope this brief summary succeeded in wetting the appetite for them .      aside from thus far reviewed coevolutionary rules , there exist examples @xcite we were unable to classify into the above subsections . without going into much details as it exceeds the scope of this mini review , we briefly describe some of these related approaches , but refer the reader to the original works for further details . @xcite , for example , studied the simultaneous evolution of learning rules and strategies , whereby the former were determined endogenously based on the success of strategies observed in the neighborhood of any given player . it was shown that endogenous learning rules put more weight on the proper understanding of each player s own experience rather than on the experience of an observed neighbor . coevolving learning rules were recently considered also by @xcite , showing that imitation is frequently displaced by replication , in turn leading to a rapid decrease of cooperation in the spatial prisoner s dilemma game . on the other hand , imitation was found to be superior to global but stochastic imitation , thereby facilitating cooperative behavior . the coevolutionary selection of strategy adoption rules was consider by @xcite as well , where the uncertainty in the fermi function ( see eq .  [ fermi ] ) was subject to evolution as a player - specific property . in particular , instead of a single @xmath32 value authors introduced different @xmath132 values where @xmath133 , which were then assigned randomly to the players . as we have already noted in section  [ games ] , the uncertainty by strategy adoptions can originate from different sources , ranging from unpredictable variations in payoffs to errors in the decision making @xcite . the parameter @xmath32 , however , can also be considered as characterizing the willingness of a player to risk a payoff quantity during a strategy change . therefore , by using different values of @xmath32 , not only the better strategy but also the way of strategy adoption can be the subject of an imitation process .     values ( @xmath134 ) demonstrate the selection of the most appropriate strategy adoption uncertainty @xmath135 ( promoting cooperation best ) , as indicated by the red solid line . this directly implies the spontaneous selection of an optimal strategy adoption rule within the scope of the fermi function ( see eq . [ fermi ] ) , as reported by @xcite . dashed blue lines depicted the extinction of the other @xmath132 values . initially , @xmath136 different @xmath132 values were distributed on the square lattice of size @xmath137 . the temptation to defect was @xmath109.,width=283 ]    accordingly , aside from the fact that player @xmath28 could adopt the strategy of player @xmath22 according to eq . [ fermi ] ( @xmath138 ) , an additional independent trail with the same probability was made also for the adoption of the imitation rule ( @xmath139 ) . it was shown that , if the system is seeded by random initial conditions , the proposed coevolutionary rule drives the system towards a state where a single @xmath135 value ( only one of the initial @xmath132 values ) prevails . this final strategy adoption uncertainty is closely related with the parameter value warranting the highest cooperation level if a given value of @xmath32 is used for all players at a certain value of the temptation to defect @xmath77 ( see fig . [ fig : schematic_games ] ) . naturally , the prevailing @xmath135 value thus depends also on the topology of the interaction network . the selection process is illustrated in fig . [ fig : n20_time ] , where @xmath136 different @xmath132 values were initially assigned to the players @xmath140 . summarizing the main observation , it was shown that a darwinian selection rule affecting a model parameter can spontaneously lead to the prevalence of the value that ensures an optimal level of cooperation in the system . for further details we refer the reader to the original work of @xcite . the evolution of altruistic behavior under coevolutionary rules was studied also in what can be considered more explicitly biologically or even humanly motivated settings @xcite . for example , internal norms , being a pattern of behavior enforced in part by internal sanctions , such as shame , guilt and loss of self - esteem , were found to provide support for the evolution of altruistic norms , and moreover , via a gene - culture coevolution argument an explanation was provided as to why individually fitness - reducing internal norms are likely to be prosocial rather than socially harmful @xcite . although mentioned already in section  [ aging ] , the study of @xcite in fact focuses on the coevolution of choosiness , the later relying on cooperativeness being used by other individuals as a choice criterion . in such a setting competition to be more generous than others can emerge , and in this case the evolution of cooperation between unrelated individuals can be driven by a positive feedback between increasing levels of cooperativeness and choosiness . it was shown that , in situations where individuals have the opportunity to engage in repeated pairwise interactions , the evolution of cooperation depends critically on the amount of behavioral variation that is being maintained in the population by processes such as mutation . finally , we note that @xcite investigated the evolution of cooperation in a so - called nongrowth dynamic network model with a death - birth dynamics based on tournament selection , @xcite as well as @xcite studied the coevolution of group structure rather than graph structure in the context of generalized reciprocity , while @xcite considered evolving heterogeneous games as means to sustain cooperation . interestingly , in the later study the players had individual payoff elements assigned to them for calculating their final payoffs . accordingly , within the realm of the proposed coevolutionary rule a player could adopt not only the strategy of the neighbor but also its individual payoff matrix elements . it was found that if starting with a random heterogeneous distribution of payoffs , eventually only a small number of definite payoff matrices remained while the others went ` extinct ' . on the other hand , if the initial rank of individual payoff elements agreed with those constituting social dilemma games , the prevailing one was found to be the stag - hunt game . considering the latter result in the light of findings reported within the evolving adoption rules model by @xcite , it is possible to raise the question if coevolutionary rules as a selection mechanism can spontaneously drive the system into a state where mutual cooperation ensures the maximal average payoff . indeed , further studies are necessary to clarify this issue . in sum , there are few boundaries to imagination when considering what coevolutionary rules might affect , and certainly , it seems like all facets of existence can be brought into consideration . as we hope the above mini review on coevolutionary games clearly shows , coevolution is certainly a promising concept to follow , as it constitutes the most natural upgrade of evolutionary games in the sense that not only do the strategies evolve in time , but so does the environment , and indeed many other factors that in turn affect back the outcome of the evolution of strategies . some of these coevolutionary processes are of a finite duration , and thus on their own do not necessarily affect the outcome of evolutionary games but do this only indirectly due to the environment that they produce , while others are lasting , introducing dynamical alterations that affect the evolution of cooperation on a continuous basis . in the future , it should be of interest to further elaborate on the question whether coevolution itself may promote cooperation by introducing dynamical mechanisms , or if mainly the final outcome of a coevolutionary process , if it exists , is the one vital for the sustenance of cooperation . often , however , it is the interplay of both that facilitates the promotion of cooperation , as it was already shown in some of the works . it should also be considered which coevolutionary processes end sooner or later , and which are those that at least in principle should last forever . for example , the growth of a city can be considered something that has a finite duration due to environmental constrains , while aging , on the other hand , is a natural ingredient of every living organism , and as such it should only make sense to consider it evolving permanently . although social dilemmas may emerge at different levels of human and animal interactions , their occurrence is by no means limited to these examples . the applicability of the concept of evolutionary games extends across the whole of social and natural sciences , with examples ranging from the rna virus @xcite , atp - producing pathways @xcite and biochemical systems @xcite , to traffic congestion @xcite and climate change @xcite , to name but a few . in this sense coevolutionary rules should be applied to evolutionary games in the broadest possible sense , with specially adapted motivation fitting to the research avenue of the main evolutionary process . moreover , while focusing predominantly on resolving social dilemmas , coevolutionary rules have thus far not been considered for many other game types , as for example the public goods game , the ultimatum game or the rock - scissors - paper game . these gaps should be interesting to fill as well , in particular when striving towards universal concepts underlying cooperation in the broadest possible sense . the authors acknowledge support from the slovenian research agency ( grant z1 - 2032 ) , the hungarian national research fund ( grant k-73449 ) , the bolyai research grant , and the slovene - hungarian bilateral incentive ( grant bi - hu/09 - 10 - 001 ) . chen , y. , qin , s .- , yu , l. , zhang , s. , 2008 . emergence of synchronization induced by the interplay between two prisoner s dilemma games with volunteering in small - world networks . e 77 , 032103 . helbing , d. , schnhof , m. , stark , h .- u . , holyst , j.  a. , 2005 . how individuals learn to take turns : emergence of alternating cooperation in a congestion game and the prisoner s dilemma . adv . complex syst . 8 , 87116 . holme , p. , trusina , a. , kim , b.  j. , minnhagen , p. , 2003 . prisoner s dilemma in real - world acquaintance networks : spikes and quasiequilibria induced by the interplay between structure and dynamics . e 68 , 030901 . kim , b.  j. , trusina , a. , holme , p. , minnhagen , p. , chung , j.  s. , choi , m.  y. , 2002 . dynamic instabilities induced by asymmetric influence : prisoner s dilemma game in small - world networks . e 66 , 021907 . milinski , m. , sommerfeld , r.  d. , krambeck , h .- j . , reed , f.  a. , marotzke , j. , 2008 . the collective - risk social dilemma and the prevention of simulated danderous climate change . natl . acad . usa 105 , 22912294 . pacheco , j.  m. , santos , f.  c. , 2005 . network dependence of the dilemmas of cooperation . in : mendes , j. f.  f. ( ed . ) , science of complex networks : from biology to the intertnet and www , aip conf . aip , melville , ny , pp . 90100 . zimmermann , m.  g. , eguluz , v.  m. , miguel , m.  s. , 2001 . cooperation , adaption and the emergence of leadership . in : zimmermann , j.  b. , kirman , a. ( eds . ) , economics and heterogeneous interacting agents . springer , berlin , pp . 7386 .
Abstract:

Answer: prevalence of cooperation within groups of selfish individuals is puzzling in that it contradicts with the basic premise of natural selection . favoring players with higher fitness , the latter is key for understanding the challenges faced by cooperators when competing with defectors . evolutionary game theory provides a competent theoretical framework for addressing the subtleties of cooperation in such situations , which are known as social dilemmas . recent advances point towards the fact that the evolution of strategies alone may be insufficient to fully exploit the benefits offered by cooperative behavior . indeed , while spatial structure and heterogeneity , for example , have been recognized as potent promoters of cooperation , coevolutionary rules can extend the potentials of such entities further , and even more importantly , lead to the understanding of their emergence . the introduction of coevolutionary rules to evolutionary games implies , that besides the evolution of strategies , another property may simultaneously be subject to evolution as well . coevolutionary rules may affect the interaction network , the reproduction capability of players , their reputation , mobility or age . here we review recent works on evolutionary games incorporating coevolutionary rules , as well as give a didactic description of potential pitfalls and misconceptions associated with the subject . in addition , we briefly outline directions for future research that we feel are promising , thereby particularly focusing on dynamical effects of coevolutionary rules on the evolution of cooperation , which are still widely open to research and thus hold promise of exciting new discoveries .    evolutionary games , coevolution , social dilemmas , cooperation 02.50.le , 87.23.ge , 87.23.kg , 89.75.fb