Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: a basic fact of life is competition . in evolution , only the fittest survive ; in the workplace , we compete for professional advancement ; in social events , we compete for attention ; in sports , its very purpose is to excel in competition . idealized models of social competition have recently been proposed in which the status of each individual is determined by competitive success @xcite . in this spirit , we introduce a simple `` rate - race '' model that embodies the struggle for advancement in a competitive environment . because everyone is engaged in the same perpetual rat race , one s relative standing may change slowly or not at all , even though the population as a whole may be advancing . when the competition favors the strong , the leader runs away from the rest of the population . as the competition becomes more equitable , in any typical realization of the system , everyone reaches the same fitness and the population become static . when the leader is easily overtaken , the mean fitness undergoes periods of near stasis and explosive advancement that qualitatively mirrors the phenomenon of punctuated evolution @xcite . empirical motivations for our model come from evolution and from sports . in evolution , large - scale species extinctions occur during sudden spurts , with much slower development during the intervening periods @xcite . these periods of near stasis characterize many sports , where it is not possible to maintain a long - term competitive advantage . if one finds such a winning strategy , competitors will eventually find a counter - strategy so that any advantage is lost . conversely , a consistent loser will be replaced by a more competent individual so that losing strategies also do not persist . a famous example of the latter idea comes from baseball , where the mythic achievement of a .400 hitter , an exceptional player who gets a hit in more than 40% of his turns at bat , occurred multiple times during the early years of the sport25 times from 1871 to 1941 ( last accomplished by the .406 batting average of ted williams of the boston red sox in 1941)but none since then . an appealing explanation for this phenomenon , proposed by s. j. gould @xcite , is that the increasing competitiveness as the sport has developed makes outliers less likely to occur . to illustrate this point , gould found that the dispersion in the batting averages of all regular players decreased systematically from 1875 until 1980 , even though year - to - year fluctuations in their mean batting average are larger than the systematic decrease in the dispersion . thus outliers become rarer and exceptional achievements , such as a season batting average over .400 , or a consecutive - game hitting streak longer than 56 achieved by joe dimaggio also in 1941 , should not recur .    in the next section , we define the rat race model and then we analytically determine its dynamical features for a two - agent system in sec . [ 2c ] . in sec . [ det ] , we investigate many agents in the framework of an almost deterministic version of the rat race . simulation results for the evolutionary behavior of the model are given in sec . [ sim ] , and we conclude in sec .  [ sum ] . in our rat race model , each individual @xmath0 possesses a real - valued fitness @xmath1 , with larger @xmath1 representing higher fitness ( fig . [ model ] ) . an individual attempts to improve with respect to the competition by advancing to larger @xmath2 . advancement events occur one at a time and each individual has the same rate of advancing ; _ i.e. _ , we consider _ serial _ dynamics in which a randomly - selected competitor advances . the leader , located at @xmath3 , advances by an amount that is drawn from a uniform distribution of width @xmath4 . that is , the leader is aware only of the next strongest individual and attempts to maintain its lead by advancing by an amount that is of the order of the separation to this nearest neighbor . on the other hand , all other individuals seek to overtake the leader . the @xmath5 agent , with fitness @xmath1 , moves a distance that is uniformly distributed in the range @xmath6 . here @xmath7 is the fundamental parameter  the `` catch - up '' factor  that quantifies the severity of the competition . when @xmath8 , the leader maintains the lead forever , while for @xmath9 the leader can be overtaken .    . the leader can advance by an amount that is uniformly distributed in the range @xmath4 . the @xmath10 particle can advance by an amount that is uniformly distributed in @xmath11.,scaledwidth=35.0% ]    in the context of competition , it would be more realistic to eliminate laggards and replace them by typical individuals . however , our model mimics precisely this situation , as a laggard typically moves toward the average fitness . a lazy population is characterized by a small value of @xmath7 for which the leader maintains the lead on the rest of the pack . for a sufficiently large value of @xmath7 , however , the lead changes often and by large amounts so that the width of the fitness distribution increases after each advancement event . between these two extremes there is an intermediate regime of stasis where the spread of the pack shrinks to zero and the population stops advancing . we begin by studying the case of two agents with fitnesses @xmath3 and @xmath12 and gap @xmath13 . the fitness of the leader increases by an amount that is uniformly distributed in @xmath14 $ ] to try to maintain its lead . similarly , the laggard advances by a distance that is uniformly distributed in the range @xmath15 $ ] . for @xmath8 the agents always maintain their order , while for @xmath9 lead changes can occur . we now determine the evolution of the gap length for any @xmath7 . the gap length undergoes a random multiplicative process because each advancement step leads to a multiplicative change . thus we expect that the distribution of gap lengths for an ensemble of two - agent systems will have a log - normal form . additionally , over a suitable range for the catch - up factor @xmath7 we also expect large fluctuations between different realizations of the process , as is well - known to occur in random multiplicative processes @xcite . are lost by the first two process , while the latter three lead to a gain of gaps of length @xmath16 . the last process is a lead - changing event.,scaledwidth=30.0% ]      the gap evolution is completely described by @xmath17 , the probability for a gap of length @xmath16 at time @xmath18 . for the case @xmath8 ( no lead changes ) , the evolution of @xmath19 is described the master equation @xmath20 where the overdot denotes time derivative . the first term on the right accounts for the loss of gaps of length @xmath16 because of the hopping of either particle ( ( a ) , ( b ) in fig .  [ gap ] ) . the second term accounts for the creation of a gap of length @xmath16 due to the leader advancing from a previous gap of length @xmath21 ( fig .  [ gap](c ) ) . the length @xmath22 of this previous gap must be in the range @xmath23 $ ] so that a gap of length @xmath16 can be created and the factor @xmath24 accounts for the hopping distance being uniformly distributed in @xmath25 $ ] . the last term accounts for the laggard advancing to create a gap of length @xmath16 ( fig . [ gap](d ) ) . here , the previous gap length @xmath22 must be in the range @xmath26 $ ] and the hopping probability then equals @xmath27 .    similarly , the master equation for @xmath28 for @xmath9 is : @xmath29 the third term on the right accounts for events in which the laggard remains the laggard ( fig . [ gap](d ) ) , while the last term accounts for overtaking events ( fig . [ gap](e ) ) .    for both @xmath8 and @xmath9 , it is straightforward to check that these equations conserve the total probability , @xmath30 . for this purpose , we need to compute @xmath31\ ,   dg\ ] ] where @xmath32 $ ] denotes the right - hand side of eq .   or eq .  . to perform this type of integral , we merely interchange the order of the @xmath16 and @xmath22 integrations . we illustrate this calculation for the second term on the right - hand side of eq .  . the interchange of integration order in this term gives @xmath33 the integration over @xmath16 merely gives @xmath22 and then the @xmath22 integral becomes simply @xmath34 . the same manipulation works for all the other terms in the master equation and we thus verify that @xmath35 is conserved . the equation of motion for the moments of the gap - length distribution is @xmath36\ , dg   \,,\ ] ] where @xmath32 $ ] again denotes the right - hand side of eq .   or eq .  . employing the same interchange of integration order as illustrated above , the integrals can be evaluated straightforwardly to yield the following closed equations for the moments : @xmath37    for @xmath8 , the first few moments obey : @xmath38 _ etc_. all positive integer moments increase in time for @xmath8 because the leader hops further than the laggard , on average , in every single event . conversely , for @xmath9 the corresponding moment equations are : @xmath39\nonumber \\ \dot { \mathcal{m}_2 } & = &    \mathcal{m}_2\left[\frac{(m-1)^3+m+1}{6m}\right]\end{aligned}\ ] ] _ etc_. curiously , different moments can have opposite time dependences . for @xmath8 the laggard trails further and further behind after each step and the average separation grows , while for @xmath40 , overtaking events are so drastic in character that the average separation between the two agents also grows . conversely , for @xmath41 , the first moment decreases in time . in spite of the differing behaviors for the first moment as a function of @xmath7 , higher moments grow for any @xmath9 ( eq .  ) .    why does this dichotomy between moments of different order arise ? the source is the multiplicative process that underlies the gap dynamics . this multiplicativity leads to the very broad _ log - normal _ distribution of gap sizes ( to be derived in the next section ) , for which the time dependence of moments of different order can be quite different @xcite . in a random multiplicative process , extreme realizations with an exponentially small probability , make an exponentially large contribution to the moment of a given order . for @xmath8 or @xmath40 , the interplay between these two extremes leads to a first moment that grows with time when summing over all realizations . in simulations , however , we study only a small fraction of all realizations and thus can observe only the very different _ most probable _ behavior . the most probable gap @xmath42 ( the geometric average of @xmath16 ) may be obtained by computing @xmath43 , using the same approach that leads from eq . we thereby find that @xmath44 with @xmath45 setting @xmath46 gives the transition at which the most probable gap length does not change . again there are two transitions ; from the first line of , the condition @xmath46 gives a transcendental equation for @xmath7 with solution @xmath47 . similarly , from the second line of , the condition @xmath46 gives the threshold @xmath48 . the most probable gap length @xmath49 thus increases with time for @xmath50 and @xmath51 , while @xmath49 shrinks to zero in a finite time for @xmath52 . comparing eqs . & , there exists a range of @xmath7 for which the average gap grows while the most probable gap shrinks . again , the interplay between exponentially unlikely events that have exponentially large contributions to an observable gives seemingly contradictory results that are natural outcomes of a random multiplicative process @xcite . we now compute the asymptotic tails of the gap length distribution itself . our approach to determine this distribution is to write the moments of the gap length distribution in eqs .   as a fourier transform and then invert this transform . thus we write @xmath53}\,.\end{aligned}\ ] ] now define @xmath54 and make an analytic continuation from @xmath55 to @xmath56 to give @xmath57}\,.\end{aligned}\ ] ] the left - hand side is just the fourier transform of @xmath58 . inverting this fourier transform , we obtain @xmath59}\,.\end{aligned}\ ] ] to derive the asymptotic distribution for large @xmath60 , we need the small-@xmath55 behavior of @xmath61 . using , we expand @xmath62 for small @xmath55 and then invert the fourier transform to obtain a gaussian distribution for @xmath60 , _ i.e. _ , a log - normal distribution for @xmath16 . the final result is @xmath63 where @xmath64 is given by eq .   and @xmath65 & m < 1 \\ \\ c - \frac{m-1}{2m}\left[2\ln(m-1 ) - \ln^2(m-1)\right ] &   m > 1 , \end{cases}\end{aligned}\ ] ] with @xmath66 . we again emphasize that while the distribution of @xmath67 extends over range that grows as @xmath68 , the distribution of @xmath16 itself is extremely broad so that it can not be characterized by any individual moment . it is not clear how to adapt the theory given above in an analytically - tractable way to treat more than 2 particles . we therefore introduce an nearly - deterministic version of the model that mimics the advancement steps in the stochastic rat race model by defining the length of each jump to be exactly one half of the total possible range . we again consider serial dynamics in which one of the competitors , chosen at random , advances . the order in which competitors are selected is the only source of stochasticity in this version of the model . there are two possibilities for particle movement , depending on the value of the catch - up factor @xmath7 :    * for @xmath69 , if the leader moves , the gap @xmath70 , while if the laggard moves , the gap @xmath71 , where @xmath72 . * for @xmath40 the laggard overtakes the leader . if the leader moves , again @xmath70 , while if the laggard moves @xmath71 , where @xmath73 . since either particle is selected with probability 1/2 at each step , after @xmath18 steps the gap could assume any of the values @xmath74 , @xmath75 ( assuming an initial gap length @xmath76 ) . after @xmath18 steps , the probability of a gap of length @xmath74 is @xmath77    . for @xmath69 , the order never changes , while for @xmath40 , the move of the laggard always leads to passing.,scaledwidth=45.0% ]    it follows that the @xmath10 moment of the gap length is @xmath78^t\,.\ ] ] thus , the large - time behavior of the @xmath10 moment depends on the factor @xmath79/2 $ ] . if this factor is greater than @xmath80 , _ i.e. _ , @xmath81 exceeds @xmath82 $ ] , the @xmath83 moment diverges as @xmath84 . on the other hand , for @xmath85 , the @xmath10 moment vanishes as @xmath84 . for @xmath86 , _ all _ positive moments of the gap size , as well as the most probable gap size , diverge . the value @xmath87 thus marks the transition from convergent to explosive behavior in the gap size . notice that this transition value for @xmath81 corresponds to the threshold values @xmath88 and @xmath89 , which agree well with the corresponding thresholds from the stochastic rat race . we study an @xmath90-particle system , with @xmath91 , with particles located at @xmath1 , with @xmath92 . the gap between particle @xmath93 and the leader is defined as @xmath94 . we limit ourselves to the case of catch - up factor @xmath40 , so that any non - leader that jumps always overtakes the leader . this fact allows us to keep track of the ordering of the particles and an exact analysis is then possible . for generality , we assume the leader jumps a distance @xmath95 ahead ; @xmath96 corresponds to the case analyzed previously , while for @xmath97 the leader is completely lazy and never jumps . if particle @xmath93 is selected , this results in a re - distribution of the vector @xmath98 of the gap lengths : @xmath99 where @xmath100 @xmath101 the vector , after @xmath18 steps , is the result of the product of @xmath18 matrices , drawn at random from among the @xmath102 . unfortunately , none of the matrices commute , so we can not deduce the probability distribution of gap sizes as in the scalar case of two particles ( @xmath103 ) . on the other hand , according to the oseledec theorem @xcite ( also known as the multiplicative ergodic theorem ) , the growth of  is determined by the product @xmath104 , where @xmath105 is the largest eigenvalue of the matrix @xmath102 ( @xmath106 ) . more precisely , the product @xmath107 determines the largest lyapunov exponent of the growth of  with @xmath108 . thus explosive growth results if the product @xmath109 , and stasis results otherwise . we now derive the critical value for @xmath81 at the transition point , where @xmath110 . the largest eigenvalue of @xmath111 is clearly @xmath112 . to determine the largest eigenvalue of @xmath102 for @xmath113 , we write the characteristic equation det@xmath114 , obtained by expanding the determinant about the column of @xmath81 s : @xmath115(1-\lambda)^{n - n}=0\,.\ ] ] from the second factor on the left - hand side we conclude that @xmath102 has @xmath116 eigenvalues @xmath117 . we argue , self - consistently , that for @xmath118 these are also the largest eigenvalues , that is , @xmath119 . indeed , if that is the case , then the criticality condition dictates @xmath120 . substituting this value into the characteristic equation for @xmath121 we find @xmath122 it follows that @xmath123 ( with the equality being realized in the limit @xmath124 ) . we can now show that our initial assumption that the remaining eigenvalues of @xmath102 ( @xmath118 ) are not larger than 1 is indeed valid . from the factor in the square brackets of the characteristic equation , we see that these eigenvalues satisfy @xmath125 the expression on the right - hand side is a monotonically increasing function of @xmath126 , hence if @xmath127 then @xmath128 , in contradiction with  ( [ bc_a>0 ] ) .    for @xmath97 , namely , the case of a lazy leader that never advances as long as it leads , the critical value of the catch - up parameter @xmath81 is no longer exponential in @xmath108 , but rather @xmath129 as can be seen by taking the limit of @xmath124 in eq . ( [ bc_a>0 ] ) . for any number of agents , the time dependence of the fitness of each agent exhibits rich behavior . for 2 agents , simulations clearly show a transition between a regime where the leader runs away from the laggard and stasis as @xmath7 passes through a critical value close to @xmath47 . this stasis continues until a second transition at @xmath130 . for @xmath131 , there is explosive growth , with many lead changes between the two agents . it bears emphasizing that the observed transitions occur close to the values associated with the most probable gap size , even though the true transitions occur at @xmath132 and @xmath133 , corresponding to the average gap size . since simulations reflect the most probable behavior , they can provide qualitative information about the nature of stasis and explosive growth , as well as the transition between these two regimes , but little else . [ n6a ] and  [ n6b ] show typical results for 6 agents . again , the existence of two transitions is clearly visible . for @xmath134 , the initial leader always maintains its lead , but the laggards are able to remain relatively close behind by virtue of the multiplicative nature of the jumps . strikingly , large jumps occur with some frequency so that the population still advances rapidly . however , for slightly larger @xmath7 , the distance between the strongest and weakest eventually disappears and the evolution quickly grinds to a halt ( fig . [ n6a ] bottom ) . here lead changes are rare and no longer occur after a short time . this nearly static behavior continues until @xmath135 ( fig . [ n6b ] top ) .     on a linear - log scale ( top ) , and @xmath136 on a log - linear scale ( bottom ) . , title="fig:",scaledwidth=36.0% ]   on a linear - log scale ( top ) , and @xmath136 on a log - linear scale ( bottom ) . , title="fig:",scaledwidth=33.0% ]    for a slightly larger @xmath7 , this system exhibits periods of near stasis followed by periods of explosive growth ( fig . [ n6b ] bottom ) . here lead changes occur at roughly a constant rate and the total number of lead changes grows linearly with time . during periods of rapid advancement , the gap between the strongest and weakest agent is nearly comparable to the fitness ( position ) of any agent . conversely , during periods of near stasis , the gap between the strongest and weakest agent is orders of magnitude smaller than the typical fitness .     on a log - linear scale ( top ) and @xmath137 on a linear - log scale ( bottom ) . shown dotted is the distance between the strongest and weakest agent . , title="fig:",scaledwidth=36.0% ]   on a log - linear scale ( top ) and @xmath137 on a linear - log scale ( bottom ) . shown dotted is the distance between the strongest and weakest agent . , title="fig:",scaledwidth=37.5% ]    qualitatively similar behavior occurs for more particles , except that the critical values of @xmath7 that separates leader runaway from stasis and stasis from explosive growth seem to approach 0 and 1 , respectively , as the number of particles increases . we introduced an idealized social competition model where individuals try to better their fitness ( a real - valued variable ) by advancing relative to the rest of the population : the leader advances to remain ahead of its closest pursuer , while others in the pack advance by a random amount , in proportion to their distance from the leader . when this proportionality constant is too small or too large , the fitness of all the agents grows explosively during short sporadic bursts . these explosive regimes are the analog of the rapid growth of new species after massive die - offs in punctuated evolution . between these two extremes there is a window of stasis , where the spread of the pack shrinks indefinitely and evolution comes to a stop . here outliers becomes progressively less likely and extreme achievements disappear ; this situation parallels the disappearance of the .400 hitter in baseball mentioned in the introduction . basic features of the model already arise in the simple limits of just two agents , and in a deterministic model where agents advance by a fixed multiple of their gap to the leader . these simplified models allow for an exact analysis , yielding specific expressions for the distribution of gaps in the two - agent model , and for the @xmath108-dependence of the threshold parameters that demarcate between the regimes of stasis and explosive growth in the deterministic model . our simulation results suggest that similar behavior occurs for a general many - agent system . a full analytical solution of the general many - agent problem seems intractable , however , even in the simplified deterministic version . thus some basic questions remain unanswered , such as , for example , what is the distribution of agents in the pack in the various regimes of explosive growth , stasis , and at the critical transition points . * acknowledgments . * we thank the isaac newton institute for mathematical sciences ( cambridge , england ) , where this research was started , for its hospitality . two of us gratefully acknowledge financial support from nsf grant phy0555312 ( dba ) and dmr0535503 ( sr ) .                      for details on analytical continuation to convert an inverse laplace transform to an inverse fourier transform , see _ e.g. _ , j. mathews and r. l. walker , _ mathematical methods of physics _ , @xmath138 ed . ( addison wesley , reading , ma , 1971 ) . v. i. oseledec , trudy . mosk .  mat . [ moscow math . soc . ] * 19 * , 197 ( 1968 ) , ( in russian ) ; d. ruelle , ihes publ . math .  * 50 * , 27 ( 1979 ) ; m. pollicott , _ lectures on ergodic theory and pesin theory on compact manifolds _ , ( cambridge university press , 1993 ) .
Abstract:

Answer: we introduce a toy model of the `` rat race '' in which individuals try to better themselves relative to the rest of the population . an individual is characterized by a real - valued fitness and each advances at a constant rate by an amount that depends on its standing in the population . the leader advances to remain ahead of its nearest neighbor , while all others advance by an amount that is set by the distance to the leader . a rich dynamics occurs as a function of the mean jump size of the trailing particles . for small jumps , the leader maintains its position , while for large jumps , there are long periods of stasis that are punctuated by episodes of explosive advancement and many lead changes . intermediate to these two regimes , in a typical realization of the system , agents reach a common fitness and evolution grinds to a halt .


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: half - metallic ferromagnets have attracted considerable attention during the last decade due to their potential applications in magnetoelectronic devices @xcite . the term `` half - metal '' was initially introduced by de groot and collaborators in 1983 to denote the peculiar behavior exhibited by a heusler compounds : nimnsb @xcite . the have found using first - principles calculations that the majority - spin band was metallic while the minority - spin band was semiconducting leading to 100%spin - polarization of the electrons at the fermi level . this behavior was later on confirmed both by infrared absorption @xcite and by spin - polarized positron annihilation @xcite experiments . although heusler alloys have attracted a lot of interest as potential half - metallic systems , the discovery of akinaga and his collaborators in 2000 has shown the possibility to grow new half - metallic systems in metastable structures usually adopted by thin films @xcite . they have shown that the cras / gaas multilayers are ferromagnets and surprisingly the x - ray diffraction measurements suggest that cras adopts the lattice structure of gaas and grows in the metastable zincblende structure . moreover squid measurements have shown that cras exhibits an integer total spin magnetic moment of 3 @xmath2 per unit cell @xcite . these findings have intensified the interest on transition - metal pnictides and chalcogenides like cras and crse which crystallize either in the zinc - blende or wurtzite structures of binary semiconductors and an extended review can be found in reference @xcite . galanakis and mavropoulos have studied using first - principles calculations several such compounds and have determined the lattice constants for which half - metallicity is present @xcite . moreover they have explained the gap in terms of the @xmath5 repulsion ; the @xmath6 orbitals of the @xmath7 atom hybridize with the @xmath8 orbitals of the transition metal atoms creating three bonding and three antibonding states . the gap is created between these states . the @xmath9 orbitals of the transition metal atom are very localized in energy since they do not hybridize with other orbitals and they are placed above the fermi level in the spin - down band . their relative position with respect to the antibonding @xmath6-@xmath8 orbitals depends on each system . it has been also shown in the same reference that except the three bonding @xmath6-@xmath8 bands below the fermi level exists also a deep @xmath10 band . thus , since there are exactly four spin - down occupied bands , the total spin moment , @xmath11 , follows a slater - pauling behavior and it equals in @xmath2 units : @xmath12 where @xmath13 the total number of valence electrons in the unit cell .    as we mentioned above most of the studies concern cases where the @xmath7 atom belongs to the vth ( pncitides ) or the vith ( chalcogenides ) column of the periodical table . the case where the @xmath7 atom comes from the ivth column of the periodical table has attracted much less attention in literature and to the best of our knowledge only the cases of mnc @xcite , mnsn @xcite and mnsi @xcite in the zincblende lattice have been studied . in this manuscript we study using the full  potential nonorthogonal local  orbital minimum  basis band structure scheme ( fplo ) @xcite within the local density approximation ( lda ) @xcite the case of [ sc@xmath0v@xmath1c and [ sc@xmath0v@xmath1si alloys for @xmath14 taking the values 0 , 0.1 , 0.2 , ... , 0.9 , 1 . the disorder is simulated using the coherent potential approximation @xcite . scc and scsi compounds have 7 electrons per unit cell and , if they are half metals , they should show a total spin moment of -1 @xmath2 . on the other hand vc and vsi have 9 electrons and , if they are half - metals , should exhibit a total spin moment of + 1 @xmath2 . thus within these families of alloys we can study the transition at the @xmath15 concentration where the total spin moment changes sign . in section [ sec2 ] we study the perfect compounds to determine the equilibrium lattice constants and we show that all four scc , scsi , vc and vsi crystallize in the non - magnetic rocksalt structure . in section [ sec3 ] we continue our study with the case of the magnetic zincblende and wurtzite structures which are degenerated with respect to their total energy and we study both the electronic and magnetic properties . we show that for the intermediate concentrations the total spin moment scales linearly with the concentration and the sc and v atoms have antiparallel spin magnetic moments . we also try to explain why for @xmath15 the c - based alloy is a semiconductor while the si - based alloys is a half - metallic antiferromagnet @xcite . the latter property is highly desirable for applications since such materials create vanishing stray fields and thus minimize energy losses in devices . finally in section [ sec4 ] we summarize and present our conclusions . and the @xmath16 ratio is for all calculations the ideal @xmath17 for which the nearest environment in the wz structure is the same with its cubic zb analogue . in the rs and zb there is one transition - metal atom and one sp atom per unit cell . in the wz structure there are two atoms of each chemical kind but we have divided the energy by two to compare it directly to the other two cases . ]    we will start the presentation of our results discussing the equilibrium lattices and lattice constants . we have taken into account three different lattices : ( i ) the rocksalt ( rs ) , ( ii ) the zincblende , and ( iii ) the wurtzite ( wz ) structures , and we present in figure [ fig1 ] the calculated total energy as a function of the volume of the unit cell . before proceeding with the discussion and presentation of our results we should focus on the characteristics of the three structures under study . we have chosen the rs structure since it is adopted by the majority of the binary compounds between transition - metal and @xmath7 atoms when the stoichiometry is 1:1 . the lattice is actually a fcc with two atoms as basis set , one atom at ( 0 0 0 ) and the second atom at ( @xmath18 @xmath18 @xmath18 ) in wyckoff coordinates . thus the rs is a close packed structure . contrary to rs both zb and wz structures are open structures . in the zb structure the lattice is again a fcc with four sites as basis set along the diagonal , but now two out of the four sites are empty . the wz is the hexagonal analogue of the zb structure . in our wz calculations we have varied only the in - plane lattice parameter @xmath19 and we have considered that the @xmath16 ratio is for all calculations the ideal @xmath17 for which the nearest environment in the wz structure is the same with its cubic zb analogue . finally we should mention that in the rs and zb there is one transition - metal atom and one sp atom per unit cell while in the wz structure there are two atoms of each chemical kind . we have divided in the wz case by two all the properties , which are calculated per unit cell ( total density of states , total spin magnetic moment and total energy ) , in order to compare them directly to the other two cases . for all four perfect compounds presented in figure [ fig1 ] the rs structure is the equilibrium lattice and the energy difference between the equilibrium rs lattice constant and the zb - wz equilibrium lattice constants is between 4 and 8 ev which are very large energy differences . thus in the form of single crystals all scc , scsi , vc and vsi prefer to crystallize in the rs lattice . as expected the equilibrium volume is much smaller in the rs case compared to the other two since in the former one no voids exist . surprisingly our results suggest that the zb and wz structure are degenerated in all cases and thus , when grown as thin films on top of semiconductors , the unit cell can easily deform itself . in the same figure we have also denoted the equilibrium lattice constants for all three structures ( for the wz one we give the in - plane lattice parameter ) . we remark that the trends depend on the chemical elements . when we substitute si for c , the equilibrium lattice parameters increases . c and si have both four valence electrons but c has six electrons in total ( the atomic configuration is @xmath20 @xmath21 @xmath22 ) while si has 14 electrons ( the atomic configuration is @xmath20 @xmath21 @xmath23 @xmath24 @xmath25 ) and thus occupies more space . sc and v belong in the same series in the periodic table . sc has three valence electrons ( the valence electrons in the atomic configuration are the @xmath26 and @xmath27 ) and v has two more @xmath28 electrons and thus in total five valence electrons . although v has more valence electrons than sc , it is well known that for the early transition metal atoms as the valence increases the lattice parameter decreases @xcite and this is also the cases here . vc and vsi correspond to smaller equilibrium lattice parameters than scc and scsi , respectively . finally we should discuss the electronic properties in the case of the rs structure before proceeding in the next section with the zb and wz structures . in the rs lattice all four perfect compounds are non - magnetic as can be seen from the density of states ( dos ) presented in figure [ fig2 ] . in the case of the scc and scsi alloys the fermi level crosses the valence band , which is created by the bonding states due to the hybridization between the sc @xmath28- and the c(si ) @xmath6-orbitals , and the atom - resolved dos has a similar shape for both the sc and c(si ) atoms . when we substitute v for sc we populate also partially the conduction band created by the antibonding @xmath5 states . as can be seen in the figure , the conduction band has its main weight mainly at the vanadium atom since the latter one offers a lot of empty @xmath28-states with respect to the empty @xmath6 states of the @xmath7 atoms . finally we should note that for all four alloys there is one @xmath10 band lying very deep in energy and which is separated by more than 3 ev from the bottom of the valence band and thus we do not present it in figure [ fig2 ] . l|cccc|cccc    & + & & + @xmath14 & @xmath29 & @xmath30 & @xmath31 & @xmath32 & @xmath29 & @xmath30 & @xmath31 & @xmath32     + 0 & -0.179 & - & -0.821 & -1.000 & -0.186 & - & -0.814 & -1.000 + 0.1 & -0.177 & 0.994 & -0.740 & -0.799 & -0.201 & 1.122 & -0.731 & -0.800 + 0.2 & -0.170 & 0.783 & -0.620 & -0.599 & -0.202 & 0.968 & -0.632 & -0.600 + 0.3 & -0.144 & 0.533 & -0.458 & -0.399 & -0.183 & 0.764 & -0.501 & -0.400 + 0.4 & @xmath33 - 0 & @xmath330 & @xmath33 - 0 & @xmath33 - 0 & -0.126 & 0.466 & 0.310 & -0.200 + 0.5 & @xmath33 - 0 & @xmath330 & @xmath33 - 0 & 0 & @xmath33 - 0 & @xmath330 & @xmath33 - 0 & 0 + 0.6 & -0.064 & 0.646 & -0.162 & 0.200 & -0.090 & 0.755 & -0.217 & 0.200 + 0.7 & -0.086 & 0.899 & -0.204 & 0.400 & -0.108 & 0.986 & -0.258 & 0.400 + 0.8 & -0.098 & 1.047 & -0.218 & 0.600 & -0.117 & 1.122 & -0.274 & 0.600 + 0.9 & -0.107 & 1.144 & -0.219 & 0.800 & -0.122 & 1.215 & -0.282 & 0.800 + 1 & - & 1.192 & -0.192 & 1.000 & - & 1.194 & -0.194 & 1.000     +   + & + & & + @xmath14 & @xmath29 & @xmath30 & @xmath34 & @xmath32 & @xmath29 & @xmath30 & @xmath34 & @xmath32 +    0 & -0.349 & - & -0.651 & -1.000 & -0.367 & - & -0.633 & -1.000 + 0.1 & -0.383 & 2.030 & -0.658 & -0.799 & -0.403 & 1.868 & -0.624 & -0.800 + 0.2 & -0.423 & 1.914 & -0.644 & -0.599 & -0.436 & 1.778 & -0.607 & -0.599 + 0.3 & -0.451 & 1.764 & -0.613 & -0.399 & -0.457 & 1.656 & -0.577 & -0.399 + 0.4 & -0.448 & 1.558 & -0.554 & -0.199 & -0.456 & 1.504 & -0.527 & -0.199 + 0.5 & -0.405 & 1.325 & -0.460 & -0.001 & -0.429 & 1.352 & -0.461 & 0.001 + 0.6 & -0.413 & 1.324 & -0.429 & 0.200 & -0.417 & 1.308 & -0.418 & 0.200 + 0.7 & -0.426 & 1.333 & -0.405 & 0.400 & -0.414 & 1.302 & -0.387 & 0.400 + 0.8 & -0.439 & 1.337 & -0.381 & 0.600 & -0.413 & 1.305 & -0.361 & 0.600 + 0.9 & -0.451 & 1.335 & -0.356 & 0.800 & -0.414 & 1.310 & -0.338 & 0.800 + 1 & - & 1.330 & -0.330 & 1.000 & - & 1.288 & -0.288 & 1.000     +    [ table1 ]     0.8 cm 0.6 cm   0.8 cm     as we showed in the previous section all compounds under study are non - magnetic in the equilibrium rs lattice and thus are not useful for spintronic applications . contrary to the rs case , we found all four scc , scsi , vc and vsi to be magnetic in both the zb and wz structures . although these structures are not stable ones , it is possible to occur when these alloys are grown as thin films or multilayers on top of binary semiconductors adopting the same lattice structure . this is possible with the new up - to - date experimental techniques like molecular beam epitaxy or pulsed layer deposition and in fact the former method was employed to grow the cras films with the zb structure on top of the gaas semiconductor in reference @xcite . we will start our disucssion from the properties of the perfect compounds and in table [ table1 ] we have gathered the atom - resolved and total spin magnetic moments and in figure [ fig3 ] we present the associated dos . all presented calculations have been performed at the equilibrium lattice constants presented in figure [ fig1 ] . our first remark concerns the difference between the zb and wz structures . as we can see in table [ table1 ] , the spin magnetic moments only scarcely vary between the two lattice structures and the same occurs also for the total and atom - resolved dos presented in figure [ fig3 ] ( note that we have divided the total spin moment and dos in the wz structure by two to make it comparable to the zb case ) . thus we will concentrate our discussion to the zb case and refer to the wz structure only if the difference with respect to the zb lattice is significant . scc has in total 7 valence electrons per unit cell and thus in order to be half - metal it should exhibit a spin magnetic moment of -1 @xmath2 according to the @xmath12 slater - pauling rule . this is actually the case since , as can be seen in table [ table1 ] , sc carries as spin moment of around -0.18 @xmath2 and c atoms carry a spin moment of around -0.82 @xmath2 . although it seems strange that the spin moment is mainly concencentrated to the @xmath7 atoms , this phenomenon can be easily understood if we look at the dos in figure [ fig3 ] . in the spin - down band all four states are occupied . these states , as we have already discussed in section [ sec1 ] and as it is shown in reference @xcite , consist of a deep lying @xmath10-state and three bonding states due to the hybridization between the @xmath6 electrons of the c and the @xmath8 @xmath28-electrons of the sc atom . these bonding states are located mainly at the c atom since the @xmath6 states of c lie lower in energy with respect to the @xmath8 states of sc . since in total we have seven electrons and four are already accomodated in the spin - down bands , only three have to be accomodated in the spin - up band . thus in the spin - up band again only the bonding hybrids with their main weight at the c atom are partially occupied and thus the spin moment is mainly concentrated at the @xmath7-atom . as can be seen in the same graph the unoccupied states are mainly of sc character since they are consisted of the antibonding @xmath35 states and the localized @xmath9 @xmath36states of sc . when we subsitute v for sc , the two extra electrons fill exclusively spin - up states since the half - metallicity is preserved and the fermi level is again within the spin - down gap . thus now all the boinding spin - up states are occupied and one electron occupies partially the localized spin - up @xmath9 states of v ( in total these states can occupy two electrons per spin ) . as a result the fermi level falls within a large peak in the spin - up band and almost divides it in two equal parts . the spin - up peak of the @xmath9 states is clearly separated by the antibonding @xmath35 states as can be seen in the dos . as a result of the above discussion v has now a spin magnetic moment of @xmath33 1.19 @xmath2 and c a spin magnetic moment of @xmath33 -0.19 @xmath2 resulting to a total spin moment of + 1 @xmath2 in agreement to the slater - pauling behavior . the spin moment of v can be decomposed to 1 @xmath2 due to the @xmath9 state , and 0.19 @xmath2 which controbalances the -0.19 @xmath2 of c and come from the small inbalance in the distribution of the bonding @xmath35 states between the two chemical species in the spin - up and spin - down bands . in the case of the si compound the situation is similar with only noticeable difference the fact that si carries in the case of scsi a smaller absolute value of the spin magnetic moment with respect to c in scc while the situation is inversed when we compare the vsi to the vc alloy . scsi and vsi compounds have significantly larger equilibrium lattice constants with respect to the scc and vc alloys as shown in figure [ fig1 ] . thus the hybridization between the si @xmath6-states and the @xmath8-states of sc(v ) is less intense than in the case of the c - based alloys resulting in bands which are more narrow in energy width but more intense ( the scale in the vertical dos axis in figure [ fig3 ] is double for the si - based alloys ) . due to this small change in hybridization a variation in the spin magnetic moments occurs with respect to the c - based compounds . we have also performed calculations for the intermediate concentrations @xmath14 and in table [ table1 ] and figure [ fig3 ] we have gathered the atom - resolved and total spin magnetic moments and dos . the atom - resolved properties have been scaled to one atom . we have assumed that the lattice constants scale linearly with the concentration @xmath14 between the perfect compounds as occurs experimentally for the quaternary heusler alloys which have similar structure @xcite . in order for these alloys to be half - metallic , the slater - pauling rule should be again valid where as valence of the transition - metal site we consider the @xmath37 , where @xmath38 and @xmath39 the valence of the sc and v atoms respectvely . as we dope scc and scsi with v , the bonding @xmath35 states in the spin - up band start to move lower in energy with respect to the fermi level and the peak of the @xmath9 states starts appearing at the fermi level as can be clearly seen for the case of @xmath40 . thus almost all intermediate compounds follow the slater - pauling behavior as can be seen from the total spin moments in table [ table1 ] and the electronic and magnetic properties of the compounds vary in a continuous way with the concentration . the compounds are ferrimagnets since the v atoms have a spin moment antiparallel to the one of the sc and c(si ) atoms .    the only exception of compounds which are not magnetic is the case of [ sc@xmath0v@xmath1c for @xmath410.4 and 0.5 in the zb lattice and @xmath410.5 in the wz structure . we will start our discussion from the case of @xmath410.5 . [ sc@xmath3v@xmath3]c is not magnetic both in the zb and wz structures and as shown in the dos presented in figure [ fig3 ] it is actually a semiconductor since there are exactly eight valence electrons which occupy the bonding @xmath35 states in both the spin - up and spin - down bands . the energy gap is about 0.4 ev . we can clearly distinguish in the dos the occupied bonding hybrids , followed by the @xmath9 bands just above the fermi level with most of their weight at the v atoms and which are clearly separated in energy from the antibonding @xmath35 states which are even higher in energy ( the deep - lying @xmath10 states are not shown ) . in the case of @xmath410.4 in the zb structure the fermi level falls in a region of small spin - up dos ( the dos is not presented here ) and due to the stoner theorem the alloy is not magnetic contrary to the wz structure where the stoner theorem is satisfied even marginally resulting in a magnetic compound . v@xmath3]si in both zincblende and wurtzite structures performing non - spinpolarized calculations . the atom - resolved dos have been scaled to one atom . [ fig4 ] ]    contrary to [ sc@xmath3v@xmath3]c the [ sc@xmath3v@xmath3]si alloy is magnetic and in reallity it is a so - called half - metallic antiferromagnet @xcite since the total spin - moment is exactly zero as in conventional antiferromagnets but the different constituents are magnetic as shown in table [ table1 ] . the question which arises is why the si - alloy shows such a different behavior from the c - alloy . to elucidate the origin of the difference we have performed non - magnetic calculations for the [ sc@xmath3v@xmath3]si alloy in both the zb and wz structures and we present the dos in figure [ fig4 ] . the fermi level falls within a deep of the dos in the zb structure and within a small gap in the wz structure , thus due to stoner theorem in both cases magnetism is not favorable . but stoner theorem has a limited application in alloys where the situation is more complicated with respect to crystals made out of a single chemical element . below the fermi level the bands are concentrated in a small energy range and just above the fermi level there is a very intense peak due to the v @xmath9 states making the non - magnetic solution unstable and the system prefers to be magnetic in order to lower its total energy . we have employed first - principles calculations and have studied the structural , electronic and magnetic properties of the [ sc@xmath0v@xmath1c and [ sc@xmath0v@xmath1si alloys . in their equilibrium rocksalt structure all alloys are non - magnetic . the zincblende and wurtzite structures are degenerated with respect to the total energy and show magnetism . for all concentrations we found that the alloys in these two lattice structures are half - metallic with the gap located in the spin - down band . moreover they are ferrimagnets since v and sc atoms have antiparallel spin - magnetic moments . the total spin moment follows the slater - pauling behavior varying linearly between the -1 @xmath2 of the perfect scc and scsi alloys and the + 1 @xmath2 of the perfect vc and vsi alloys . at the critical concentration , both [ sc@xmath3v@xmath3]c and [ sc@xmath3v@xmath3]si alloys present zero total spin - magnetic moment but the c - based alloy shows a semiconducting behavior since the stoner criterion for magnetism is not satisfied . contrary , the [ sc@xmath3v@xmath3]si compounds is a half - metallic antiferromagnet and thus very interesting for potential application in spintronics . we have shown that also in the case of artificial binary compounds between transition - metal and @xmath7 atoms we can tune their magnetic properties in a continuous way by mixing atoms of neighboring chemical species . following this procedure we were able to demonstrate the existence of half - metallic ferrimagnetism in the studied alloys ( and in an extreme case even half - metallic antiferromagnetism ) which is highly desirable for spintronic applications since ferrimagnets create smaller stray fields than ferromagnets and consequatively lead to smaller energy losses in devices . moruzzi and c.b . sommers , in _ calculated electronic properties of ordered alloys : a handbook ; the elements and their 3d/3d and 4d/4d alloys _ ( world scientific publishing company , singapore ) , 1995 , pp 421 . webster and k.r.a . ziebeck , in _ alloys and compounds of d - elements with main group elements . _ , edited by h.r.j . wijn , landolt - brnstein , new series , group iii , vol . 19,pt.c ( springer - verlag , berlin ) , 1988 , pp 75 - 184 .
Abstract:

Answer: employing first - principles calculations we study the structural , electronic and magnetic properties of the [ sc@xmath0v@xmath1c and [ sc@xmath0v@xmath1si alloys . in their equilibrium rocksalt structure all alloys are non - magnetic . the zincblende and wurtzite structures are degenerated with respect to the total energy . for all concentrations the alloys in these lattice structures are half - metallic with the gap located in the spin - down band . the total spin moment follows the slater - pauling behavior varying linearly between the -1 @xmath2 of the perfect scc and scsi alloys and the + 1 @xmath2 of the perfect vc and vsi alloys . for the intermediate concentrations v and sc atoms have antiparallel spin magnetic moments and the compounds are half - metallic ferrimagnets . at the critical concentration , both [ sc@xmath3v@xmath3]c and [ sc@xmath3v@xmath3]si alloys present zero total spin - magnetic moment but the c - based alloy shows a semiconducting behavior contrary to the si - based alloys which is a half - metallic antiferromagnet .    electronic structure , half - metals , ferrimagnets    75.47.np , 75.50.cc , 75.30.et


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: deep neural networks ( dnns ) have been receiving ubiquitous success in wide applications , ranging from computer vision @xcite , to speech recognition @xcite , natural language processing @xcite , and domain adaptation @xcite . as the sizes of data mount up , people usually have to increase the number of parameters in dnns so as to absorb the vast volume of supervision . high performance computing techniques are investigated to speed up dnn training , concerning optimization algorithms , parallel synchronisations on clusters w / o gpus , and stochastic binarization / ternarization , etc @xcite .    on the other hand the memory and energy consumption is usually , if not always , constrained in industrial applications @xcite . for instance , for commercial search engines ( e.g. , google and baidu ) and recommendation systems ( e.g. , netflix and youtube ) , the ratio between the increased model size and the improved performance should be considered given limited online resources . compressing the model size becomes more important for applications on mobile and embedded devices @xcite . having dnns running on mobile apps owns many great features such as better privacy , less network bandwidth and real time processing . however , the energy consumption of battery - constrained mobile devices is usually dominated by memory access , which would be greatly saved if a dnn model can fit in on - chip storage rather than dram storage ( c.f . @xcite for details ) .    a recent trend of studies are thus motivated to focus on compressing the size of dnns while mostly keeping their predictive performance @xcite . with different intuitions , there are mainly two types of dnn compression methods , which could be used in conjunction for better parameter savings . the first type tries to revise the training target into more informative supervision using _ dark knowledge_. in specific , hinton _ _ @xcite suggested to train a large network ahead , and distill a much smaller model on a combination of the original labels and the soft - output by the large net . the second type observes the redundancy existence in network weights @xcite , and exploits techniques to constrain or reduce the number of free - parameters in dnns during learning . this paper focuses on the latter type .    to constrain the network redundancy , efforts @xcite formulated an original weight matrix into either low - rank or fast - food decompositions . moreover @xcite proposed a simple - yet - effective pruning - retraining iteration during training , followed by quantization and fine - tuning . @xcite proposed hashednets to efficiently implement parameter sharing prior to learning , and showed notable compression with much less loss of accuracy than low - rank decomposition . more precisely , prior to training , a hash function is used to randomly group ( virtual ) weights into a small number of buckets , so that all weights mapped into one hash bucket directly share a same value . hashednets was further deliberated in frequency domain for compressing convolutional neural networks in @xcite .    in applications , we observe hashednets compresses model sizes greatly at marginal loss of accuracy for some situations , whereas also significantly loses accuracy for others . after revisiting its mechanism , we conjecture this instability comes from at least three factors . first , hashing and training are disjoint in a two - phase manner , i.e. , once inappropriate collisions exist , there may be no much optimization room left for training . second , _ one single hash function _ is used to fetch a single value in the compression space , whose collision risk is larger than multiple hashes @xcite . third , parameter sharing within a buckets implicitly uses _ identity mapping _ from the hashed value to the virtual entry . this paper proposes an approach to relieve this instability , still in a two - phase style for preserving efficiency . specifically , we use _ multiple hash functions _ @xcite to map per virtual entry into multiple values in compression space . then an additional network plays in a _ mapping function _ role from these hashed values to the virtual entry before hashing , which can be also regarded as `` reconstructing '' the virtual entry from its multiple hashed values . plugged into and jointly trained within the original network , the reconstruction network is of a comparably ignorable size , i.e. , at low memory cost . this functional hashing structure includes hashednets as a degenerated special case , and facilitates less value collisions and better value reconstruction . shortly denoted as funhashnn , our approach could be further extended with dual space hashing and multi - hops . since it imposes no restriction on other network design choices ( e.g. dropout and weight sparsification ) , funhashnn can be considered as a standard tool for dnn compression . experiments on several datasets demonstrate promisingly larger reduction of model sizes and/or less loss on prediction accuracy , compared with hashednets . [ [ notations . ] ] notations . + + + + + + + + + +    throughout this paper we express scalars in regular ( @xmath0 or @xmath1 ) , vectors in bold ( @xmath2 ) , and matrices in capital bold ( @xmath3 ) . furthermore , we use @xmath4 to represent the @xmath5-th dimension of vector @xmath2 , and use @xmath6 to represent the @xmath7-th entry of matrix @xmath3 . occasionally , @xmath8_i$ ] is also used to represent the @xmath5-th dimension of vector @xmath2 for specification clarity . notation @xmath9 $ ] stands for the expectation operator . [ [ feed - forward - neural - networks . ] ] feed forward neural networks . + + + + + + + + + + + + + + + + + + + + + + + + + + + + +    we define the forward propagation of the @xmath10-th layer as @xmath11.\end{aligned}\ ] ] for each @xmath10-th layer , @xmath12 is the output dimensionality , @xmath13 is the bias vector , and @xmath14 is the ( _ virtual _ ) weight matrix in the @xmath10-th layer . vectors @xmath15 denote the units before and after the activation function @xmath16 . typical choices of @xmath16 include rectified linear unit ( relu ) @xcite , sigmoid and tanh @xcite . [ [ feature - hashing ] ] feature hashing + + + + + + + + + + + + + + +    has been studied as a dimension reduction method for reducing model storage size without maintaining the mapping matrices like random projection @xcite . briefly , it maps an input vector @xmath17 to a much smaller feature space via @xmath18 with @xmath19 . following the definition in @xcite , the mapping @xmath20 is a composite of two approximate uniform hash functions @xmath21 and @xmath22 . the @xmath23-th element of @xmath24 is defined as : @xmath25_j = \sum_{i : h(i)=j } \xi(i)x_i.\end{aligned}\ ] ] as shown in @xcite , a key property is its inner product preservation , which we quote and restate below . * _ lemma [ inner product preservation of original feature hashing ] _ * with the hash defined by eq . ( [ eq : originalfeaturehash ] ) , the hash kernel is unbiased , i.e. , @xmath26={\mathbf}{x}^{\top}{\mathbf}{y}$ ] . moreover , the variance is @xmath27 , and thus @xmath28 if @xmath29 .    [ [ hashednets - in- . ] ] hashednets in @xcite . + + + + + + + + + + + + + + + + + + + + + +    as illustrated in figure  [ fig : model](a ) , hashednets randomly maps network weights into a smaller number of groups prior to learning , and the weights in a same group share a same value thereafter . a naive implementation could be trivially achieved by maintaining a secondary matrix that records the group assignment , at the expense of additional memory cost however . hashednets instead adopts a hash function that requires no storage cost with the model . assume there is a finite memory budge @xmath30 per layer to represent @xmath14 , with @xmath31 . we only need to store a weight vector @xmath32 , and assign @xmath33 an element in @xmath34 indexed by a hash function @xmath35 , namely @xmath36 where hash function @xmath35 outputs an integer within @xmath37 $ ] . another independent hash function @xmath38 outputs a sign factor , aiming to reduce the bias due to hash collisions @xcite . the resulting matrix @xmath14 is _ virtual _ , since @xmath12 could be increased without increasing the _ actual _ number of parameters in @xmath34 once the compression space size @xmath30 is determined and fixed . substituting eq . ( [ eq : hashednets ] ) into eq .  ( [ eq : ffnn ] ) , we have @xmath39 . during training , @xmath34 is updated by back propagating the gradient via @xmath40 ( and the virtual @xmath14 ) . besides , the activation function @xmath16 in eq . ( [ eq : ffnn ] ) was kept as relu in @xcite to further relieve the hash collision effect through a sparse feature space . in both @xcite and this paper , the open source _ _ xxhash _ _ is adopted as an approximately uniform hash implementation with low cost . for clarity , we will focus on a single layer throughout and drop the super - script @xmath10 . still , vector @xmath41 denotes parameters in the compression space . the key difference between funhashnn and hashednets @xcite lies in ( i ) how to employ hash functions , and ( ii ) how to map from @xmath42 to @xmath43 :    * instead of adopting one pair of hash function @xmath44 in eq . ( [ eq : hashednets ] ) , we use a set of multiple pairs of independent random hash functions . let s say there are @xmath45 pairs of mappings @xmath46 , each @xmath47 outputs an integer within @xmath48 $ ] , and each @xmath49 selects a sign factor . * ( [ eq : hashednets ] ) of hashednets employs an identity mapping between one element in @xmath43 and one hashed value , i.e. , @xmath50 . in contrast , we use a multivariate function @xmath51 to describe the mapping from multiple hashed values @xmath52 to @xmath53 . specifically , @xmath54;\ { \boldsymbol}{\alpha}\right ) . \end{aligned}\ ] ] therein , @xmath55 is referred to as the parameters in @xmath51 . note that the input @xmath56 is order sensitive from @xmath57 to @xmath45 . we choose @xmath51 to be a multi - layer feed forward neural network , and other multivariate functions may be considered as alternatives .    as a whole , figure  [ fig : model](b ) illustrates our funhashnn structure , which can be easily plugged in any matrices of dnns . note that @xmath55 in the reconstruction network @xmath51 is of a much smaller size compared to @xmath42 . for instance , a setting with @xmath58 and a 1-layer @xmath59 of @xmath60 performs already well enough in experiments . in other words , eq . ( [ eq : funhashnn ] ) just uses an ignorable amount of additional memory to describe a functional @xmath42-to-@xmath43 mapping , whose properties will be further explained in the sequel . the parameters in need of updating include @xmath42 in the compression and @xmath55 in @xmath51 . training funhashnn is equivalent to training a standard neural network , except that we need to forward / backward - propagate values related to @xmath42 through @xmath51 and the virtual matrix @xmath43 . [ [ forward - propagation . ] ] forward propagation . + + + + + + + + + + + + + + + + + + + +    substituting eq . ( [ eq : funhashnn ] ) into eq . ( [ eq : ffnn ] ) , we still omit the super - script @xmath10 and get @xmath61;\ { \boldsymbol}{\alpha}\right).\end{aligned}\ ] ]    [ [ backward - propagation . ] ] backward propagation . + + + + + + + + + + + + + + + + + + + + +    denote @xmath62 as the final loss function , e.g. , cross entropy or squared loss , and suppose @xmath63 is already available by back - propagation from layers above . the derivatives of @xmath62 with respect to @xmath42 and @xmath55 are computed by @xmath64 where , since we choose @xmath51 as a multilayer neural network , derivatives @xmath65 and @xmath66 can be calculated through the small network @xmath51 in a standard back - propagation manner .    [ [ complexity . ] ] complexity . + + + + + + + + + + +    concerning time and memory cost , funhashnn roughly has the same complexity as hashednets , since the small network @xmath51 is quite light - weighted . one key variable factor is the way to implement multiple hash functions . on one hand , if they are calculated online , then funhashnn requires little additional time if tackling them in parallel . on the other , if they are pre - computed and stored in dicts to avoid hashing time cost , the multiple hash functions of funhashnn demand more storage space . in application , we suggest to pre - compute hashes during offline training for speedup , and to compute hashes in parallel during online prediction for saving memory under limited budget .      in this part , we try to depict the properties of our funhashnn from several aspects to help understanding it , especially in comparison with hashednets @xcite . [ [ value - collision . ] ] value collision . + + + + + + + + + + + + + + + +    it should be noted , both hashednets and funhashnn conduct hashing prior to training , i.e. , in a two - phase manner . consequently , it would be unsatisfactory if hashing collisions happen among important values . for instance in natural language processing tasks , one may observe wired results if there are many hashing collisions among embeddings ( which form a matrix ) of frequent words , especially when they are not related at all . in the literature , multiple hash functions are known to perform better than one single function @xcite . in intuition , when we have multiple hash functions , the items colliding in one function are hashed differently by other hash functions . [ [ value - reconstruction . ] ] value reconstruction . + + + + + + + + + + + + + + + + + + + + +    in both hashednets and funhashnn , the hashing trick can be viewed as a reconstruction of the original parameter @xmath43 from @xmath67 . in this sense , the approach with a lower reconstruction error is preferred , whereas here we could imagine @xmath43 is already structured and filled by values with least redundancy . ] . then we have at least the following two observations :    * * the maximum number of possible distinct values * output by hashing intuitively explains the modelling capability @xcite . for hashednets , considering the sign hashing function @xmath68 , we have at most @xmath69 possible distinct values of eq . ( [ eq : hashednets ] ) to represent elements in @xmath43 . in contrast , since there are multiple ordered hashed inputs , funhashnn has at most @xmath70 possible distinct values of eq . ( [ eq : funhashnn ] ) . note that the memory size @xmath71 is the same for both . * * the reconstruction error * may be difficult to analyzed directly , since the hashing mechanism is trained jointly within the whole network . however , we observe @xmath72;\ { \boldsymbol}{\alpha}\right)$ ] degenerates to @xmath73 if we assign zeros to all entries in @xmath55 unrelated to the 1st input dimension . since @xmath73 depends only on one single pair of hash functions , it is conceptually equivalent to hashednets . consequently , including hashednets as a special case , funhashnn with freely adjustable @xmath55 is able to reach a lower reconstruction error to fit the final accuracy better . [ [ feature - hashing . ] ] feature hashing . + + + + + + + + + + + + + + + +    in line with previous work @xcite , we compare hashednets and funhashnn in terms of feature hashing . for specification clarity , we drop the sign hashing functions @xmath68 below for both methods , the analysis with which is straightforward by replacing @xmath71 hereafter with @xmath69 .    * for hashednets , one first defines a hash mapping function @xmath74 , whose @xmath75-th element is @xmath76_k \triangleq \sum_{j : h(i , j)=k } a_j , \quad { \mathrm}{for } \quad k=1,\ldots , k . \end{aligned}\ ] ] thus @xmath77 by hashednets can be computed as the inner product ( details c.f . section  4.3 in @xcite ) @xmath78 * for funhashnn , we first define a hash mapping function @xmath79 . different from a @xmath71-dim output in eq . ( [ eq : featurehash_hashnet1 ] ) , it is of a much larger size @xmath80 , with @xmath81-th element as @xmath82_{\sum_{u=1}^u k_uk^{(u-1 ) } }   \triangleq \sum_{\substack{j : h_1(i , j)=k_1 \\ \ \ h_2(i , j)=k_2 \\ \ \ \ldots \\ \ \ h_u(i , j)=k_u } } a_j , \quad { \mathrm}{for}\quad \forall u , \ k_u=1,\ldots , k . \end{aligned}\ ] ] second , we define vector @xmath83 still of length @xmath80 , whose @xmath81-th entry is @xmath84_{\sum_{u=1}^u k_uk^{(u-1 ) } }   \triangleq g\left(w_{k_1},w_{k_2},\ldots , w_{k_u } ; \ { \boldsymbol}{\alpha}\right ) , \quad { \mathrm}{for}\quad \forall u , \ k_u=1,\ldots , k . \end{aligned}\ ] ] thus @xmath77 by funhashnn can be computed as the following inner product @xmath85 the difference between eq . ( [ eq : featurehash_hashnet2 ] ) and eq . ( [ eq : featurehash_funhashnn3 ] ) further explains the above discussion about `` the maximum number of possible distinct values '' . [ [ hashing - on - dual - space . ] ] hashing on dual space . + + + + + + + + + + + + + + + + + + + + + +    if considering a linear model @xmath86 , one can not only deliver analysis like bayesian or hashing on input feature space of @xmath2 , but also do similarly on the _ dual space _ of @xmath87 @xcite . we now revisit the `` reconstruction '' network @xmath88 in eq . ( [ eq : funhashnn ] ) , where vector @xmath89 concatenates the hashed values @xmath56 for @xmath90 . what we did in eq . ( [ eq : funhashnn ] ) is in fact hashing @xmath7 through @xmath42 to get the input feature of @xmath51 . in analogy , we can also hash @xmath7 to fetch parameters of @xmath51 , namely we have a new `` reconstruction '' network in the following form : @xmath91_u = \xi_u(i , j)w_{h_u(i , j)}\quad { \mathrm}{and }       \quad [ { \boldsymbol}{\alpha}_{ij}]_r = \xi'_r(i , j ) w'_{h'_r(i , j)},\end{aligned}\ ] ] where @xmath92 are additional multiple pairs of hash functions applied on @xmath55 , and @xmath93 is an additional vector in the compression space of @xmath55 . the size of @xmath94 remains the same as previous . using this trick , the maximum number of possible distinct values of @xmath43 further increases exponentially , so that funhashnn has more potential ability to fit the prediction well . we denote funhashnn with dual space hashing shortly as funhashnn - d , and illustrate its structure in figure  [ fig : model](c ) . [ [ multi - hops . ] ] multi - hops . + + + + + + + + + + +    we conjecture that funhashnn could be used in a multi - hops structure , by imagining @xmath42 in the compression space plays a _ virtual _ role similar to @xmath43 . specifically , we can build another level of hash functions @xmath95 and compression space @xmath96 . thereafter , each entry in @xmath42 is hashed into multiple values in @xmath96 via @xmath95 . then another reconstruction network @xmath97 is used to learn the mapping from the hashed values in @xmath96 to the corresponding entry in @xmath42 . this procedure can be implemented recursively . if there are in total @xmath98-hops , what we need to save in fact just includes a ( possibly much more smaller ) vector @xmath99 at the final hop , a series of @xmath98 small reconstruction networks @xmath100 , and a series of hashing functions . in contrast , the multi - hops version of hashednets is equivalent to just adjusting the compression ratio , or say the size @xmath71 . recent studies have confirmed the redundancy existence in the parameters of deep neural networks . @xcite decomposed a matrix in a fully - connected layers as the product of two low - rank matrices , so that the number of parameters decreases linearly as the latent dimensionality decreases . more structured decompositions fastfood @xcite and deep fried @xcite were proposed not only to reduce the number of parameters , but also to speed up matrix multiplications . more recently , han _ et al . _ @xcite proposed to iterate pruning - retraining during training dnns , and used quantization and fine - tuning as a post - processing step . huffman coding and hardware implementation were also considered . in order to mostly keep accuracy , the authors suggested multiple rounds of pruning - retraining . that is , for little accuracy loss , we have to prune slowly enough and thus suffer from increased training time . again , the most related work to ours is hashednets @xcite , which was then extended in @xcite to random hashing in frequency domain for compressing convolutional neural networks . either hashednets or funhashnn could be combined in conjunction with other techniques for better compression . extensive studies have been made on constructing and analyzing multiple hash functions , which have shown better performances over one single hash function @xcite . one multi - hashing algorithm , @xmath101-random scheme @xcite , uses only one hash table but @xmath101 hash functions , pretty similar to our settings . one choice alternative to @xmath101-random is the @xmath101-left algorithm proposed in @xcite , used for improving ip lookups . hashing algorithms for natural language processing are also studied in @xcite . papers @xcite investigated feature hashing ( a.k.a . the hashing trick ) , providing useful bounds and feasible results . we conduct extensive experiments to evaluate funhashnn on dnn compression . codes for fully reproducibility will be open source soon after necessary polishment . [ [ datasets . ] ] datasets . + + + + + + + + +    three benchmark datasets @xcite are considered here , including ( 1 ) the original ` mnist ` hand - written digit dataset , ( 2 ) dataset ` bg - img ` as a variant to ` mnist ` , and ( 3 ) binary image classification dataset ` convex ` . for all datasets , we use prespecified training and testing splits . in particular , the original ` mnist ` dataset has # train=60,000 and # test=10,000 , while the remaining both have # train=12,000 and # test=50,000 . moreover , collected from a commercial search engine , a large scale dataset with billions of samples is used to learn dnns for pairwise semantic ranking . we randomly split out 20% samples from the training data to form the validation set .    [ [ methods - and - settings . ] ] methods and settings . + + + + + + + + + + + + + + + + + + + + +    in @xcite , the authors compared hashednets against several dnn compression approaches , and showed hashednets performs consistently the best , including the low - rank decomposition @xcite . under the same settings , we compare _ funhashnn _ with _ _ / project / hashednets / index.html ] and a standard neural network without compression . all activation functions are chosen as relu . the settings of funhashnn are tested in two scenarios . first , we will fix to use funhashnn in figure  [ fig : model](b ) without extensions , and then compare the effects of compression by funhashnn and hashednets . second , we compare different configurations of funhashnn itself , including the number @xmath45 of seeds , the layer of reconstruction network @xmath51 , and extension with the dual space hashing . hidden layers within @xmath51 keep using tanh as activation functions . results by the multi - hops extension of funhashnn will be included in another ongoing paper for systematic comparisons .      to test robustness , we vary the compression ratio with ( 1 ) a fixed virtual network size ( i.e. , the size of @xmath14 in each layer ) , and then with ( 2 ) a fixed memory size ( i.e. , the size of @xmath34 in each layer ) . three - layer ( 1 hidden layer ) and five - layer ( 3 hidden layers ) networks are investigated . in experiments , we vary the compression ratio geometrically within @xmath102 . for funhashnn , this comparison sticked to use 4 hash functions , 3-layer @xmath51 , and without dual space hashing .    [ [ with - virtual - network - size - fixed . ] ] with virtual network size fixed . + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +    the hidden layer for 3-layer nets initializes at 1000 units , and for 5-layer nets starts at 100 units per layer . as the compression ratio ranges from 1 to 1/64 with a fixed virtual network size , the memory decreases and it becomes increasingly difficult to preserve the classification accuracy . the testing errors are shown in figure  [ fig : res_varycomp_fixnet ] , where standard neural networks with equivalent parameter sizes are included in comparison . funhashnn shows robustly effective compression against the compression ratios , and persistently produces better prediction accuracy than hashednets . it should be noted , even when the compression ratio equals to one , funhashnn with the reconstruction network structure is still not equivalent to hashednets and performs better . +            [ [ with - memory - storage - fixed . ] ] with memory storage fixed . + + + + + + + + + + + + + + + + + + + + + + + + + +    we change to vary the compression ratio from 1 to 1/64 with a fixed memory storage size , i.e. , the size of the virtual network increases while the number of free parameters remains unchanged . in this sense , we d better call it expansion instead of compression . both 3-layer and 5-layer nets initialize at 50 units per hidden layer . the testing errors in this scenario are shown in figure  [ fig : res_varycomp_fixmem ] . at all compression ( expansion ) ratios on each dataset , funhashnn performs better than or at least comparably well compared to hashednets .             +              on 3-layer nets with compression ratio @xmath103 , we vary the configuration dimensions of funhashnn , including the number of hash functions ( @xmath45 ) , the structure of layers of the reconstruction network @xmath51 , and whether dual space hashing is turned on . since it is impossible to enumerate all probable choices , @xmath45 is restricted to vary in @xmath104 . the structure of @xmath51 is chosen from @xmath105 layers , with @xmath106 , @xmath107 , @xmath108 layerwise widths , respectively . we denote u@xmath109-g@xmath110 as @xmath109 hash functions and @xmath110 layers of @xmath51 , and a suffix -d indicates the dual space hashing . table  [ tab : res_varyconfig ] shows the performances of funhashnn with different configurations on ` mnist ` . the observations are summarized below . first , the series from index ( 0 ) to ( 1.x ) fixes a 3-layer @xmath51 and varies the number of hash functions . as listed , more hash functions do not ensure a better accuracy , and instead u4-g3 performs the best , perhaps because too many hash functions potentially brings too many partial collisions . second , the series from ( 0 ) to ( 2.x ) fixes the number of hash functions and varies the layer number in @xmath51 , where three layers performs the best mainly due to its strongest representability . third , indices ( 3.x ) show further improved accuracies using dual space hashing . captypetable    [ cols="<,<,^",options="header " , ]      + captypefigure      finally , we evaluate the performance of funhashnn on semantic learning - to - rank dnns . the data is collected from logs of a commercial search engine , with per clicked query - url being a positive sample and per non - clicked being a negative sample . there are totally around 45b samples . we adopt a deep convolutional structured semantic model similar to @xcite , which is of a siamese structure to describe the semantic similarity between a query and a url title . the network is trained to optimize the cross entropy for each pair of positive and negative samples per query . the performance is evaluated by correct - to - wrong pairwise ranking ratio on testing set . in figure [ fig : res_hash_ltr ] , we plot the performance by a baseline network as training proceeds , compared to funhashnn and hashnet both with 1/4 compression ratio . with @xmath58 hash functions , funhashnn performs better than hashednets throughout the training epochs , and even comparable to the full network baseline which requires 4 times of memory storage . the deterioration of hashednets probably comes from many inappropriate collisions on word embeddings , especially for words of high frequencies . this paper presents a novel approach funhashnn for neural network compression . briefly , after adopting multiple low - cost hash functions to fetch values in compression space , funhashnn employs a small reconstruction network to recover each entry in an matrix of the original network . the reconstruction network is plugged into the whole network and learned jointly . the recently proposed hashednets @xcite is shown as a degenerated special case of funhashnn . extensions of funhashnn with dual space hashing and multi - hops are also discussed . on several datasets , funhashnn demonstrates promisingly high compression ratios with little loss on prediction accuracy .    as future work , we plan to further systematically analyze the properties and bounds of funhashnn and its extensions . more industrial applications are also expected , especially on mobile devices . this paper focuses on the fully - connected layer in dnns , and the compression performance on other structures ( such as convolutional layers ) is also planned to be studied . as a simple and effective approach , funhashnn is expected to be a standard tool for dnn compression . g.  hinton , l.  deng , d.  yu , g.  e. dahl , a.  rahman mohamed , n.  jaitly , a.  senior , v.  vanhoucke , p.  nguyen , t.  n. sainath , and b.  kingsbury . deep neural networks for acoustic modeling in speech recognition : the shared views of four research groups . , 29(6):8297 , 2012 .
Abstract:

Answer: as the complexity of deep neural networks ( dnns ) trend to grow to absorb the increasing sizes of data , memory and energy consumption has been receiving more and more attentions for industrial applications , especially on mobile devices . this paper presents a novel structure based on functional hashing to compress dnns , namely funhashnn . for each entry in a deep net , funhashnn uses multiple low - cost hash functions to fetch values in the compression space , and then employs a small reconstruction network to recover that entry . the reconstruction network is plugged into the whole network and trained jointly . funhashnn includes the recently proposed hashednets @xcite as a degenerated case , and benefits from larger value capacity and less reconstruction loss . we further discuss extensions with dual space hashing and multi - hops . on several benchmark datasets , funhashnn demonstrates high compression ratios with little loss on prediction accuracy .