Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: one of the great mysteries of neuroscience is how the brain manages to perform stable and useful computations using such apparently unreliable elements as neurons . one can present the same stimulus to a sensory neuron over and over again , and the number of spikes it produces will differ each time . while some of this variability arises from biophysical processes within neurons ( e.g. , synaptic transmission , diffusion processes within and across membranes ) , we have also known for a long time that neural responses are affected by a huge array of contextual state variables : arousal ; attention ; expected or actual reward ; emotions ; local metabolic resource availability ; and the presence of stimulants , depressants or anesthetics . in turn , fluctuations in these variables can compound the measured variability of neural responses [ e.g. , 12 , 13 , 14 ] . although these sources of variability are well known in the neuroscience community , many of them are difficult to control or measure . experimentalists largely handle this variability by simple averaging . in sensory systems , for example , stimuli are typically presented repeatedly for many trials ; the results are then averaged , in order to estimate the stimulus - dependent component of the neural response . this approach has several major drawbacks . first , the need for many repeats is very resource - intensive . second , it assumes that the variability can actually be removed by averaging , which need not be true . third , there are no widely agreed - upon means for assessing the contribution of these unknown sources , before or after averaging . if we wish to study a non - stationary brain , then it behooves us to consider more explicitly how these unknown state variables manifest in neural responses . a more explicit model of their effect could , in principle , have two major benefits : it might allow us to directly estimate the contextual influences on neurons , and it could provide better methods to infer stimulus - response relationships . to first approximation , the effect of these state variables is _ modulatory _ : they alter the gain or responsivity of neurons , rather than directly cause the generation of spikes ( fig .  1 ) . this idea has recently proven useful as a structural constraint for a model of the desired form . goris et al [ 1 ] describe neural responses as arising from a poisson process whose rate is a product of stimulus drive and a latent gain signal . this model provides an accurate account of the variability of sensory neurons , attributing a substantial fraction to fluctuations in modulatory influences . here , we generalize this _ modulated poisson _ ( mop ) model , providing it with a more explicit stimulus - dependent component , and assuming that the unknown state variables driving the gain fluctuations change only slowly in time . we develop statistical inference procedures for extracting both the latent gain signal , as well as the parameters of the stimulus dependency . we test these procedures on simulated data , and demonstrate the success of the model in explaining electrophysiological data obtained from auditory neurons in the anesthetized ferret . we note that our formulation has similarities to previously published models . in form , this is an extension of the generalized linear model ( glm , see below ; [ 2 ] ) , but with the inclusion of a time - varying latent signal . our model shares the general form of a latent state space model for neural data [ 15 - 19 ] . this class includes the poisson linear dynamical system ( plds ) model [ 17 ] . unlike the plds , which relies on autoregressive processes to characterise the latent signal , our formulation relies on gaussian processes . we also relax the constraint that the latent modulatory signal is passed through the same nonlinearity as the stimulus - response function , and rather consider it simply to be a positive - valued signal that has a multplicative effect .    an earlier version of these results was presented at the cosyne meeting in 2014 .    . stimuli ( oriented gratings ) drive the firing of this neuron , but have dynamics on a timescale of seconds . modulatory influences on this cell create slow non - stationarities that are visible in its spiking output . ( b ) two epochs of low and high firing ( labelled a and b ) . ( c - d ) the stimulus selectivity of the neuron in these two epochs differs by a multiplicative gain factor . ] our central abstraction is to build a generative model of neural responses that consists of three components . first , there are the controlled or measured inputs to a neuron . for a sensory neuron , this might be encapsulated as `` the stimulus '' . second , there a slowly varying stochastic modulatory process , that acts as a multiplier on the instantaneous firing rates . this component is not directly observed . third , there is the spike - generating point process ( whose output is typically observed ) .    for more detail , we begin with the classical poisson framework for describing the stimulus - driven response of a sensory neuron ( fig . this asserts a simple generative model for producing spike counts within a set of time windows , and contains only the input - rate and point - process components . we assume here we have a collection of discrete time windows of identical duration , indexed by @xmath0 , and that the spike rate within each of these windows , @xmath1 , is a function , @xmath2 , of the current stimulus , @xmath3 ( or , perhaps , the recent history of stimulation , which can be encapsulated in @xmath3 ) , and a set of input - response parameters , @xmath4 : @xmath5 in turn , we assume that the spike count within each window , @xmath6 , is drawn from a poisson distribution with rate @xmath1 . we use the vector notation @xmath7 to describe the set of scalars @xmath6 . this class includes the linear - nonlinear - poisson ( lnp ) models ( where @xmath8 ) , the generalized linear model ( glm ) , where the input @xmath3 encapsulates a range of known time - varying signals , such as the recent history of spike counts from the same and other neurons [ 2 ] , and the generalized quadratic model ( gqm ) , where @xmath2 also includes quadratic operations on @xmath3 [ 7 ] . in the modulated - poisson ( mop ) model [ 1 ] , we assume that the firing rate is additionally modulated by a multiplicative interaction with a latent ( unobserved ) variable @xmath9 : @xmath10 we make two specific assumptions about the vector of time - varying modulator values , @xmath11 . first , we assume it is positive , by writing @xmath12 . this choice is not unique : other nonlinear functions could also be used [ 10 ] . second , we assume that it is slowly varying . the slow dynamic on @xmath13 $ ] could take on any form appropriate to a given system ( e.g.  linear gaussian , discrete markov ) . here , for tractability and generality , we assume that @xmath14 is multivariate gaussian : @xmath15 where the smoothness is imparted by @xmath16 , the prior covariance matrix on @xmath14 , via a set of hyperparameters @xmath17 . this structure is depicted in the schematic shown in fig .  2b , and the graphical model shown in fig . below , we motivate a particular choice of form for @xmath16 . suppose we have a set of neural data with stimuli @xmath18 $ ] and observed spike counts @xmath7 . our goal is to infer the two unknown components of the model : the log - modulators @xmath14 , and the parameters of the input - response relationship , @xmath4 . in the case where the nonlinearity @xmath2 is the exponential function , these two stages can be merged . for generality , we maintain our central abstraction here , and split the inference into separate stages for each of these two components . more precisely , we approximate the joint posterior by @xmath19 , and then solve iteratively for the two components . for brevity , we omit the subscripts on @xmath20 and the conditioning on @xmath21 and @xmath7 from the notation , and write these simply as @xmath22 and @xmath23 . here , we shall remain agnostic to the form of the input - response relationship ( @xmath2 ) , and thus focus entirely on the modulator component . further , rather than solving jointly for the modulator @xmath14 and its hyperparameters @xmath17 , we follow the approach of [ 3 ] , and split this inference into two parts : first , we calculate a maximum - marginal - likelihood point estimate @xmath24 , and then we calculate a posterior on @xmath14 conditioned on @xmath25 . we concentrate on the latter problem first . suppose we have an estimate of @xmath22 , and @xmath25 , a point estimate of @xmath17 . to solve for @xmath14 given these , we begin by writing the terms of the log joint , @xmath27 that depend on @xmath14 , and then we condition on our current estimates of @xmath22 and @xmath25 : @xmath28   \;=\ ;   -{\boldsymbol{{{\boldsymbol{\hat \nu}}}}}^{\mathsf{t}}\exp({\boldsymbol{h } } ) { \,+\,}{\boldsymbol{y}}^{\mathsf{t}}{\boldsymbol{h } } -{\frac 1 2 \,}{\boldsymbol{h}}^{\mathsf{t}}{{\boldsymbol{c}}({{\boldsymbol{\hat \theta}}})^{-1}}{\boldsymbol{h } } { \,+\,}{\mathrm{const}}\label{lj}\ ] ] where @xmath29 is the vector of values @xmath30}$ ] , i.e. the expected stimulus - driven component of the firing rate under our current estimate of @xmath22 , and the exponential is applied elementwise . the number of elements of @xmath14 is equal to the number of time windows , @xmath31 . this is typically very large . for example , an hour of continuous recording , with spike counts binned at 25  ms intervals has @xmath32 ; at 5  ms resolution , this number exceeds @xmath33 . performing inference on @xmath14 scales with @xmath34 , and is therefore intractable : the objective is expensive to compute , and the number of variables to optimize is far too large . we therefore reduce its dimensionality . our strategy is to project @xmath14 into a low - dimensional space specified by the eigendecomposition of the prior covariance , @xmath35 . since we want @xmath14 to be slowly varying , the prior to be translation invariant , and the eigendecomposition and projection to be inexpensive , a natural choice is for @xmath35 to be circulant . in this way , the eigenvectors are sinusoids , the prior is diagonalized to a fourier power spectrum ( in this case , low - pass ) which can be parameterized by @xmath17 , the transform can be quickly calculated through the fft , and inference can proceed on the fourier coefficients of @xmath36 within the pass - band .    more specifically , we write : @xmath37 as the eigendecomposition ; @xmath38 as the @xmath39 projection operator which excises the low - eigenvalue dimensions , i.e.  those with low prior power ; @xmath40 as its pseudoinverse , which imputes missing coefficients as zero ; and @xmath41 as the combined transform to the reduced space . we consider the dft matrix @xmath42 as an invertible real - valued transform , by concatenating the real and imaginary parts of the transformed vectors ; since @xmath36 is real - valued , the negative frequencies are redundant and can be omitted from the computation . we implement all matrix operations that involve @xmath42 and @xmath43 via an orthonormalized , real - valued , real - signal fft .    as a result , we perform inference on the length-@xmath44 vector @xmath45 , corresponding to a reduced fourier - domain representation of the modulator , @xmath36 . the transform back to the time domain is given by @xmath46 . this reduces the complexity of inference to @xmath47 , corresponding to the cost of the fft plus the cost of inference in reduced space .    in reduced fourier space , the conditional log posterior on @xmath45 , its jacobian and its hessian become : @xmath48 where @xmath49 is the firing rate , @xmath50 is the elementwise product , and the diagonal matrix @xmath51 is the projected prior covariance on @xmath45 . since equation contains a sum of exponentials , a moment - matched exponential family form for @xmath52 can not be tractably normalized . however , since @xmath53 , the hessian is convex wrt . @xmath45 , so we can solve for a laplace approximation of the conditional posterior instead , @xmath54 . in principle , this reduced fourier representation can be transformed back into the time domain , giving @xmath55 , but since @xmath56 is @xmath57 , it is typically too large to fit in memory . sampling and conditional inference can nevertheless proceed with @xmath58 rather than @xmath59 .    in order for the fft to be an efficient tool , the time windows should be regularly sampled . it is nevertheless straightforward to handle missing data at time points @xmath60 , by simply setting @xmath61 . in this way , imputed values of @xmath62 do not materially contribute to the likelihood terms in the objective and its derivatives , and are constrained only by the smoothness and shrinkage terms from the prior . this also provides a way of avoiding artefacts from circular boundary conditions imposed by the fourier transform : we pad @xmath36 with an additional @xmath31 values , for which the responses are unobserved . finally , the first term of the hessian is expensive to compute directly , even via the fft implementation . however , we note that this matrix is a selection of rows and columns from @xmath63 , which , in turn , is a real - valued rearrangement of the real and imaginary parts of a complex - valued , hermitian , circulant matrix , with entries constructed from the fourier transform of @xmath64 . this enables a quick construction . we place a smoothness prior on @xmath36 . for a given neural recording , the degree of smoothness , i.e.  the timescales over which the latent modulators vary , is itself unknown . we therefore build a hierarchical model , wherein the smoothness is controlled by a set of hyperparameters , @xmath17 . in the fourier domain , this amounts to parameterizing the prior power spectrum  i.e.  the elements of the diagonal of @xmath66  as a function of @xmath17 . one potential form for a low - pass prior on @xmath14 is the zero - mean aldf prior ( automatic locality determination in the frequency domain [ 3 ] ) . this parameterizes the elements of the diagonal of @xmath66 as a function of their respective fourier frequencies , @xmath67 , and two hyperparameters @xmath68 : @xmath69_{ii }   \;=\ ;   \exp \left ( -\frac { f(i)^2 } { 2 \sigma^2 } { \,-\,}\rho \right ) \ ] ] in practice , there is considerable computational pressure to minimize the number of coefficients of @xmath45 ( see section [ section.recovering ] ) , which means we have to truncate this spectrum at some point . we find it more practical to construct a low - pass prior covariance from a more compact windowing function , such as a blackman - harris window , with hyperparameters @xmath70 : @xmath69_{ii }            \;=\ ;            \left\ {              \begin{array}{lr }                   e^{-\rho } \sum_{n=0}^{3 } ( -1)^n a_n \cos \left ( \pi n ( 1 + f(i)/f_c ) \right ) & \;:\ ; f(i ) \le f_c \\                  0 & \;:\ ; f(i ) > f_c              \end{array }          \right.\ ] ] where @xmath71^{\mathsf{t}}$ ] . compared with the truncated aldf prior , this has less flexibility in controlling the ripple in the estimate of @xmath36 . nevertheless , the difference in fitted @xmath36 values are typically very small for a modest speed improvement .    to choose values for the hyperparameters , we follow the approach of park and pillow [ 3 , 4 ] , and solve for the maximum marginal likelihood value of @xmath17 , a procedure also known as evidence optimization the idea is to integrate out the values of @xmath36 , and maximize the marginal likelihood of the data as a function of @xmath17 . this gives a point estimate of @xmath17 , as @xmath25 . we refer the reader to these papers for a complete description of this process .      in parallel to the approach in section [ section : inference.on.h ] , we suppose we have an estimate of the modulators @xmath23 , and wish to solve for the input - response parameters , @xmath22 . the terms of the log joint containing @xmath4 are : @xmath73 where the exponential and logarithm are applied element - wise . next , we condition on our current estimate of @xmath23 . to do this , we need only replace @xmath74 with its expectation under @xmath23 : @xmath75 }      \;=\ ;          \exp \left ( { { \boldsymbol{\hat h}}}+ { \frac 1 2 \,}\mathrm{diag } \ , { \boldsymbol{\lambda } } \right )      \;=\ ;          \exp \left ( { { \boldsymbol{\hat h}}}+ { \frac 1 2 \,}\left ( ( { \boldsymbol{r}}^{\mathsf{t}}{{\boldsymbol{\lambda^ * } } } ) \odot { \boldsymbol{r}}^{\mathsf{t}}\right ) { \boldsymbol{1 } } \right)\end{aligned}\ ] ] where the latter expression avoids explicitly constructing @xmath56 . we calculate @xmath76 via an ifft on the columns of @xmath77 , and we build @xmath78 by taking the ifft of the columns of @xmath40 . inference on @xmath4 then proceeds in a manner appropriate to the specific form of the function @xmath2 , e.g.  by maximizing @xmath79}$ ] wrt . @xmath4 .    in practice , we find that two to three iterations of solving for @xmath23 given @xmath22 , then @xmath22 given @xmath23 , are sufficient for convergence . we start by asking how well this inference procedure recovers underlying modulators when we know the ground truth . to answer this , we simulated a neuron s spiking response to a stimulus ensemble . we assumed a simple input : the model neuron s expected response to a stimulus of value @xmath80 was described by a smooth tuning function @xmath81 , which we discretized as a length-@xmath82 vector , @xmath4 . we also subjected the model neuron to a slow gain fluctuation ( fig . we set the ground truth for @xmath83 and @xmath84 , and sampled the modulator , @xmath85 , and spikes , @xmath7 , from the generative model , for @xmath31 consecutive , pseudo - random presentations of the stimuli . we then performed complete inference of @xmath4 , @xmath14 , and @xmath86 .    , and applied it to a model neuron responding to a stimulus . from the spiking output ( bottom ) , we inferred @xmath59 , which is overlaid on the top panel . black : posterior mode , @xmath87 ; red : samples from the posterior , @xmath59 . ( b)-(c ) : quality of recovery of @xmath85 , measured as @xmath88 , improves with several factors : increasing the cutoff frequency of the imposed modulators ( abscissae ) ; increasing the standard deviation of the imposed modulator ( ( b ) ; factors of @xmath89 , @xmath90 , @xmath91 , and @xmath92 ) ; and increasing the firing rate ( ( c ) ; factors of @xmath89 , @xmath91 , and @xmath92 . ( d ) the computational cost of computing @xmath93 as a function of @xmath17 ( abscissa , measured via the length of @xmath45 ) , and the number of time windows ( symbols ) . ]    we reasoned that the quality of the modulator estimate would depend on how much data was available to estimate each phase of the modulator , as well as the quality of that data . we tested this in three ways . first , for slow modulations , the posterior mode of the recovered modulator , @xmath87 was very close to the ground truth , @xmath85 ; but when the imposed modulators were too fast , and approached the sampling resolution of the time windows themselves , the fit quality declined . second , when we reduced the magnitude of the fluctuations in @xmath85 , the estimates @xmath87 captured the slower modulations only ( and @xmath25 was more conservative than @xmath84 ) . finally , we observed the same result when we decreased the average firing rate ( fig . these results reflect an important feature of the inference procedure : by maximizing the marginal likelihood of @xmath17 , we learn the fastest timescale of modulation that the data are able to provide evidence for .    the inference on @xmath14 scales as @xmath94 , and is thus constrained by two factors ( fig . first , as the number of observations grows , the fft operations become more costly , regardless of the value of @xmath17 . second , as the number of modulator coefficients ( determined by @xmath17 ) grows , the optimization of @xmath45 becomes more expensive . this cost appears to dominate as the hyperparameter admits higher frequencies . since computation time is always limited , it is necessary to set some upper bound on the maximum length of @xmath45 , and hence on @xmath17 , for each dataset . our experiments suggest that keeping the number of modulator coefficients below about 10002000 is a reasonable goal . this , however , means that any modulations at higher frequencies can not be tractably learned using this algorithm .      even if we are not interested in recovering the modulatory signal per se , including it in the model can yield a substantial improvement in estimates of the input - response parameters , @xmath4 . to demonstrate this , we sampled from a simple generative model for the spiking responses of auditory cortical neurons , based on the generalized linear model ( glm , [ 2 ] ; fig .  3 ) . the auditory stimulus was a dynamic random chord ( drc ) ensemble as described in [ 5 ] . briefly , this is a collection of simultaneously - presented tones ; the levels of each tone were drawn independently every 25 ms from a fixed distribution . we simulated neurons with a fixed set of parameters : a linear spectro - temporal receptive field ( strf ) that was localized in time and frequency , a pointwise exponential nonlinearity , and a spike feedback term that modulated the firing rate for a period of up to 200 ms after every spike . in addition , we added gain modulations of different kinds . we then fitted glms to the simulated spike trains , assuming an alds prior on the strf , and an aldsf prior on the spike history term [ 3 ] . we also added latent modulators to the models . for brevity , we refer to the glms fitted without the latent modulators as p - glms , as the only stochastic source in these models is the conditionally poisson point process , while we refer to glms with the latent modulators as mop - glms , as they additionally have a stochastic modulator process .    in the absence of slow modulations , i.e.  under conditions of stationary gain , the p - glms recovered the ground truth strfs and spike history terms with a high degree of accuracy ( fig . however , when there was either a slowly varying gain ( fig . 4b ) or a slow monotonic decrease in gain over time ( fig . 4c ) , the fitted spike history term for the p - glms included a near - constant positive offset . this artefact reflects the only means the model has to capture a slowly changing gain state : to smooth the last few seconds spike counts as a proxy measure of the modulator signal , and leverage this to change the predicted firing rate in the next time bin . indeed , when we increased the speed of the imposed gain modulations , the estimated spike feedback kernels differed wildly from the ground truth ( fig . in all cases , switching to a mop - glm removed these biases , and recovered more accurate estimates of the spike - feedback kernels .     with and without the latent modulator . ( a ) ground truth receptive field and spike - feedback kernel used to generate spikes according to a glm forward model . ( b)-(d ) top row : modulators applied to simulated neurons ( blue ) ; estimates @xmath87 from the mop - glm model showing excellent recovery ( black / red ) . bottom : comparison of p - glm ( green ) and mop - glm estimates ( black / red ) of spike - history kernels . without accounting for the modulator , the inference on @xmath4 is biased . ]        to test the modulated - poisson model in practice , we fit glms to real spiking data obtained from extracellular recordings of auditory neurons in the primary auditory cortex and midbrain of anesthetized ferrets . the details of the data collection are described in [ 5 , 9 ] . we fitted both p - glms and mop - glms , as per the previous section , to approximately an hour of spiking responses to random chord stimulation from each of 339 recorded neurons . these data were recorded under typical non - stationary physiological conditions ; we note , for instance , that the depth of anesthesia in such preparations is known to vary over time ( though was not quantified here ) . we trained the glms on 80% of the data . we constructed the held - out 20% test set by selecting random 250 ms contiguous snippets from each recording , with a minimum of 250 ms training data between each test snippet . by setting @xmath95 for these snippets , inference on the training data simultaneously yielded predictive distributions on the modulators for the test data . since the test snippets were very short in duration compared with the fastest tractable latent modulator timescale , the values of @xmath14 were almost constant over each test snippet . in particular , we emphasize that while the mop - glms have more fitted parameters than the p - glms , these extra parameters were fit exclusively to the training dataset : we introduced no new latent variables to describe the held - out data .    since ground truth is unknown for these datasets , we simply compared the likelihoods on the test datasets for the p - glm and mop - glm model fits . for all 339 neurons , the mop - glms produced better predictions of the held - out data than the p - glms . the improvement scaled with the amount of non - stationarity estimated in the spike train ( fig . moreover , the model - estimated value of the modulator hyperparameters , @xmath25 , appeared optimal for prediction : when we fixed the modulator time constants to values higher or lower than the learned values , predictions were measurably worse ( fig . 5b ) .    . top left : spike counts . remaining panels show fits of the components of mop - glm to this cell . ( b ) improved predictions on held - out data from 339 units , measured as the likelihood ratio per second between the mop - glm and the p - glm . the difference was greatest for cells with more estimated modulation ( @xmath96 ) . ( c ) median improvement of mop - glm over poisson - glm across the population , when the cutoff frequency was set to a value higher or lower than the learned optimum . this shows the local sensitivity to mis - estimation of @xmath25 . ] we developed a modulated - poisson model , that includes a smooth , latent modulatory signal , which is combined multiplicatively with a stimulus - driven firing rate , as well as an inference procedure for estimating all parameters given noisy neural data . our application of this model to simulated data indicates that the inference recovers an underlying modulator of the neuron s firing rate , so long as this modulator varies on a sufficiently slower time scale than the windows over which spikes are counted . on the other hand , if we exclude the modulator from our models , our simulations show that this can lead to substantial biases in the estimation of stimulus - response parameters . when we apply this model to real data from the auditory midbrain and cortex of the ferret , we find that cross - validated predictions of neural responses improve . we believe that the tools we have developed here offer a principled solution to a long - standing problem in experimental neuroscience : how to build analysis for a non - stationary brain .
Abstract:

Answer: neural responses are highly variable , and some portion of this variability arises from fluctuations in modulatory factors that alter their gain , such as adaptation , attention , arousal , expected or actual reward , emotion , and local metabolic resource availability . regardless of their origin , fluctuations in these signals can confound or bias the inferences that one derives from spiking responses . recent work demonstrates that for sensory neurons , these effects can be captured by a modulated poisson model , whose rate is the product of a stimulus - driven response function and an unknown modulatory signal [ 1 ] . here , we extend this model , by incorporating explicit modulatory elements that are known ( specifically , spike - history dependence , as in previous models [ 2 , 11 ] ) , and by constraining the remaining latent modulatory signals to be smooth in time . we develop inference procedures for fitting the entire model , including hyperparameters , via evidence optimization [ 3 ] , and apply these to simulated data , and to responses of ferret auditory midbrain and cortical neurons to complex sounds . we show that integrating out the latent modulators yields better ( or more readily - interpretable ) receptive field estimates than a standard poisson model . conversely , integrating out the stimulus dependence yields estimates of the slowly - varying latent modulators .


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: advances in technology and infrastructure are delivering the capacity to record signals from brain cells in much greater numbers and at even faster speeds . this deluge of data is central to answering many critical open questions in neuroscience and motivates the continued development of computational approaches to analyze , visualize , and understand large - scale recordings of neural activity . fortunately , the activity of complex networks of neurons can often be described by relatively few distinct patterns ( for instance ,  @xcite ) . identifying these spatial - temporal patterns enables the reduction of complex measurements through projection onto coherent structures , where it is tractable to build dynamical models and apply machine learning tools for pattern analysis . here we introduce dynamic mode decomposition ( dmd ) as a novel approach to explore spatial - temporal patterns in large - scale neural recordings . the method combines well - characterized advantages from two of the most powerful data analytic tools in use today : power spectral analysis in time and principal components analysis ( pca ) in space . measurements of neural activity from tens to hundreds of simultaneously recorded channels are traces in time that probe a network with complex dynamics , and one principled way to make sense of such dynamic networks is with modal decomposition  @xcite . a particularly popular modal decomposition tool is pca , which derives modes ordered by their ability to account for energy or variance in the data  @xcite . pca has already been widely applied in the study of high - dimensional biological systems ; however , it suffers from a few well known drawbacks . in particular , pca is a static technique and does not model temporal dynamics of time - series data explicitly , so it often performs poorly in reproducing dynamic data , such as recordings of neural activity . neural dynamics are well known to be characterized by dynamic oscillations at many frequency bands , which are implicated in a variety of neural functions  @xcite . most tools analyzing the frequency content of a signal are related to the fourier transform , which transforms time - varying signals into a spectrum in the frequency domain . importantly , the power spectrum can be computed efficiently using the fast fourier transform ( fft ) algorithm  @xcite , whose efficient implementation has contributed to its ubiquitous use . one example of a modal decomposition in time that goes beyond the fourier transform is empirical mode decomposition ( emd ) , which computes intrinsic oscillatory modes from time - varying data  @xcite . emd has been used to analyze neural data , including cortical local field potential  @xcite and eeg  @xcite . however , these time - domain transforms are typically applied to individual signals ( see exceptions in @xcite ) and do not support spatial structures . a relatively new modal decomposition method is dmd  @xcite . dmd was developed initially to study experiments and simulations in the fluid mechanics community , where it was introduced to reduce very high - dimensional dynamic data into relatively few coupled spatial - temporal modes . importantly , it has been shown that dmd is related to koopman spectral analysis , motivating its usefulness in characterizing dynamics of nonlinear systems  @xcite . more recently , dmd has been generalized as an eigendecomposition of an approximating linear operator  @xcite , allowing it to be more easily applied to a larger class of datasets .    to demonstrate dmd s applicability to large - scale neural recordings , we analyzed sub - dural electrode array recordings from human subjects in two different contexts . first , we validated the dmd approach to derive sensorimotor maps based on a simple movement task  @xcite . next , we leveraged dmd in combination with machine learning techniques to detect and characterize spindle networks present during sleep ; a method to automatically extract these stereotyped sleep spindle networks had not been described previously in the literature . we show that sleep spindles tended to occur coincidentally in different groups of electrodes at different times  @xcite . these patterns may reflect some underlying anatomical or functional connectivity in the brain , and studying relatively local spindle networks may be a novel way to understand the organization of the brain . our spindle network detection algorithm enables the exploration of sleep spindle networks in a large number of experimental subjects , which will shed light on thalamacortical connections and local cortical networks . the purpose of this work is to describe dmd and its adaptation to the analysis of large - scale neural recordings . for very large datasets whose dimensionality strains typical computing resources , dmd may be readily implemented using routine linear algebra functions to take advantage of cluster computing  @xcite . we suggest that dmd may be useful in understanding spatial - temporal coherent patterns in data of escalating scale in neuroscience , including non - invasive and invasive measurements such as functional mri , meg , neurophysiological recordings with electrode arrays , and optical imaging of neural activity . here we briefly summarize the dmd algorithm  @xcite and then describe a few adaptations useful for its application to large - scale recordings of neural activity .    consider measurements taken from @xmath0 observable locations at times @xmath1 , where we arrange measurements at snapshot @xmath2 to make a column vector @xmath3 . for instance , these measurements may be voltages from @xmath0 channels of an electrode array sampled every @xmath4 . gathering measurements from @xmath5 points in time , we may construct two @xmath6 raw data matrices : @xmath7 note that @xmath8 and @xmath9 contain largely overlapping data , differing in that columns of @xmath9 are shifted one @xmath4 from those in @xmath8 . let us suppose that there is an unknown linear operator @xmath10 such that @xmath11 the _ dynamic mode decomposition _ of the data matrix pair @xmath8 and @xmath9 is given by the eigendecomposition of @xmath10 . we may think of @xmath10 as describing a high - dimensional linear regression of the nonlinear dynamics which relate @xmath8 to @xmath9 .    to obtain an approximation of @xmath10 , one approach is to use the singular value decomposition ( svd ) of the data matrix @xmath12 to compute its pseudoinverse : @xmath13 however , if @xmath0 is large , computing the eigendecomposition of the @xmath14 matrix @xmath10 may be prohibitively expensive . instead , the following procedure allows the dmd modes and eigenvalues to be calculated without direct computation of @xmath10 . * dmd algorithm * @xcite    1 . compute the svd of our first data matrix , @xmath12 . we may now make the substitution into equation and write @xmath15 . 2 .   define @xmath16 . 3 .   compute the eigendecomposition of @xmath17 , @xmath18 where @xmath19 is the matrix of eigenvectors , and @xmath20 is the diagonal matrix of eigenvalues . each eigenvalue @xmath21 is a dmd eigenvalue . 4 .   compute the dmd modes , @xmath22 each column of @xmath23 is a dmd mode @xmath24 corresponding to eigenvalue @xmath21 .           finally , we may write an approximation of the observed data as a simple dynamic model @xmath25 , @xmath26 where @xmath27 is set of weights such that @xmath28 and can be solved as a pseudoinverse problem . * figure  [ fig : dmd ] * illustrates the separation of spatial modes @xmath23 from their temporal dynamics @xmath20 in the reconstructed multi - channel time series electrocorticography ( ecog ) data . a dmd mode @xmath24 is a vector that has the same dimension as @xmath29 ; its magnitude represents spatial correlations between the @xmath0 observable locations . the eigenvalue @xmath21 corresponds to the temporal dynamics of the spatial mode @xmath24 . specifically , its rate of growth / decay and frequency of oscillation are reflected in the magnitude and phase components of @xmath21 , respectively ( * fig . [ fig : dmdspectrum]a ,  b * ) . the key feature of the above algorithm is that it decomposes data , arranged as in equation , into a set of _ coupled spatial - temporal modes_. note that @xmath30 has , in general , non - zero imaginary components ; if the raw data @xmath8 is strictly real valued , then we may consider only the real component of @xmath30 . a few general properties of dmd are interesting to note . the data @xmath29 may be real or complex valued ; in the case of recordings from electrode arrays , we will proceed assuming @xmath29 are real valued voltage measurements . further , the decomposition is unique  @xcite , and it is also possible to compute the dmd of non - uniformly sampled data  @xcite . it is convenient to think of this spatial - temporal decomposition as a hybrid of static mode extraction by principal components analysis ( pca ) in the spatial domain and spectral transformation in the frequency domain ( fourier transform ) . when the high - dimensional dynamics of the data has some underlying low - dimensional structure , it may be possible to capture the key dynamics of the data with relatively few dmd modes . dmd modes are computed in the basis of @xmath31 by an eigendecomposition of @xmath32 , where @xmath31 is taken from a svd of the data matrix @xmath8 . it follows that the dmd algorithm obtains exactly as many dmd modes as the number of singular values in this svd , within numerical precision .    to obtain a truncated dmd with @xmath33 modes , it is possible to use instead a truncated svd basis , keeping only the @xmath33 largest singular values . let @xmath34 be the first @xmath33 columns of @xmath31 , let @xmath35 be the upper left @xmath36 matrix of @xmath37 , and let @xmath38 be the first @xmath33 columns of @xmath39 . this truncated svd basis can be used in place of the full versions in steps 24 in the dmd algorithm ; @xmath40 is now a @xmath36 matrix . note that these low - rank dmd modes and eigenvalues are not a subset of their standard dmd counterparts , and in some cases , they can be quite different from each other . the estimation of a truncation dimensionality @xmath33 to best capture signal and reject noise in a dataset is the subjective of an extensive literature ( for instance ,  @xcite ) . a simplistic heuristic is to look at the singular values on the diagonal of @xmath37 . we picked @xmath33 such that the sum of the first @xmath33 singular values accounts for over 95% of the variance in the data ; for 300 msec windows from the human ecog records of around 100 electrodes sampled at 200 samples / sec , we chose @xmath41 modes . * figure  [ fig : dmd]c * shows the error of the reconstruction decreases as @xmath33 increases , and an examination of where this improvement plateaus also helps inform the appropriate truncation . visualized on the complex plane , relative to the unit circle . ( * b * ) an alternate visualization of the eigenvalues , where the imaginary component of @xmath42 is proportional to the frequency of oscillation in cycles / sec . ( * c * ) the dmd power spectrum , which qualitatively resembles the fft power spectrum in ( * d * ) . the fft spectrum was computed independent for every recording channel ( gray ) and its average is shown in black . crucially , unlike the fft spectrum , each point in the dmd spectrum corresponds to a specific spatial mode.,scaledwidth=45.0% ]      the application of the dmd algorithm to arrays of large - scale recordings of neuronal activity may require an adaptation to the normal procedure . dmd was originally used in the study of very large fluid flow fields , where typically @xmath43 . in contrast , in neuroscience we are often interested in electrode arrays that have tens of channels sampled at hundreds of samples per second , so for a data matrix @xmath8 over a one - second window of data , @xmath44 . the economy svd of @xmath8 produces @xmath45 non - zero singular values , where @xmath45 is the smaller of @xmath0 and @xmath46 . this property restricts the maximum number of dmd modes and eigenvalues to @xmath0 , which is often too few to fully capture the dynamics over @xmath46 snapshots in time . the solution to this rank mismatch is to construct modified versions of the data matrices , appending to the snapshot measurements with time - shifted versions of themselves , thus augmenting the number of channels to be @xmath47 . the augmented data matrices is inspired by the hankel matrix constructed in the eigenvalue realization algorithm ( era )  @xcite . specifically , we construct a new augmented data matrix @xmath48 , @xmath49 and similarly for @xmath50 . dmd is then applied as described above using @xmath48 and @xmath50 instead of @xmath8 and @xmath9 .    for our multichannel recordings , we chose the smallest integer @xmath51 so that @xmath52 ; this degree of stacking provided enough dmd modes to capture the observed dynamics . the resultant augmented dmd modes now vectors of @xmath53 elements ; generally , the first @xmath0 elements of each mode are used in subsequent analyses . the distribution of dmd eigenvalues @xmath54 may be visualized relative to the unit circle on the complex plane , as in * figure  [ fig : dmdspectrum]a*. as we can see from equation  , the magnitude of the eigenvalues relative to the unit circle indicates whether the corresponding mode is growing or decaying . eigenvalues exactly on the unit circle are stable modes . the phase of each eigenvalue translates to the frequency of oscillation . specifically , @xmath55 gives the frequency of oscillation of mode @xmath24 in units of cycles per second ( * figure  [ fig : dmdspectrum]c * ) . the definition of dmd as the eigendecomposition of @xmath10 in equation   allows for arbitrary scaling of the dmd modes . the algorithm outlined above produces modes with unit norm . to use the magnitude of these modes in a way similar to the power spectrum for selecting modes with high energy , we must choose an appropriate scaling . one useful scaling is to multiply each mode by the corresponding singular value from the svd . we modified step 3 of the dmd algorithm to scale the modes by energy as follows .    1 . compute the eigendecomposition of @xmath56 , @xmath57 where @xmath58 is the matrix of eigenvectors and @xmath20 is the diagonal matrix of eigenvalues . the eigenvalues of @xmath59 are identical to the eigenvalues of @xmath17 , and @xmath60 are eigenvectors of @xmath17 that we will use in step 4 . these eigenvectors are scaled by @xmath61 so do not have unit norm .    to visualize the dmd spectrum , we plot the `` power '' of each mode @xmath62 against its frequency of oscillation @xmath63 . the power of @xmath62 is defined as the square of its vector magnitude : @xmath64    * figure  [ fig : dmdspectrum]c * illustrates the intuition that the dmd spectrum qualitatively resembles the power spectrum computed by the fft for a 0.5 sec window of ecog data , shown for comparison in * figure  [ fig : dmdspectrum]d*. despite this resemblance , it is important to remember that the power spectrum is computed independently for every channel of the recording , whereas every point in the dmd spectrum corresponds to a specific spatial mode across all channels .          to demonstrate the application of dmd to large - scale time - series data , we analyzed datasets recorded from sub - dural electrode arrays implanted in two patients monitored for seizure loci localization . to validate the dmd approach to spatial - temporal pattern analysis , we derived sensorimotor maps based on a simple motor repetition task where the subjects were instructed to move either their tongue or the hand contralateral to the implanted electrode array . this task was previously analyzed for a large cohort of patients , and a spectral analysis of each channel revealed consistent sites in sensorimotor cortex whose power changed specifically for each movement  @xcite . we performed a related analysis based on the dmd spectrum and derived motor maps of tongue and hand movements that are closely consistent with the previously described results  @xcite . dmd spectra were computed for each epoch of the motor screen , and dmd modes within a low frequency band ( 832 hz ) and a high frequency band ( 76100 hz ) were averaged to derive mean modes in each band . next the baseline low frequency and high frequency mean modes were subtracted from the movement epochs to produce the frequency - dependent sensorimotor maps in * figure  [ fig : motor_validation]*.    in the low frequency band , there was a generalized decrease in correlation across sensorimotor cortex in both the tongue and hand movement epochs . these decreases are visualized by decreases in relative dmd mode magnitude across the most posterior columns of the electrode array ( * figure  [ fig : motor_validation]a , b * ) . in the high frequency band , we found relatively local groups of electrodes within sensorimotor cortex where dmd mode amplitude increased selectively for tongue and hand movement . the foci for hand movement were more dorsal than the tongue movement sites .          in a novel application of dmd , we developed methods to extract and identify sleep spindle networks in human ecog recordings . sleep spindles are distinctive , transient 1215 hz oscillations that are characteristic of non - rapid eye movement ( nrem ) sleep , and their presence is commonly used to classify sleep stages  @xcite . spindles have been the subject of scientific investigation since the early 1930 s and their mechanisms of generation are now quite well understood  @xcite . in brief , sleep spindles oscillations are generated in the thalamus and their electrographic signature arises from thalamacortical connections . even so , the role these transient oscillatory events play in brain function remains unclear . a line of evidence suggests that sleep spindles facilitate the consolidation of recently acquired memories  @xcite . this hypothesis is supported by recent work demonstrating that sleep spindles can be locally , rather than globally , synchronous events  @xcite . historically , sleep spindles have been scored by experts on single channels of eeg . spindles vary in amplitude , duration , central frequency , and often concur with other regularly observed sleep features . automated detection algorithms typically rely on band - pass filtering the signal followed by an amplitude threshold on some moving average window ( for instance  @xcite ) . recently , a number of these algorithms were evaluated against experts and crowd - sourced spindle detectors  @xcite . it is important to point out that all of these approaches only address spindle detection on single electrodes , and reliable identification of networks of electrodes showing synchronous spindle activity has remained a challenge . the structure of sleep spindle networks may reveal insights about thalamacortical connections and other neural circuitry , which motivates development of more sophisticated methods for their detection and characterization . our approach to spindle network extraction is based on the dmd spectra of windowed ecog data ( * figure  [ fig : spindle_methods ] * ) . dmd modes corresponding to larger than expected power in the spindle band ( 1117  hz ) were collected in a library , whose elements were then clustered to determine stereotypes of spindle networks in the recording . each spindle network stereotype represents strength of spatial correlations between electrodes and may be visualized on a grid of electrode locations . we applied our spindle network extraction algorithm to ecog recorded during non - rem sleep from sub - dural electrodes implanted over the temporal lobe of two human subjects . we found distinct stereotypes of spindle networks , whose spatial distributions are visualized for in * figure  [ fig : spindlestereotypes]*. subject a had 5 distinct spindle networks over a 48-channel array ; subject b had 4 distinct spindle networks over a 64-channel array . in both subjects , we found both relatively local and more spatially distributed spindle networks . in addition to separation of spindle activity to distinct locations on the cortex , spindle networks were also distinct from each other by their characteristic frequencies of oscillation . these frequencies were not used in the clustering . in this work , we presented the novel adaption of a modal decomposition technique known as dynamic mode decomposition ( dmd ) to analyze and visualize large - scale neural recordings . such neural recordings are often characterized by coherent patterns of activity in space ( across many channels ) at multiple temporal frequencies . we showed how dmd can be used to extract these coherent patterns by decomposing the data into a low - dimensional representation in both space and time . this extraction was validated on a simple motor task where selective and separable regions of sensorimotor cortex were identified . next , we presented a novel method to detect and analyze sleep spindle networks from large - scale human ecog recordings ; automated approaches to characterize these stereotyped spindle networks had not been previously reported , and the high - dimensionality of the dataset makes manual scoring by experts an infeasible task . we showed that our method reliably detected spindle networks , which are correlated groups of electrodes that showed significantly power in the spindle band ( between 11 and 17 hz ) . further , we found multiple stereotypes of spindle networks for two different subjects . some of these spindle networks were fairly localized on the cortex , but some revealed correlations across physically non - adjacent parts of cortex . these sleep spindle networks are discovered independently of an explicit behavior and may represent functionally connected cortical areas . the automated identification of spindle networks and their classification into distinct stereotypes allows us to analyze the duration , frequency , and relative timing of potentially independent spindle events . in addition , we are now able to compare their timing relative to other events common in sleep ( e.g. , k - complexes ) and relative to pre - epileptic indicators . our method enables these analyses to be performed across many subjects , and its computation scales favorably with increasing numbers of channels in the electrode array recordings . dimensionality reduction is a useful concept in building meaningful models based on dynamics of neuronal networks because there exists low - dimensional structures in large - scale data . ideas from compressive sensing further suggest that such models may be accessible even from limited data , when the system is known to be sufficiently sparse  @xcite . extensions of dmd that exploit underlying data sparsity ( including  @xcite ) have potential to expand the usefulness of the framework to a larger class of incomplete measurements with improved robustness . in contrast to other static modal decomposition techniques , dmd provides not only modes , but also a relatively low - dimensional , efficient linear model for how the most dynamically important modes evolve in time . in other words , the dmd approximation of the dataset as shown in * figure  [ fig : dmd ] * and expressed by equation   is also a prediction of the system s dynamic trajectory . such dynamic models of high - dimensional dynamic data are _ equation - free _ , in the sense that they are entirely data - driven and do not rely on a set of governing equations . model predictions do not typically hold for long term ; however , even short - term dmd predictions can inform design of feedback control in complex , nonlinear systems  @xcite . we propose that dmd is generally useful for the analysis , understanding , and visualization of large - scale neural recordings . in particular , we are exploring dmd - based methods to characterize network - level responses across multiple brain areas to complex stimulus inputs . we envision this spatial - temporal modal decomposition may be applied to a variety of modes of measurements , including ecog , meg , functional mri , calcium imaging , lfp , and spike rates of a large collection of single units . all subjects were patients undergoing long - term electrocorticography ( ecog ) monitoring in preparation for surgical treatment of intractable epilepsy . data were collected from two subjects ( female subjects a and b , ages 29 and 11 respectively ) with subdural platinum electrode arrays ( ad - tech , racine , wi ) . electrodes had a 2.3 mm exposed surface diameter and were spaced at 1 cm . subjects were patients at the university of washington and gave informed consent according to the protocol approved by the institutional review board of that institution . the ecog signals were recorded by the xltek ( natus medical incorporated , san carlos , california ) clinical monitoring system at a sampling rate of 500 or 2000hz . the standard system parameters impose a high - pass filter at about 0.1hz . for the motor mapping , recordings were high pass filtered above 6 hz and down sampled to 100 samples / sec ; the total length of the motor screen recordings were approximately 4 minutes . for spindle network extraction , recordings were bandpass filtered between 6 and 80 hz , and down sampled at 200 samples / sec ; the total length of recording of a sleep epoch from each subject was approximately 20 to 40 minutes . subject a had an electrode array with 64 channels ; subject b had an electrode array with 48 channels . the simple motor screen task was performed as described previously in  @xcite . briefly , the patient was instructed either not move ( baseline ) , move their tongue , or move the hand contralateral to the implanted electrode array . twenty ( 20 ) trials of each movement were repeated in pseudo - random order with instructions to not move in between ; each instruction lasted three ( 3 ) seconds . the data in this analysis was from subject a.      non - rem sleep epochs were identified by eye using the increased power in the delta band ( 16hz ) and verified by the presence of k - complexes and spindles . for every sleep epoch , all electrode traces were normalized by z - scoring with respect to the amplitude in the 550hz range . this frequency range was chosen to eliminate the variable amplitude effects of k - complexes , which have a maximum amplitude in medial - frontal regions 28 . to map cortical areas whose activity were modified during movement of the tongue and hands in a frequency - dependent way , we divided the electrode array recording into baseline ( no instructed movement ) , tongue movement , and hand movement trials . the middle 2 seconds of each trial ( between 500 and 2500 msec from the beginning of the instruction ) where used in the motor mapping analysis . in each trial , the 2 second recording window over all channels was decomposed by dmd ; the time series data were augmented by stacking 10 times as described in the main text to increase the rank of the data matrix , and the resultant basis was truncated using @xmath65 so that the result spectrum contained only 200 modes . the dmd spectrum was examined to extract spatial modes in two frequency ranges , a low frequency band ( 832 hz ) and a high frequency band ( 75100 hz ) . all the absolute value of dmd modes in each frequency range were averaged to extract the mean mode magnitude . next , for both the low and high frequency bands , we compared the mean mode across all trials for hand and tongue movements by subtraction of the mean baseline modes . the relative changes in these mean mode magnitudes were reshaped and visualized at the electrodes implanted locations in * figure  3*.      to detect the presence of spindle networks , we first separated the ecog recordings into 300 msec windows in time , decomposed the windowed data using dmd , then used the dmd spectrum to identify modes that represent a significant increase in the 1117 hz frequency band characteristic of spindle activity . we used overlapping windows , sliding 100 msec between consecutive windows . the dmd power spectrum allows us to formulate a principled criterion to identify the presence of power in the spindle band . we identified power between 11 and 17 hz , above what would have been expected from the power spectral density of ecog recordings . next , dmd modes corresponding to excess power in the spindle band were collected over the entire recording epoch and stereotypes of spindle networks were discovered by a gaussian mixtures model . it has been well described that the power spectral density of recordings from the brain follows a @xmath66 distribution , where @xmath67 is a positive scalar  @xcite . we used this observation to fit the @xmath67 of the dmd spectrum , excluding power at frequencies below 18 hz and above 57 hz . this @xmath66 distribution was fit over the cumulative dmd spectra of each epoch of a subject s recording ( usually about an hour ) using robust regression  @xcite , which rejected outliers due to sporadic electrical noise in the recordings . windows including presumptive epileptiform activity were rejected base on a generalized elevation in power over all frequencies . for each window , a dmd mode @xmath62 was considered part of a spindle network if and only if its power significantly exceeded the upper 99% confidence interval of the @xmath66 fit . further , to reduce the incidence of spurious identification of spindle networks , significant power in the spindle band must be detected for three consecutive overlapping windows .      from every window of data , dmd modes that passed the spindle detection criteria were gathered to form a library of spindle networks @xmath68 , and elements of this library were clustered into distinct types of spindle networks . specifically , we constructed a library of dmd modes @xmath68 , @xmath69 for purposes of clustering , we considered only the absolute value of dmd modes ; each mode was normalized to unit length . clusters were determined in @xmath33-dimensional principal components space , using the projections of each column of @xmath70 onto the first @xmath33 principal components of @xmath70 : @xmath71 where @xmath72 is the transpose of the first @xmath33 columns of @xmath73 . next we used a gaussian mixtures model to group columns of @xmath74 as points in @xmath75 into @xmath2 clusters  @xcite . since this is an unsupervised approach , we selected the appropriate value of @xmath2 in the model using the bayes information criterion ( bic ) , a statistical metric to guide comparison of models with different numbers of parameters that punishes overfitting . briefly , a model with a smaller bic is more parsimonious with the available data than a model with a larger bic . we evaluated descriptions of @xmath70 using a gaussian mixtures model in @xmath33 dimensions using @xmath2 and systematically varied @xmath33 from 315 and varied @xmath2 from 210 . the number of stereotyped spindle networks @xmath2 was chosen to minimize bic of this family of gaussian mixtures model . for the two subjects we tested , the median @xmath2 for which bic was minimized was 4 and 5 clusters for subjects a and b , respectively . we chose to fit the gaussian mixtures model with @xmath76 reduced dimensions , because increasing @xmath33 beyond @xmath77 did not significantly change the assignment of clusters . we thank s. l. brunton and j. l. proctor for comments on the manuscript , j. p. dyhr and t. l. daniel for helpful discussions , and t. blakely for collecting the dataset used for the sensorimotor mapping . this research was supported by national institutes of health grant r01 ns065186 - 01 and award number eec-1028725 from the national science foundation . b.w.b . and l.a.j . conceived of the project ; l.a.j . collected the sleep data . b.w.b . designed the analyses and implemented the algorithms , with contributions from l.a.j . j.g.o . and j.n.k . supervised the project . b.w.b . wrote the manuscript , with input from all authors
Abstract:

Answer: there is a broad need in the neuroscience community to understand and visualize large - scale recordings of neural activity , big data acquired by tens or hundreds of electrodes simultaneously recording dynamic brain activity over minutes to hours . such dynamic datasets are characterized by coherent patterns across both space and time , yet existing computational methods are typically restricted to analysis either in space or in time separately . here we report the adaptation of dynamic mode decomposition ( dmd ) , an algorithm originally developed for the study of fluid physics , to large - scale neuronal recordings . dmd is a modal decomposition algorithm that describes high - dimensional dynamic data using coupled spatial - temporal modes ; the resulting analysis combines key features of performing principal components analysis ( pca ) in space and power spectral analysis in time . the algorithm scales easily to very large numbers of simultaneously acquired measurements . we validated the dmd approach on sub - dural electrode array recordings from human subjects performing a known motor activation task . next , we leveraged dmd in combination with machine learning to develop a novel method to extract sleep spindle networks from the same subjects . we suggest that dmd is generally applicable as a powerful method in the analysis and understanding of large - scale recordings of neural activity .


Instruction: Write an abstract for the following acadamic paper.

Input:
Paper: we have recorded the flight of a fly during take off and landing using digital high speed photography . it is shown that the dynamics of flexible wings are different for these procedures . during this observation fly flew freely in a big box and it was not tethered .
Abstract: in this fluid dynamics video , we demonstrated take off and landing of a fly . the deformation of wings is in focus in this video .

Paper: self - assembly of nanoparticles is an important tool in nanotechnology , and an active area of interdisciplinary research , with applications spanning a variety of fields such as optics , materials science , electronics , and nanomedicine @xcite . there are a multitude of experimental techniques that take advantage of the natural tendency of particles to self - assembly due to chemical bonds @xcite . one of the most intuitive and cost - effective methods for creating thin films , for example , is layer - by - layer self - assembly , also known as ionic self - assembly of monolayers , or isam . it was first introduced by iler @xcite and later used in the creation of antireflective coatings @xcite . to create the thin films , layers of cations and anions are deposited by alternately dipping the substrate in aqueous solutions of appropriate ions . the same principle is used for other types of applications , such as the creation of thin films using nanotubes @xcite , and drug attachment and encapsulation of nanoparticles using synthetic dendrimers @xcite . the main goal of our paper is to present a stochastic statistical physics model that encapsulates the essential features of the self - assembly of ionic nanoparticles from a colloidal suspension onto a glass substrate . the model is validated by experiments conducted in our lab that show the effect of the concentration of the colloidal suspension on the nanoparticle coverage of a glass substrate . analytical and computational models of sequential adsorption have proven successful in describing diverse physical systems ranging from surface deposition and chemisorption on crystal surfaces @xcite to epidemic problems @xcite and voting behavior @xcite . the dynamics of nanoparticle deposition is another application of such models . it is currently an active area of research in nanotechnology studies @xcite which addresses interesting open questions on the theoretical front @xcite . two classes of models that have been particularly successful are _ random sequential adsorption ( rsa ) @xcite , in which particles are adsorbed / deposited at a fixed rate at random unoccupied sites on a grid , and _ cooperative sequential adsorption ( csa ) @xcite , in which adsorption rates depend upon the occupation of neighboring sites . one - dimensional sequential adsorption models have been studied thoroughly in different physical contexts @xcite , but adsorption in two dimensions is less understood . there are many computational adsorption models @xcite , but few analytical solutions have been developed for the general two - dimensional case . recently , analytical results have been reported for the random sequential process @xcite and reaction - diffusion processes on cayley trees and bethe lattices @xcite . adding the possibility of particle detachment , or _ evaporation _ , to such models brings additional complications . one of the standard tools used to study these systems , the _ empty - interval method _ @xcite , fails when evaporation is considered . evaporation has been treated analytically in a few studies of one - dimensional systems using a quantum mechanical approach @xcite . _ _ we will describe the isam process using a _ stochastic cooperative sequential adsorption with evaporation _ ( csae ) model on two - dimensional lattices . these methods are ideally suited for modeling isam since the deposition process of nanoparticles is stochastic and the deposited nanoparticles are electrically charged , as are the substrate deposition sites , suggesting a cooperative sequential adsorption model with deposition rates dependent on nearest - neighbor site occupation . the general csae model that we utilize leads to analytical solutions for the particle density . in order to validate the model , we conducted an experimental study of the effect of the colloidal suspension concentration on the steady state coverage density of the glass substrate . the analytical results are compared to the experimental data and to monte carlo computer simulations . we found excellent agreement between the three methods .    in the following section of this paper , we describe the isam process and our experimental results for the concentration dependence of the coverage density . in section [ theory ] , we present the analytical model and its mean field solution . section [ comparison ] is dedicated to a comparison between experiment , theory , and the monte carlo simulations . we summarize our results and discuss some open questions in section [ conclusion ] . the use of ionic self - assembled monolayers allows detailed structural control of materials at the nanoscale , combined with ease of manufacturing and low cost . the isam process allows the deposition of alternating layers of cations and anions by dipping a substrate in aqueous solutions of the appropriate ions , as illustrated in fig . [ fig1 ] . , width=325 ]    because it is a dipping process , any exposed surface is homogeneously coated , allowing highly uniform , conformal coatings on irregular shapes . the basic building block for the film is a cation / anion bilayer , which may consist of either two polyelectrolytes ( a polycation and a polyanion ) , a polyelectrolyte and a nanoparticle , or two different nanoparticles . the thickness of a bilayer is a function of the diameter of the nanoparticle and the packing of the particles from layer to layer . the optical properties of the resulting film can be tuned by the choice of nanoparticles and by the number of bilayers deposited . a comprehensive review of the technique and its applications can be found in @xcite . although there are numerous studies on the subject of thin - film characterization @xcite , the goal of creating thin films with a graded index of refraction is still outstanding . a study published by yancey et al . @xcite shows that the coverage of the substrate plays an important role in tuning the index of refraction of the thin film . the maxwell - garnett approximation @xcite , in fact , predicts that the index of refraction depends on surface coverage .    in our experiments we deposited negatively charged spherical silica nanoparticles of nominal 40 - 50 nm diameter on negatively charged glass slides using poly(diallyldimethylammonium chloride ) ( pdda ) as polycation . the silica nanoparticles ( snowtex st-20l from nissan chemical ) were in a colloidal suspension at stable @xmath0 and room temperature @xmath1 . the glass slides were cleaned under sonication , in three successive twenty - minute steps , with labtone detergent , 1n sodium hydroxide solution , and deionized water , and then dried with flowing nitrogen gas . the dipping time was ten minutes for each bilayer . we varied the concentration of the silica suspension by diluting it with deionized water . we examined the nanoparticle coverage of the substrate using sem micrographs , in which deposited particles appear as light regions on a dark background . a sample sem micrograph is shown in fig . [ fig2 ] .    , width=325 ]    we processed two single - bilayer micrographs for each concentration data point . using an automated pixel - counting method we determined the average coverage of light pixels , representing presence of deposited particles . the experimental data is presented in section [ comparison ] , alongside and compared to the analytical solution . we model the glass slide uniformly covered by the pdda polymer as a finite two - dimensional lattice with @xmath2 total sites . we consider the silica nanoparticles as charged monomers that attach to and detach from the lattice sites . we define an occupation number @xmath3 for an empty site and @xmath4 for an occupied site . our model considers both evaporation of monomers and deposition of monomers with rates dependent on the number of occupied neighbors . we define the following transition rate for the particle occupation : @xmath5 the first term in the transition rate is the evaporation term : if a particle is present , it will evaporate with probability @xmath6 . the second term describes the deposition of monomers . if the lattice cell is empty , a monomer will attach with a rate equal to @xmath7 , where @xmath8 is the number of occupied nearest neighbors . when @xmath9 ( no nearest neighbors present ) , the intrinsic deposition rate is @xmath10 . the rate @xmath11 attenuates this intrinsic deposition rate based on the number of occupied nearest neighbors . given this transition rate , the number of particles on the lattice changes according to the following equation : @xmath12      in order to find the equation that governs the time dependence of the overall particle density , we take the ensemble average of @xmath13 : @xmath14 since this equation contains higher order correlations , we employ the mean field technique , which allows for the correlations to be approximated as : @xmath15 using this approximation , we arrive at the following equation : @xmath16 where @xmath17 .    in fig . [ fig2 ] , we see that the size of a particle is much less than the size of the slide . as such , edge effects due to the finite size of the slide should be negligible in the interior of the slide . additionally , we see a uniform distribution of particles on the slide . from these two observations , we find that the coverage density is independent of the location on the slide . therefore , the average site density @xmath18 is the same as the overall average coverage density @xmath19 : @xmath20 using this information leads to a rate equation for the particle density : @xmath21    for the steady state , @xmath22 , this is a self - consistent transcendental equation that can be solved numerically : @xmath23 eq . can be solved numerically using standard software such as maple or mathematica . in fig . [ fig3 ] , we present the time dependent particle density for three different values of @xmath11 ( 0.1 , 0.5 , and 0.9 ) at a fixed @xmath24 and @xmath25 .     with @xmath24 and @xmath25 . the three values of @xmath11 shown are ( black , dashed line ) 0.1 , ( red , dot - dashed line ) 0.5 , and ( green , solid line ) 0.9.[fig3],width=325 ]    for all three @xmath11 s the shape of these curves is the same , but the steady state values of the particle density are drastically different . a more in - depth analysis of the steady state coverage is required and will be presented in section [ comparison ] , in connection with its dependence on concentration .    from a theoretical point of view , it is worth noting that eq . can be generalized for any coordination number @xmath26 , as :    @xmath27    the solution of this mean field equation can be obtained for a generic geometry with an effective coordination ( per site ) @xmath26 . such a solution would show that a different coordination number ( in the mean field limit ) just corresponds to a different effective @xmath11 , i.e. , the parameter would be @xmath28 rather than @xmath11 . because we are comparing our analytical results to a very specific experiment , we discus in this article just the particular case of a square lattice of coordination number @xmath29 and @xmath30 , to simulate electrostatic screening . the case of @xmath31 corresponds to a physical situation in which the presence of occupied neighbors favors adsorption . this choice can apply to a voter- or an epidemic - type model . the numerical solutions for @xmath31 are very similar in shape to the ones presented in fig . [ fig3 ] for @xmath30 . the main difference is the increased rate at which the lattice fills up to @xmath32 coverage . the cooperative aspects of the model disappear for @xmath33 ; it becomes a langmuir model @xcite . we arrive at the same self - consistent transcendental equation for the particle density in the steady state if we approach the problem in the context of the ising model on a two - dimensional lattice . the hamiltonian associated with the two - dimensional ising model of a system of @xmath2 spins in an external field is : @xmath34    the first term describes the interactions between nearest - neighbor spins , and the second term expresses the interaction between each spin and an external magnetic field @xmath35 . the spin numbers are @xmath36 for a spin up , and @xmath37 for for a spin down . we can map our model onto an equivalent spin model , in which the spin numbers are related to the occupation numbers @xmath13 , @xmath38 . using the detailed balance condition , we can solve for the coupling constants in terms of the defined attachment and detachment rates @xmath10 , @xmath11 , and @xmath6 : @xmath39    the equation derived for the magnetization of a system of spins in an external magnetic field in the mean field approximation is @xcite : @xmath40 with the coupling constants @xmath41 and @xmath42 found above , and @xmath43 , we arrive at a transcendental equation identical to eq .  . we perform monte carlo simulations on a two - dimensional square lattice in order to investigate the dynamics of the csae process and evaluate the steady state solutions under various parameter regimes . our simulations utilize a @xmath44 two - dimensional grid onto which particles are both deposited at empty sites and evaporated from filled sites . in order to minimize edge effects , data is recorded for only the @xmath45 matrix at the center of the larger lattice . the interior of the lattice is chosen instead of periodic boundary conditions ; this choice mimics what is done experimentally . only a small portion of the glass slide is analyzed , which is typically far away from the edges of the slide . the edges in the simulations have a higher average site density due to the reduced number of neighbors . additionally , the average site density near the edges in the simulation decays rapidly to the average bulk density as shown in fig . [ fig - edge ] for the left edge . similar results are seen for the other edges . edge effects were not seen in the sem micrographs , which is another reason we only consider the interior of the lattice . lattice with @xmath24 , @xmath25 , and @xmath46.[fig - edge],width=325 ]    particles are deposited at empty cells with the rate @xmath47 , where @xmath48 represents the sum of occupied neighboring sites . particles evaporate from filled cells with the rate @xmath6 , which is independent of the state of neighboring sites . to update a site , a random site is chosen . if the site is occupied , the particle will evaporate with rate @xmath6 . if the site is empty , then it will become occupied with rate @xmath49 . to make the simulation reach the steady state more efficiently , we only consider updates that change the configuration of the lattice . a different reaction ( evaporation , adsorption with no neighbors , adsorption with one neighbor , etc . ) is randomly chosen . we weight the choice of each reaction by the number of sites which would allow this reaction multiplied by the rate of the reaction . once a reaction is chosen , a site with the given reaction is randomly chosen to change . starting with an empty lattice , we allow the system to reach steady state by waiting @xmath50 site updates . we then average the particle density at steady state over 100 realizations of the system .    for physical systems with repulsion between particles , the rate of deposition decreases when neighboring sites are occupied . we model this situation by choosing @xmath11 to be between zero and one for all simulations . a simple rescaling of time in eq .   shows that the ratio of @xmath10 to @xmath6 controls the steady state density . therefore , we set @xmath25 and vary @xmath6 without loss of generality .    as seen in fig .  [ fig5 ] , the mean field result is in excellent agreement with the simulation results    and captures the relevant dynamics of this model for @xmath51 . additionally , we see in fig . [ fig5b ] that the density as a function of @xmath11 could be approximated by a linear function for @xmath51 . at smaller values of @xmath11 , the mean field theory fails to agree with the simulation due to stronger spatial correlation , which the theory neglects . since the simulation models an isam , we now look at connecting this linear dependence to a similar one found in the experimental data . our csae model considers a simple case of deposition and evaporation of monomers and yields a transcendental equation for the particle density of the steady state that can be solved numerically . for the proposed model , the equation associated with the steady state is re - written here for convenience : @xmath52    the experimental data shows a linear dependence between the particle density and the inverse of concentration . using our model , we found a relationship between the concentration of the nanoparticle suspension and the theoretical probability rate @xmath11 . in particular , we found numerical solutions for the particle density @xmath53 in eq .   for fixed @xmath25 and @xmath24 , which match the experimental data shown in fig . although equation is a nonlinear function , a linear approximation matches the numerical solution well , which is also shown in fig . [ fig6 ] .    ; ii ) experiment ( blue squares ) , @xmath54 with @xmath55 . the theoretical fit is drawn from the numerical solutions to eq . .[fig6],width=325 ]    from this comparison , we conclude that , according to our model , for constant temperature , the concentration of the nanoparticle solution is a function of @xmath11 : @xmath56 for the chosen values of @xmath25 , and @xmath24 , or for any values of @xmath10 and @xmath6 for which the ratio @xmath57    we linearize equation by performing a taylor expansion about @xmath33 . @xmath58 where we only keep the linear term . using @xmath59 , we obtain the following result : @xmath60\ ] ] as long as this ratio is equal to @xmath61 , the intercept of the theoretical and experimental lines is identical , and the difference between the two slopes is minimal .    for the model presented in this paper , we also explored the case of the detachment rate being dependent on the number of neighbors , @xmath62 . in the end , it seemed an unnecessary complication to consider such dependence , because the results showed that the model can be recast in terms of the ratio @xmath63 .    from an experimental point of view , this cooperative sequential adsorption model with evaporation can lead to interesting applications . the ability to predict or estimate the steady state coverage makes possible the prediction of the index of refraction @xcite , which is dependent on the overall particle density . a graded index of reflection is an outstanding goal in the creation of antireflective coatings . the model can also be modified for other lattice structures , such as cayley trees with any coordination number @xmath26 , with applications in modeling drug encapsulation in nanomedicine @xcite . the attachment and detachment rates can be chosen to reflect nearest - neighbor attraction ( @xmath31 ) and repulsion ( @xmath30 ) . in this article , we presented a cooperative sequential adsorption with evaporation model for the experimental process of ionic self - assembly of charged silica nanoparticles ( isam ) . experimentally , we investigated the effect of the concentration of the nanoparticle suspension on the particle density at fixed temperature . we found that the particle density depends linearly on the inverse of the concentration . theoretically , we found equations for the time - dependent particle density and the density of the steady state . our solutions are also validated by monte carlo simulations . we compared our theoretical results with the experimental data , and found an excellent agreement between the two for @xmath51 . we conclude that we can directly relate our theoretical probability rate @xmath11 to the nanoparticle concentration using eq .  . several open questions may be addressed by extending our results . the model presented matches well the particle density of the steady state found experimentally , but it does nt capture the dynamics of the system on its way to the steady state . experimental studies @xcite indicate that @xmath64 of the particle attachment happens in the first 30 seconds of the dipping process , followed by a slower approach to the final steady state . we plan to further study this time - dependent behavior both experimentally and theoretically . we will explore the dynamics of our model when time - dependent attachment and detachment rates are being considered , in agreement with the experiment . our theoretical model can be generalized to include other aspects of the isam process , such as the presence of dimers and other particles of various shapes and sizes in the colloidal suspension . the analytical method used in our study is the mean field method , which disregards correlations between particles . using a different mathematical approach might lead to possible analytical results for these correlations . +    the authors would like to thank tom williams for a critical reading of this paper . we would also like to thank the anonymous referees for their valuable feedback . funding for this research was provided through the summer research scholars program and the lenfest grant at washington and lee university . _ multilayer thin films : sequential assembly of nanocomposite materials _ , edited by g.  decher , j.  b.  schlenoff ( wiley - vch verlag gmbh & co. kgaa , weinheim , 2003 ) . r.  k.  iler , j.  colloid interface sci . * 21 * , 569 ( 1966 ) . y.  m.  lvov , k.  ariga , m.  onda , i.  ichinose , and t.  kunitache , langmuir * 13 * , 6195 ( 1997 ) . s.  hecht and j.  m.  j.   frechet , angew . int . ed . * 40 * , 74 ( 2001 ) . p.  kolhe , e.  misra , r.  m.  kannana , s.  kannanb , and m.  lieh - lai , i.  j.  pharm . * 259 * , 143 ( 2003 ) . t.  m.  liggett , _ stochastic interacting systems : contact , voter , and exclusion processes _ ( springer - verlag , berlin , 1999 ) . o.  diekmann and j.  a.  p.  heesterbeek , _ mathematical epidemiology of infectious diseases : model building , analysis and interpretation _ ( john wiley & sons ltd . , chichester , 2000 ) . j.  d.  murray , _ mathematical biology i : an introduction _ ( springer - verlag , berlin , 2002 ) . c.  castellano , c.  fortunato , and v.  loreto , rev . phys .  * 81 * 591 ( 2009 ) . m.  di ventra , s.  evoy , and j.  r.  heflin , _ introduction to nanoscience and technology _ ( springer , new york , 2004 ) . r.  gouet and a.  sudbury , j.  stat . phys .  * 130 * , 935 ( 2008 ) . j.  w.  evans , rev . phys .  * 65 * , 1281 ( 1993 ) . a.  cadilhe , n.  a.  m.  araujo , and v.  privman , j.  phys . cond .  mat . * 19 * , 065124 ( 2007 ) . a.  cadilhe and v.  privman , mod . b * 18 * , 207 ( 2004 ) . v.  privman , _ nonequilibrium statistical mechanics in one dimension _ ( cambridge university press , cambridge , 1997 ) . l.  krapivsky , s.  redner , and e.  v.  ben - naim , _ a kinetic view of statistical physics _ ( cambridge university press , cambridge , 2010 ) . d.   ben - avraham and m.  l.  glasser , j.  phys . matter  * 19 * , 065107 ( 2007 ) . l.  f.  matin , a.  aghamohammadi , and m.  khorrami , eur . j.  b * 56 * , 243 ( 2007 ) . a.  alimohammadi and n.  olanj , physica a * 389 * , 549 ( 2010 ) . d.  a.  mazilu , i.  mazilu , a.  m.  seredinski , v.  o.  kim , b.  m.  simpson , and w.  e.  banks , j.  stat . 2012 * , p01017 ( 2012 ) . t.  tome and m.  j.  oliveira , j.  phys .  a : math . * 44 * , 095005 ( 2011 ) . c.  m.  fonseca , d.  a.  mazilu , i.  mazilu , h.  t.  williams , appl . * 26 * , 1206 ( 2013 ) . m.  d.  grynberg , t.  j.  newman , and r.  b.  stinchcombe , phys . e * 50 * , 957 ( 1994 ) . m.  ibn - elhaj and m.  schadt , nature * 410 * , 796 ( 2001 ) . j.  q.  xi , m.  f. schubert , j.  k.  kim , e.  f.  schubert , m.  chen , s.  lin , w.  liu , and j.  a.  smart , nature photonics * 1 * , 176 ( 2007 ) . s.  e.  yancey , w.  zhong , j.  r.  heflin , and a.  l.  ritter , j.  appl . phys .  * 99 * , 034313 ( 2006 ) . e.  hecht , _ optics _ ( addison - wesley , san francisco , 2002 ) . i.  langmuir , j.  am . chem .  soc . * 40 * , 1361 ( 1918 )
Abstract:

Answer: self - assembly of nanoparticles is an important tool in nanotechnology , with numerous applications including thin films , electronics , and drug delivery . we study the deposition of ionic nanoparticles on a glass substrate both experimentally and theoretically . our theoretical model consists of a stochastic cooperative adsorption and evaporation process on a two - dimensional lattice . by exploring the relationship between the initial concentration of nanoparticles in the colloidal solution and the density of particles deposited on the substrate , we relate the deposition rate of our theoretical model to the concentration .