<?xml version="1.0"?>
<!-- name="generator" content="blosxom/2.0" -->
<!DOCTYPE rss PUBLIC "-//Netscape Communications//DTD RSS 0.91//EN" "http://my.netscape.com/publish/formats/rss-0.91.dtd">

<rss version="0.91">
  <channel>
    <title>Notebooks   </title>
    <link>http://bactra.org/notebooks</link>
    <description>Cosma's Notebooks</description>
    <language>en</language>

  <item>
    <title>On the Asymptotics of an Infinite-Dimensional Stochastic Dynamical System</title>
    <link>http://bactra.org/notebooks/2008/06/25#infinite-stochastic-dyn-sys</link>
    <description>
&lt;P&gt;I am working on an idea where I need to show that, in the long run, a
certain infinite-dimensional discrete-time stochastic dynamical system has a
stable limiting distribution, and calculate certain properties of that
distribution.  This notebook is for storing related references.

&lt;P&gt;I'm a little paranoid about being scooped, so I won't say much more, only
that there are certain connections with &lt;a href=&quot;evol-comp.html&quot;&gt;genetic
algorithms&lt;/a&gt;, and that the finite-dimensional analog is related to the
replicator equation of &lt;a href=&quot;evolution.html&quot;&gt;evolutionary biology&lt;/a&gt;.  In
that representation, the fitness function would show a particular kind of
frequency-dependence, with random fluctuations which are &lt;em&gt;not&lt;/em&gt;
necessarily independent over time, though I'd be willing to ignore serial
dependence if the alternatives were simply intractable. Now, the replicator
equation can be re-written as a linear system (or so Nihat tells me), which may
be helpful...

&lt;P&gt;See also:
	&lt;a href=&quot;ergodic-theory.html&quot;&gt;Ergodic Theory&lt;/a&gt;;
	&lt;a href=&quot;filtering.html&quot;&gt;Filtering&lt;/a&gt; (since related equations occur
in nonlinear filtering);
	&lt;a href=&quot;stochastic-processes.html&quot;&gt;Stochastic Processes&lt;/a&gt;

&lt;ul&gt;Definitely useful for this project:
	&lt;li&gt;Nihat Ay and Ionas Erb, &quot;On the Linearity of Replicator Equations&quot;,
&lt;a href=&quot;http://www.santafe.edu/research/publications/wpabstract/200310053&quot;&gt;SFI
Working Paper 2003-10-053&lt;/a&gt; [I &lt;em&gt;think&lt;/em&gt; this is applicable to my
problem, but I need to carefully re-read it to make sure.  Of course, I have a
stochastic fitness function, whereas this is all about deterministic ones, but
an averaging argument should take care of that.]
	&lt;li&gt;Michel Bena&amp;iuml;m, &quot;Dynamics of stochastic approximation
algorithms&quot;, &lt;cite&gt;S&amp;eacute;minaire de probabilit&amp;eacute;s (Strasbourg)&lt;/cite&gt; 
&lt;strong&gt;33&lt;/strong&gt; (1999): 1--68
[&lt;a href=&quot;http://www.numdam.org/item?id=SPS_1999__33__1_0&quot;&gt;Link to full text,
bibliography, etc.&lt;/a&gt;]
	&lt;li&gt;Robin Pemantle, &quot;A Survey of Random Processes with Reinforcement&quot;,
&lt;a href=&quot;http://arxiv.org/abs/math/0610076&quot;&gt;arxiv:math/0610076&lt;/a&gt;
	&lt;/ul&gt;

&lt;ul&gt;To read:
	&lt;li&gt;Siva R. Athreya, Richard F. Bass, Maria Gordina, and Edwin
A. Perkins, &quot;Infinite dimensional stochastic differential equations of
Ornstein-Uhlenbeck type&quot;, &lt;a
href=&quot;http://arxiv.org/abs/math.PR/0503165&quot;&gt;math.PR/0503165&lt;/a&gt;
	&lt;li&gt;Yuri Bakhtin and Jonathan C. Mattingly, &quot;Malliavin Calculus for
Infinite-Dimensional Systems with Additive Noise&quot;,
&lt;a href=&quot;http://arxiv.org/abs/math.PR/0610754&quot;&gt;math.PR/0610754&lt;/a&gt;
	&lt;li&gt;J. B&amp;eacute;rard and A. Bienven&amp;uuml;e, &quot;Sharp asymptotic results
for simplified mutation-selection algorithms&quot;, &lt;cite&gt;The Annals of Applied
Probability&lt;/cite&gt; &lt;strong&gt;13&lt;/strong&gt; (2003): 1534--1568
	&lt;li&gt;&amp;Agrave;ngel Calsina and S&amp;iacute;lvia Cuadrado, &quot;Small mutation
rate and evolutionarily stable strategies in infinite-dimensional adaptive
dynamics&quot;,
&lt;a href=&quot;http://dx.doi.org/10.1007/s00285-003-0226-6&quot;&gt;&lt;cite&gt;Mathematical
Biology&lt;/cite&gt; &lt;strong&gt;48&lt;/strong&gt; (2004): 135--159&lt;/a&gt;
	&lt;li&gt;Alain Cercuiel and Olivier Fran&amp;ccedil;ois, &quot;Sharp Asymptotics for
Fixation Times in Stochastic Population Genetics Models at Low Mutation
Probabilities&quot;, &lt;cite&gt;Journal of Statistical
Physics&lt;/cite&gt; &lt;strong&gt;110&lt;/strong&gt; (2003): 311--332
	&lt;li&gt;Fabio A. C. C. Chalub and Max O. Souza, &quot;The continuous limit of
the Moran process and the diffusion of mutant genes in infinite
populations&quot;, &lt;a
href=&quot;http://arxiv.org/abs/math.AP/0602530&quot;&gt;math.AP/0602530&lt;/a&gt;
	&lt;li&gt;Igor Chueshov, Jinqiao Duan and Bj&amp;ouml;rn Schmalfuss, &quot;Determining
functionals for random partial differential equations&quot;, &lt;cite&gt;Nonlinear
Differential Equations and Applications&lt;/cite&gt; &lt;strong&gt;10&lt;/strong&gt; (2003):
431--454 = &lt;a href=&quot;http://arxiv.org/abs/math.DS/0409481&quot;&gt;math.DS/0409481&lt;/a&gt;
	&lt;li&gt;Giuseppe Da Prato and Jerzy Zabczyk [apparently mostly
continuous time, which is more complicated than I need]
		&lt;ul&gt;
		&lt;li&gt;&lt;cite&gt;Ergodicity for Infinite Dimensional Systems&lt;/cite&gt;
		&lt;li&gt;&lt;cite&gt;Stochastic Equations in Infinite
Dimensions&lt;/cite&gt;
		&lt;/ul&gt;
	&lt;li&gt;P. Del Moral, &quot;Measure-Valued Processes and Interacting Particle
Systems. Application to Nonlinear Filtering Problems&quot;, &lt;cite&gt;The Annals of
Applied Probability&lt;/cite&gt; &lt;strong&gt;8&lt;/strong&gt; (1998): 438--495
[&lt;a
href=&quot;http://links.jstor.org/sici?sici=1050-5164%28199805%298%3A2%3C438%3AMPAIPS%3E2.0.CO%3B2-4&quot;&gt;JSTOR&lt;/a&gt;]
	&lt;li&gt;Iva Dos&amp;aacute;lkov&amp;aacute; and Pavel Kindlmann, &quot;Evolutionarily
stable strategies for stochastic processes&quot;, &lt;a
href=&quot;http://dx.doi.org/10.1016/j.tpb.2004.01.001&quot;&gt;&lt;cite&gt;Theoretical Population
Biology&lt;/cite&gt; &lt;strong&gt;65&lt;/strong&gt; (2004): 205--210&lt;/a&gt;
	&lt;li&gt;Jinqiao Duan, Kening Lu and Bjorn Schmalfuss, &quot;Smooth stable and
unstable manifolds for stochastic partial differential equations&quot;, &lt;a
href=&quot;http://arxiv.org/abs/math.DS/0409483&quot;&gt;math.DS/0409483&lt;/a&gt;
	&lt;li&gt;Tobias Galla
		&lt;ul&gt;
		&lt;li&gt;&quot;Dynamics of random replicators with Hebbian
interactions&quot;, &lt;a
href=&quot;http://arxiv.org/abs/cond-mat/0507473&quot;&gt;cond-mat/0507473&lt;/a&gt;
		&lt;li&gt;&quot;Random replicators with asymmetric couplings&quot;, &lt;a
href=&quot;http://arxiv.org/abs/cond-mat/0508174&quot;&gt;cond-mat/0508174&lt;/a&gt; [&quot;The
dynamics of random replicators is studied using generating functional
techniques... We first discuss in detail how dynamical theories can be
formulated for general replicator models in terms of an effective
single-species process, and how persistent order parameters of the ergodic
stationary states can be extracted from this process. We then detail how
different types of dynamical phase transitions can be identified and related to
each other. As an application of the general theory we address replicator
models with Gaussian couplings of arbitrary symmetry between pairs and triples
of species, respectively. Numerical simulations verify our theory, and also
indicate regimes in which only a finite number of species survives, even when
the thermodynamic limit is considered.&quot;]
		&lt;/ul&gt;
	&lt;li&gt;Mats Gyllenberg and G&amp;eacute;za Mesz&amp;eacute;na, &quot;On the
impossibility of coexistence of infinitely many strategies&quot;, &lt;a
href=&quot;http://dx.doi.org/10.1007/s00285-004-0283-5&quot;&gt;&lt;cite&gt;Journal of
Mathematical Biology&lt;/cite&gt; &lt;strong&gt;50&lt;/strong&gt; (2005): 133--160&lt;/a&gt; [This
would be &lt;em&gt;very&lt;/em&gt; useful to me, if the result generalizes to my setting.]
	&lt;li&gt;Dirk Helbing and Nicole J. Saam, &quot;Analytical Investigation of
Innovation Dynamics Considering Stochasticity in the Evaluation of Fitness&quot;, &lt;a
href=&quot;http://arxiv.org/abs/cond-mat/051217&quot;&gt;cond-mat/051217&lt;/a&gt;
	&lt;li&gt;David Hochberg, M.-P. Zorzano, Federico Moran, &quot;Complex noise in
diffusion-limited reactions of replicating and competing
species&quot;, &lt;a href=&quot;http://arxiv.org/abs/cond-mat/0606378&quot;&gt;cond-mat/0606378&lt;/a&gt;
= &lt;a href=&quot;http://dx.doi.org/10%2E1103/PhysRevE%2E73%2E066109&quot;&gt;&lt;cite&gt;Physical
Review E&lt;/cite&gt; &lt;strong&gt;73&lt;/strong&gt; (2006): 066109&lt;/a&gt;
	&lt;li&gt;Lorens A. Imhof, &quot;The long-run behavior of the stochastic
replicator dynamics&quot;, &lt;a
href=&quot;http://dx.doi.org/10%2E1214/105051604000000837&quot;&gt;&lt;cite&gt;Annals of Applied
Probability&lt;/cite&gt; &lt;strong&gt;15&lt;/strong&gt; (2005): 1019--1045&lt;/a&gt; = &lt;a
href=&quot;http://arxiv.org/abs/math.PR/0503529&quot;&gt;math.PR/0503529&lt;/a&gt;
	&lt;li&gt;Vassili N. Kolokoltsov, &quot;Nonlinear Markov Semigroups and
Interacting L&amp;eacute;vy Type
Processes&quot;, &lt;a href=&quot;http://dx.doi.org/10.1007/s10955-006-9211-y&quot;&gt;&lt;cite&gt;Journal
of Statistical Physics&lt;/cite&gt; &lt;strong&gt;126&lt;/strong&gt; (2007): 585-642&lt;/a&gt;
	&lt;li&gt;Kai Liu, &quot;Uniform stability of autonomous linear stochastic
functional differential equations in infinite dimensions&quot;, &lt;a
href=&quot;http://dx.doi.org/10.1016/j.spa.2005.02.006&quot;&gt;&lt;cite&gt;Stochastic Processes
and Their Applications&lt;/cite&gt; &lt;strong&gt;115&lt;/strong&gt; (2005): 1131--1165&lt;/a&gt;
	&lt;li&gt;A.G. Munoz, J. Ojeda, D. Sierra and T. Soldovieri, &quot;Variational and
Potential Formulation for Stochastic Partial Differential Equations&quot;, &lt;a
href=&quot;http://arxiv.org/abs/nlin.SI/0502010&quot;&gt;nlin.SI/0502010&lt;/a&gt;
	&lt;li&gt;Marcello Pelillo, &quot;Replicator Equations, Maximal Cliques, and Graph
Isomorphism&quot;, &lt;citE&gt;Neural Computation&lt;/cite&gt; &lt;strong&gt;11&lt;/strong&gt; (1999):
1933--1955
	&lt;li&gt;A. J. Roberts, &quot;Resolve the multitude of microscale interactions to
model stochastic partial differential equations&quot;, &lt;a
href=&quot;http://arxiv.org/abs/math.DS/0506533&quot;&gt;math.DS/0506533&lt;/a&gt;
	&lt;li&gt;Wilhelm Stannat, &quot;On the convergence of genetic algorithms --- a
variational approach&quot;, &lt;a
href=&quot;http://dx.doi.org/10.1007/s00440-003-0330-y&quot;&gt;&lt;cite&gt;Probability Theory and
Related Fields&lt;/cite&gt;
&lt;strong&gt;129&lt;/strong&gt; (2004): 113--132&lt;/a&gt;
	&lt;li&gt;Mark Stegeman and Paul Rhode, &quot;Stochastic Darwinian equilibria
in small and large populations&quot;, &lt;cite&gt;Games and Economic Behavior&lt;/cite&gt;
&lt;strong&gt;49&lt;/strong&gt; (2004): 171--214
	&lt;li&gt;Anatoly V. Swishchuk and Jianhong Wu, &lt;citE&gt;Evolution of Biological
Systems in Random Media: Limit Theorems and Stability&lt;/cite&gt; [This looks
extremely relevant]
	&lt;li&gt;Marcel O. Vlad, Stefan E. Szedlacsek, Nader Pourmand, L. Luca
Cavalli-Sforza, Peter Oefner and John Ross, &quot;Fisher's theorems for
multivariable, time- and space-dependent systems, with applications in
population genetics and chemical kinetics&quot;, &lt;a
href=&quot;http://dx.doi.org/10.1073/pnas.0504073102&quot;&gt;&lt;cite&gt;PNAS&lt;/cite&gt; &lt;strong&gt;102&lt;/strong&gt;
(2005): 9848--9853&lt;/a&gt;
	&lt;/ul&gt;
</description>
  </item>
  </channel>
</rss>