This work develops a class of stochastic global optimization algorithms that are Kiefer-Wolfowitz (KW) type procedures with an added perturbing noise and partial step size restarting. The motivation stems from the use of KW-type procedures and Monte Carlo versions of simulated annealing algorithms in a wide range of applications. Using weak convergence approaches, our effort is directed to proving the convergence of the underlying algorithms under general noise processes.

A simple asymmetric random walk on the integers is stopped when its range is of a given length. When and where is it stopped? Analogous questions can be stated for a Brownian motion. Such problems are studied using results for the classical ruin problem, yielding results for the cover time and the range, both for asymmetric random walks and Brownian motion with drift.

Classic works of Karlin and McGregor and Jones and Magnus have established a general correspondence between continuous-time birth-and-death processes and continued fractions of the Stieltjes-Jacobi type together with their associated orthogonal polynomials. This fundamental correspondence is revisited here in the light of the basic relation between weighted lattice paths and continued fractions otherwise known from combinatorial theory. Given that sample paths of the embedded Markov chain of a birth-and-death process are lattice paths, Laplace transforms of a number of transient characteristics can be obtained systematically in terms of a fundamental continued fraction and its family of convergent polynomials. Applications include the analysis of evolutions in a strip, upcrossing and downcrossing times under flooring and ceiling conditions, as well as time, area, or number of transitions while a geometric condition is satisfied.

This paper introduces a fractional heat equation, where the diffusion operator is the composition of the Bessel and Riesz potentials. Sharp bounds are obtained for the variance of the spatial and temporal increments of the solution. These bounds establish the degree of singularity of the sample paths of the solution. In the case of unbounded spatial domain, a solution is formulated in terms of the Fourier transform of its spatially and temporally homogeneous Green function. The spectral density of the resulting solution is then obtained explicitly. The result implies that the solution of the fractional heat equation may possess spatial long-range dependence asymptotically.

Certain types of Markov jump processes x(t) with continuous state space and one or more absorbing states are studied. Cases where the transition rate in state x is of the form λ(x) = |x|δ in a neighbourhood of the origin in ℝd are considered, in particular. This type of problem arises from quantum physics in the study of laser cooling of atoms, and the present paper connects to recent work in the physics literature. The main question addressed is that of the asymptotic behaviour of x(t) near the origin for large t. The study involves solution of a renewal equation problem in continuous state space.

A near-maximum is an observation which falls within a distance a of the maximum observation in an i.i.d. sample of size n. The asymptotic behaviour of the number Kn(a) of near-maxima is known for the cases where the right extremity of the population distribution function is finite, and where it is infinite and the right hand tail is exponentially small, or fatter than exponential. This paper completes the picture for thin tails, i.e., tails which decay faster than exponential. Limit theorems are derived and used to find the large-sample behaviour of the sum of near-maxima.

We consider Markov processes of DNA sequence evolution in which the instantaneous rates of substitution at a site are allowed to depend upon the states at the sites in a neighbourhood of the site at the instant of the substitution. We characterize the class of Markov process models of DNA sequence evolution for which the stationary distribution is a Gibbs measure, and give a procedure for calculating the normalizing constant of the measure. We develop an MCMC method for estimating the transition probability between sequences under models of this type. Finally, we analyse an alignment of two HIV-1 gene sequences using the developed theory and methodology.

This paper focuses on the analyticity of the limiting behavior of a class of dynamical systems defined by iteration of non-expansive random operators. The analyticity is understood with respect to the parameters which govern the law of the operators. The proofs are based on contraction with respect to certain projective semi-norms. Several examples are considered, including Lyapunov exponents associated with products of random matrices both in the conventional algebra, and in the (max, +) semi-field, and Lyapunov exponents associated with non-linear dynamical systems arising in stochastic control. For the class of reducible operators (defined in the paper), we also address the issue of analyticity of the expectation of functionals of the limiting behavior, and connect this with contraction properties with respect to the supremum norm. We give several applications to queueing theory.

We consider a fluid model similar to that of Kella and Whitt [32], but with a buffer having finite capacity K. The connections between the infinite buffer fluid model and the G/G/1 queue established by Kella and Whitt are extended to the finite buffer case: it is shown that the stationary distribution of the buffer content is related to the stationary distribution of the finite dam. We also derive a number of new results for the latter model. In particular, an asymptotic expansion for the loss fraction is given for the case of subexponential service times. The stationary buffer content distribution of the fluid model is also related to that of the corresponding model with infinite buffer size, by showing that the two corresponding probability measures are proportional on [0,K) if the silence periods are exponentially distributed. These results are applied to obtain large buffer asymptotics for the loss fraction and the mean buffer content when the fluid queue is fed by N On-Off sources with subexponential on-periods. The asymptotic results show a significant influence of heavy-tailed input characteristics on the performance of the fluid queue.

This paper studies a revenue management problem in which a finite number of substitutable commodities are sold to two different market segments at respective prices. It is required that a certain number of commodities are reserved for the high-price segment to ensure a minimum service level. The two segments are served concurrently at the beginning of the season. To improve revenues, management may choose to close the low-price segment at a time when the chance of selling all items at the high price is promising. The difficulty is determining when such a decision should be made. We derive the exact solution in closed form using the theory of optimal stopping time. We show that the optimal decision is made in reference to a sequence of thresholds in time. These time thresholds take both remaining sales season and inventory into account and exhibit a useful monotone property.

We study the (two-sided) exit time and position of a random walk outside boundaries which are regularly varying functions of smaller order at infinity than the square root. A natural domain of interest is those random walks which are attracted without centring to a normal law, or are relatively stable. These are shown to have ‘stable’ exit positions, in that the overshoot of the curved boundary is of smaller order of magnitude (in probability) than the boundary, as the boundary expands. Surprisingly, this remains true regardless of the shape of the boundary. Furthermore, within the same natural domain of interest, norming of the exit position by, for example, the square root of the exit time (in the finite-variance case), produces limiting distributions which are computable from corresponding functionals of Brownian motion. We give a functional limit theorem for attraction of normed sums to general infinitely divisible random variables, as a means of making this, and more general, computations. These kinds of theorems have applications in sequential analysis, for example.

We study the following stochastic investment model: opportunities occur randomly over time, following a renewal process with mean interarrival time d, and at each of them the decision-maker can choose a distribution for an instantaneous net gain (or loss) from the set of all probability measures that have some prespecified expected value e and for which his maximum possible loss does not exceed his current capital. Between the investments he spends money at some constant rate. The objective is to avoid bankruptcy as long as possible. For the case e>d we characterize a strategy maximizing the probability that ruin never occurs. It is proved that the optimal value function is a concave function of the initial capital and uniquely determined as the solution of a fixed point equation for some intricate operator. In general, two-point distributions suffice; furthermore, we show that the cautious strategy of always taking the deterministic amount e is optimal if the interarrival times are hyperexponential, and, in the case of bounded interarrival times, is optimal ‘from some point on’, i.e. whenever the current capital exceeds a certain threshold. In the case e = 0 we consider a class of natural objective functions for which the optimal strategies are non-stationary and can be explicitly determined.

This paper investigates the dynamics of a synchronization node in isolation, and of networks of service and synchronization nodes. A synchronization node consists of M infinite capacity buffers, where tokens arriving on M distinct random input flows are stored (there is one buffer for each flow). Tokens are held in the buffers until one is available from each flow. When this occurs, a token is drawn from each buffer to form a group-token, which is instantaneously released as a synchronized departure. Under independent Poisson inputs, the output of a synchronization node is shown to converge weakly (and in certain cases strongly) to a Poisson process with rate equal to the minimum rate of the input flows. Hence synchronization preserves the Poisson property, as do superposition, Bernoulli sampling and M/M/1 queueing operations. We then consider networks of synchronization and exponential server nodes with Bernoulli routeing and exogenous Poisson arrivals, extending the standard Jackson network model to include synchronization nodes. It is shown that if the synchronization skeleton of the network is acyclic (i.e. no token visits any synchronization node twice although it may visit a service node repeatedly), then the distribution of the joint queue-length process of only the service nodes is product form (under standard stability conditions) and easily computable. Moreover, the network output flows converge weakly to Poisson processes. Finally, certain results for networks with finite capacity buffers are presented, and the limiting behavior of such networks as the buffer capacities become large is studied.

We consider a fluid queue fed by the superposition of n homogeneous on-off sources with generally distributed on and off periods. The buffer space B and link rate C are scaled by n, so that we get nb and nc, respectively. Then we let n grow large. In this regime, the overflow probability decays exponentially in the number of sources n. We specifically examine the scenario where b is also large. We obtain explicit asymptotics for the case where the on periods have a subexponential distribution, e.g., Pareto, Lognormal, or Weibull.

The results show a sharp dichotomy in the qualitative behavior, depending on the shape of the function v(t) := - logP(A* > t) for large t, A* representing the residual on period. If v(.) is regularly varying of index 0 (e.g., Pareto, Lognormal), then, during the path to overflow, the input rate will only slightly exceed the link rate. Consequently, the buffer will fill ‘slowly’, and the typical time to overflow will be ‘more than linear’ in the buffer size. In contrast, if v(.) is regularly varying of index strictly between 0 and 1 (e.g., Weibull), then the input rate will significantly exceed the link rate, and the time to overflow is roughly proportional to the buffer size.

In both cases there is a substantial fraction of the sources that remain in the on state during the entire path to overflow, while the others contribute at their mean rates. These observations lead to approximations for the overflow probability. The approximations may be extended to the case of heterogeneous sources. The results provide further insight into the so-called reduced-load approximation.

We consider a fluid queue fed by a superposition of a finite number of On/Off sources, the distribution of the On period being subexponential for some of them and exponential for the others. We provide general lower and upper bounds for the tail of the stationary buffer content distribution in terms of the so-called minimal subsets of sources. We then show that this tail decays at exponential or subexponential speed according as a certain parameter is smaller or larger than the ouput rate. If we replace the subexponential tails by regularly varying tails, the upper bound and the lower bound are sharp in that they differ only by a multiplicative factor.

This paper proposes and analyzes discrete-time approximations to a class of diffusions, with an emphasis on preserving certain important features of the continuous-time processes in the approximations. We start with multivariate diffusions having three features in particular: they are martingales, each of their components evolves within the unit interval, and the components are almost surely ordered. In the models of the term structure of interest rates that motivate our investigation, these properties have the important implications that the model is arbitrage-free and that interest rates remain positive. In practice, numerical work with such models often requires Monte Carlo simulation and thus entails replacing the original continuous-time model with a discrete-time approximation. It is desirable that the approximating processes preserve the three features of the original model just noted, though standard discretization methods do not. We introduce new discretizations based on first applying nonlinear transformations from the unit interval to the real line (in particular, the inverse normal and inverse logit), then using an Euler discretization, and finally applying a small adjustment to the drift in the Euler scheme. We verify that these methods enforce important features in the discretization with no loss in the order of convergence (weak or strong). Numerical results suggest that these methods can also yield a better approximation to the law of the continuous-time process than does a more standard discretization.

We consider a multiserver queue in the heavy-traffic regime introduced and studied by Halfin and Whitt who investigated the case of a single customer class with exponentially distributed service times. Our purpose is to extend their analysis to a system with multiple customer classes, priorities, and phase-type service distributions. We prove a weak convergence limit theorem showing that a properly defined and normalized queue length process converges to a particular K-dimensional diffusion process, where K is the number of phases in the service time distribution. We also show that a properly normalized waiting time process converges to a simple functional of the limit diffusion for the queue length.

We consider a diffusing particle in one dimension that is subject to a time-dependent drift or potential field. A reflecting barrier constrains the particle's position to the half-line X ≥ 0. Such models arise naturally in the study of queues with time-dependent arrival rates, as well as in advection-diffusion problems of mathematical physics. We solve for the probability distribution of the particle as a function of space and time. Then we do a detailed study of the asymptotic properties of the solution, for various ranges of space and time. We also relate our asymptotic results to those obtained by probabilistic approaches, such as central limit theorems and large deviations. We consider drifts that are either piecewise constant or linear functions of time.

In this paper we investigate the application of perfect simulation, in particular Coupling from the Past (CFTP), to the simulation of random point processes. We give a general formulation of the method of dominated CFTP and apply it to the problem of perfect simulation of general locally stable point processes as equilibrium distributions of spatial birth-and-death processes. We then investigate discrete-time Metropolis-Hastings samplers for point processes, and show how a variant which samples systematically from cells can be converted into a perfect version. An application is given to the Strauss point process.

This paper presents the large-buffer asymptotics for a multiplexer which serves N types of heterogeneous sessions which have long-tailed session lengths. Specifically, the model considered is that sessions of type i ∈ {1,…,N} arrive as a Poisson process with rate λi. Each type of session (independently) remains active for a random duration, say τi, where P(τi > x) ~ αix-(1 + βi) for positive numbers αi and βi. While active, a session transmits at a rate ri. Under the assumption that the average load ρ = ∑Ni=1riλiE[τi] < C, where C denotes the server capacity, we show that both the tail distribution of the stationary buffer content and the loss asymptotics in finite buffers of size z behave approximately as z-κJ0, where κJ0 depends not only on the βi but also on the transmission rates ri; it is the ratio of βi to ri which determines κJ0. When specialized to the homogeneous case, i.e., when ri=r and βi = β for all i, the result coincides with results reported in the literature which have been shown under more restrictive hypotheses. Finally, it is a simple observation that light-tailed sessions only have the effect of reducing the available capacity for long-tailed sessions, but do not contribute otherwise to the definition of κJ0.