We give a unified presentation of stability results for stochastic vector difference equations based on various choices of binary operations and , assuming that are stationary and ergodic. In the scalar case, under standard addition and multiplication, the key condition for stability is E[log |A0|] < 0. In the generalizations, the condition takes the form γ< 0, where γis the limit of a subadditive process associated with . Under this and mild additional conditions, the process has a unique finite stationary distribution to which it converges from all initial conditions.

The variants of standard matrix algebra we consider replace the operations + and × with (max, +), (max,×), (min, +), or (min,×). In each case, the appropriate stability condition parallels that for the standard recursions, involving certain subadditive limits. Since these limits are difficult to evaluate, we provide bounds, thus giving alternative, computable conditions for stability.

We consider non-homogeneous Markov chains generated by the simulated annealing algorithm. We classify states according to asymptotic properties of trajectories. We identify recurrent and transient states. The set of recurrent states is partitioned into disjoint classes of asymptotically communicating states. These classes correspond to atoms of the tail sigma-field. The results are valid under the weak reversibility assumption of Hajek.

Consider a stationary Markov chain with state space consisting of the ξ -letter alphabet set Λ= {a1, a2, ···, aξ }. We study the variables M=M(n, k) and N=N(n, k), defined, respectively, as the number of overlapping and non-overlapping occurrences of a fixed periodic k-letter word, and use the Stein–Chen method to obtain compound Poisson approximations for their distribution.

We prove that every infinite-state stochastic matrix P say, that is irreducible and consists of positive-recurrrent states can be represented in the form I – P=(A – I)(B – S), where A is strictly upper-triangular, B is strictly lower-triangular, and S is diagonal. Moreover, the elements of A are expected values of random variables that we will specify, and the elements of B and S are probabilities of events that we will specify. The decomposition can be used to obtain steady-state probabilities, mean first-passage-times and the fundamental matrix.

We consider the problem of conditioning a continuous-time Markov chain (on a countably infinite state space) not to hit an absorbing barrier before time T; and the weak convergence of this conditional process as T → ∞. We prove a characterization of convergence in terms of the distribution of the process at some arbitrary positive time, t, introduce a decay parameter for the time to absorption, give an example where weak convergence fails, and give sufficient conditions for weak convergence in terms of the existence of a quasi-stationary limit, and a recurrence property of the original process.

Neveu's exchange formula relates the Palm probabilities with respect to two jointly stationary simple point processes. We give a new proof of the exchange formula by using a simple result from discrete time stationary stochastic processes.

We derive an ESTA property for marked point processes similar to Wolff's PASTA property for ordinary (non-marked) point processes, via a stochastic integral approach. This new ESTA property allows us to extend a known result on the conditional PASTA property and to derive an ASTA property for batch arrival processes. We also present an application of our results.

The study of exponential functionals of Brownian motion has recently attracted much attention, partly motivated by several problems in financial mathematics. Let be a linear Brownian motion starting from 0. Following Dufresne (1989), (1990), De Schepper and Goovaerts (1992) and De Schepper et al. (1992), we are interested in the process (for δ > 0), which stands for the discounted values of a continuous perpetuity payment. We characterize the upper class (in the sense of Paul Lévy) of X, as δ tends to zero, by an integral test. The law of the iterated logarithm is obtained as a straightforward consequence. The process exp(W(u))du is studied as well. The class of upper functions of Z is provided. An application to the lim inf behaviour of the winding clock of planar Brownian motion is presented.

In this paper we continue the study of the classification problem for random walks in the quarter plane, with zero drifts in the interior of the domain. The necessary and sufficient conditions for these random walks to be ergodic were found earlier in [3]. Here we obtain necessary and sufficient conditions for transience by constructing suitable Lyapounov functions.

In this paper we give a solution of an optimal stopping problem concerning random walks with non-zero drift, thereby proving the necessity of the existence of ESτ for Wald's equation ESτ = ES1 · Ετ to hold, even if attention is restricted to non-randomized stopping times τ. This answers a question of Robbins and Samuel (1966).

Conditions that have been widely used to establish stochastic ordering of random vectors include those given by Kamae et al. (1977), Barlow and Proschan (1975) and Langberg (1988). In this note we offer conditions that are weaker than those above, thus providing potential application to a wider class of problems.

In this note we introduce recurring-with-carry sequences which generalize add-with-carry and subtract-with-borrow sequences introduced in [1], and describe periods of admissible recurring-with-carry sequences which include add-with-carry and subtract-with-borrow sequences with a few exceptions.

Given a sequence of independent identically distributed random variables, we derive a moving-maximum sequence (with random translations). The extremal index of the derived sequence is computed and the limiting behaviour of clusters of high values is studied. We are then given two or more independent stationary sequences whose extremal indices are known. We derive a new stationary sequence by taking either a pointwise maximum or by a mixture of the original sequences. In each case, we compute the extremal index of the derived sequence.

Records from are analyzed, where {Yj} is an independent sequence of random variables. Each Yj has a continuous distribution function Fj = Fλj for some distribution F and some λ j > 0. We study records, record times and related quantities for this sequence. Depending on the sequence of powers , a wide spectrum of behaviour is exhibited.

The paper deals with processes in (or ), one of whose components is skip-free. We obtain identities for distributions of hitting times for the components of the process generalizing the well-known one for the one-dimensional case. These relations reflect the fact that in this case spatial and time coordinates play, in some sense, symmetric roles. They turn out to be useful for solving several problems. For example, they allow us to find the distribution of the number of jumps of the process, which fall in a fixed set before the skip-free component of the process hits a fixed level. Examples are given showing how our results can be applied to models in branching processes, queueing, and risk theory.

The first-passage problem for the one-dimensional Wiener process with drift in the presence of elastic boundaries is considered. We use the Kolmogorov backward equation with corresponding boundary conditions to derive explicit closed-form expressions for the expected value and the variance of the first-passage time. Special cases with pure absorbing and/or reflecting barriers arise for a certain choice of a parameter constellation.

The cumulative distribution of the finite sum of the binary sequence of order k is studied and some of its applications discussed. Certain properties of this sequence are investigated and uniformly superior bounds for the cumulative distribution under minimal information on the ‘success' probabilities are derived.

We first introduce a Lorenz ordering family of distributions which are related to the gamma distribution, and then prove that the weak convergence within this family is equivalent to the convergence of each moment sequence of positive orders to the corresponding moment of the limiting distribution.

Intersymbol and cochannel interference in a communications channel can often be modelled as the sum of an infinite series of random variables with weights which decay fairly rapidly. Frequently, this yields a random variable which is singular but non-atomic. The Hausdorff dimension of the distribution is estimated and methods for calculating expectations are studied. A connection is observed between the dimension and the complexity of the calculation of an expectation.

The quadratic mean of the deviation between the probability content and the interior point proportion of a random convex hull in is investigated. We obtain, in particular, an explicit and distribution-independent bound.