In this study, we characterize the equilibrium behavior of spatial migration processes that represent population migrations, or birth-death processes, in general spaces. These processes are reversible Markov jump processes on measure spaces. As a precursor, we present fundamental properties of reversible Markov jump processes on general spaces. A major result is a canonical formula for the stationary distribution of a reversible process. This involves the characterization of two-way communication in transitions, using certain Radon-Nikodým derivatives. Other results concern a Kolmogorov criterion for reversibility, time reversibility, and several methods of constructing or identifying reversible processes.

We study a fork-join processing network in which jobs arrive according to a Poisson process and each job splits into m tasks, which are simultaneously assigned to m nodes that operate like M/M/s queueing systems. When all of its tasks are finished, the job is completed. The main result is a closed-form formula for approximating the distribution of the network's response time (the time to complete a job) in equilibrium. We also present an analogous approximation for the distribution of the equilibrium queue length (the number of jobs in the system), when each node has one server. Kolmogorov-Smirnov statistical tests show that these formulae are good fits for the distributions obtained from simulations.

A basic issue in extreme value theory is the characterization of the asymptotic distribution of the maximum of a number of random variables as the number tends to infinity. We address this issue in several settings. For independent identically distributed random variables where the distribution is a mixture, we show that the convergence of their maxima is determined by one of the distributions in the mixture that has a dominant tail. We use this result to characterize the asymptotic distribution of maxima associated with mixtures of convolutions of Erlang distributions and of normal distributions. Normalizing constants and bounds on the rates of convergence are also established. The next result is that the distribution of the maxima of independent random variables with phase type distributions converges to the Gumbel extreme-value distribution. These results are applied to describe completion times for jobs consisting of the parallel-processing of tasks represented by Markovian PERT networks or task-graphs. In these contexts, which arise in manufacturing and computer systems, the job completion time is the maximum of the task times and the number of tasks is fairly large. We also consider maxima of dependent random variables for which distributions are selected by an ergodic random environment process that may depend on the variables. We show under certain conditions that their distributions may converge to one of the three classical extreme-value distributions. This applies to parallel-processing where the subtasks are selected by a Markov chain.

Limit Statements obtainable by the key renewal theorem are of the form EXt = v(t) + o(1), as t →∞. We show how to delineate the limit function v for processes X associated with crudely regenerative phenomena. Included are refinements of classical limit theorems for Markov and regenerative processes, limits of sums of stationary random variables, and limits for integrals and derivatives of EXt.

We present conditions under which a point process of certain jump times of a Markov process is a Poisson process. The central idea is that if the Markov process is stationary and the compensator of the point process in reverse time has a constant intensity a, then the point process is Poisson with rate a. A known example is that the output flow from an M/M/1 queueing system is Poisson. We present similar Poisson characterizations of more general marked point process functionals of a Markov process. These results yield easy-to-use criteria for a collection of such processes to be multivariate Poisson, compound Poisson, or marked Poisson with a specified dependence or independence. We discuss several applications for queueing systems with batch arrivals and services and for networks of queues. We also indicate how our results extend to functionals of non-Markovian processes.

When a stochastic process (a random measure, set, field, etc. on a group) is stationary, ergodic, or reversible, then certain functions of this process inherit these properties. We present sufficient conditions for this inheritance.

The Poisson process is regarded as a point process of rare events because of the classical result that the number of successes in a sequence of Bernoulli trials is asymptotically Poisson as the probability of a success tends to 0. It is shown that this rareness property of the Poisson process is characteristic of any infinitely divisible point process or random measure with independent increments. These processes and measures arise as limits of certain rarefactions of compound point processes: purely atomic random measures with uniformly null atom sizes. Examples include thinnings and partitions of point processes.

The techniques used by Doeblin and Chung to obtain ordinary limit laws (central limit laws, weak and strong laws of large numbers, and laws of the iterated logarithm) for Markov chains, are extended to obtain analogous functional limit laws for stochastic processes which have embedded processes satisfying these laws. More generally, it is shown how functional limit laws of a stochastic process are related to those of a process embedded in it. The results herein unify and extend many existing limit laws for Markov, semi-Markov, queueing, regenerative, semi-stationary, and subordinated processes.

A batch service queue is considered where each batch size and its time of service is subject to control. Costs are incurred for serving the customers and for holding them in the system. Viewing the system as a Markov decision process (i.e., dynamic program) with unbounded costs, we show that policies which minimize the expected continuously discounted cost and the expected cost per unit time over an infinite time horizon are of the form: at a review point when x customers are waiting, serve min {x, Q} customers (Q being the, possibly infinite, service capacity) if and only if x exceeds a certain optimal level M. Methods of computing M for both the discounted and average cost contexts are presented.

A conditional Poisson process (often called a double stochastic Poisson process) is characterized as a random time transformation of a Poisson process with unit intensity. This characterization is used to exhibit the jump times and sizes of these processes, and to study their limiting behavior. A conditional Poisson process, whose intensity is a function of a Markov process, is discussed. Results similar to those presented can be obtained for any process with conditional stationary independent increments.

We study a class of processes which are essentially processes with stationary independent increments whose basic parameters are allowed to vary randomly over time. These processes are equivalent to random time transformations of processes with stationary independent increments where the time process is independent of the original process. Several limiting theorems are presented including weak and strong laws of large numbers and a functional central limit theorem.