In this paper, distributional questions which arise in certain mathematical finance models are studied: the distribution of the integral over a fixed time interval [0, T] of the exponential of Brownian motion with drift is computed explicitly, with the help of computations previously made by the author for Bessel processes. The moments of this integral are obtained independently and take a particularly simple form. A subordination result involving this integral and previously obtained by Bougerol is recovered and related to an important identity for Bessel functions. When the fixed time T is replaced by an independent exponential time, the distribution of the integral is shown to be related to last-exit-time distributions and the fixed time case is recovered by inverting Laplace transforms.

Let ψ be a functional of the sample path of a stochastic system driven by a Poisson process with rate λ . It is shown in a very general setting that the expectation of ψ,Eλ [ψ], is an analytic function of λ under certain moment conditions. Instead of following the straightforward approach of proving that derivatives of arbitrary order exist and that the Taylor series converges to the correct value, a novel approach consisting in a change of measure argument in conjunction with absolute monotonicity is used. Functionals of non-homogeneous Poisson processes and Wiener processes are also considered and applications to light traffic derivatives are briefly discussed.

In this paper we connect various topological and probabilistic forms of stability for discrete-time Markov chains. These include tightness on the one hand and Harris recurrence and ergodicity on the other. We show that these concepts of stability are largely equivalent for a major class of chains (chains with continuous components), or if the state space has a sufficiently rich class of appropriate sets (‘petite sets').

We use a discrete formulation of Dynkin's formula to establish unified criteria for these stability concepts, through bounding of moments of first entrance times to petite sets. This gives a generalization of Lyapunov–Foster criteria for the various stability conditions to hold. Under these criteria, ergodic theorems are shown to be valid even in the non-irreducible case. These results allow a more general test function approach for determining rates of convergence of the underlying distributions of a Markov chain, and provide strong mixing results and new versions of the central limit theorem and the law of the iterated logarithm.

In a discrete-time renewal process {Nk, k = 0, 1, ·· ·}, let Zk and Ak be the forward recurrence time and the renewal age, respectively, at time k. In this paper, we prove that if the inter-renewal time distribution is discrete DFR (decreasing failure rate) then both {Ak, k = 0, 1, ·· ·} and {Zk, k = 0, 1, ·· ·} are monotonically non-decreasing in k in hazard rate ordering. Since the results can be transferred to the continuous-time case, and since the hazard rate ordering is stronger than the ordinary stochastic ordering, our results strengthen the corresponding results of Brown (1980). A sufficient condition for {Nk+m – Nk, k = 0, 1, ·· ·} to be non-increasing in k in hazard rate ordering as well as some sufficient conditions for the opposite monotonicity results are given. Finally, Brown's conjecture that DFR is necessary for concavity of the renewal function in the continuous-time case is discussed.

The problem treated is that of controlling a process with values in [0, a]. The non-anticipative controls (µ(t), σ(t)) are selected from a set C(x) whenever X(t–) = x and the non-decreasing process A(t) is chosen by the controller subject to the condition where y is a constant representing the initial amount of fuel. The object is to maximize the probability that X(t) reaches a. The optimal process is determined when the function has a unique minimum on [0, a] and satisfies certain regularity conditions. The optimal process is a combination of ‘timid play' in which fuel is used gradually in the form of local time at 0, and ‘bold play' in which all the fuel is used at once.

In this paper, we develop a unified approach for stochastic load balancing on various multiserver systems. We expand the four partial orderings defined in Marshall and Olkin, by defining a new ordering based on the set of functions that are symmetric, L-subadditive and convex in each variable. This new partial ordering is shown to be equivalent to the previous four orderings for comparing deterministic vectors but differs for random vectors. Sample-path criteria and a probability enumeration method for the new stochastic ordering are established and the ordering is applied to various fork-join queues, routing and scheduling problems. Our results generalize previous work and can be extended to multivariate stochastic majorization which includes tandem queues and queues with finite buffers.

A single machine is available to process a collection of stochastic jobs preemptively. Rewards are received at job completions. We seek policies for machine allocation which maximize the total reward. Application areas point to the need to study such models for resource allocation when job processing requirements are dependent. To this end, models are developed in which the nature of such dependence is derived from various notions of positive and negative dependence in common usage in reliability. Optimal policies for resource allocation of simple structure are obtained for a variety of such models.

The M/G/1 queue with batch arrivals and a queueing discipline which is a generalization of processor sharing is studied by means of Crump–Mode–Jagers branching processes. A number of theorems are proved, including investigation of heavy traffic and overloaded queues. Most of the results obtained are also new for the M/G/1 queue with processor sharing. By use of a limiting procedure we also derive new results concerning M/G/1 queues with shortest residual processing time discipline.

In this paper we investigate dynamic routing in queueing networks. We show that there is a heavy traffic limiting regime in which a network model based on Brownian motion can be used to approximate and solve an optimal control problem for a queueing network with multiple customer types. Under the solution of this approximating problem the network behaves as if the service-stations of the original system are combined to form a single pooled resource. This resource pooling is a result of dynamic routing, it can be achieved by a form of shortest expected delay routing, and we find that dynamic routing can offer substantial improvements in comparison with less responsive routing strategies.

Consider m queueing stations in tandem, with infinite buffers between stations, all initially empty, and an arbitrary arrival process at the first station. The service time of customer j at station i is geometrically distributed with parameter pi, but this is conditioned on the fact that the sum of the m service times for customer j is cj. Service times of distinct customers are independent. We show that for any arrival process to the first station the departure process from the last station is statistically unaltered by interchanging any of the pi's. This remains true for two stations in tandem even if there is only a buffer of finite size between them. The well-known interchangeability of ·/M/1 queues is a special case of this result. Other special cases provide interesting new results.

Starting with some mild assumptions on the parametrization of the service process, perturbation analysis (PA) estimates are obtained for stationary and ergodic single-server queues. Besides relaxing the stochastic assumptions, our approach solves some problems associated with the traditional regenerative approach taken in most of the previous work in this area. First, it avoids problems caused by perturbations interfering with the regenerative structure of the system. Second, given that the major interest is in steady-state performance measures, it examines directly the stationary version of the system, instead of considering performance measures expressed as Cesaro limits. Finally, it provides new estimators for general (possibly discontinuous) functions of the workload and other steady-state quantities.

The purpose of this note is to point out the connection between the invariance property of M/M/1 and GI/G/1 queues (which has been reported in several papers) and the interchangeability and reversibility properties of tandem queues. This enables us to gain new insights for both problems and obtain stronger invariance results for M/M/1, GI/G/1, as well as loss systems M/M/1/N, GI/G/1/N and tandem systems.

We show that the stationary version of the queueing relation H = λG is equivalent to the basic Palm transformation for stationary marked point processes.