We aim to link random fields and marked point processes, and, therefore, introduce a new class of stochastic processes which are defined on a random set in . Unlike for random fields, the mark covariance function of a random marked set is in general not positive definite. This implies that in many situations the use of simple geostatistical methods appears to be questionable. Surprisingly, for a special class of processes based on Gaussian random fields, we do have positive definiteness for the corresponding mark covariance function and mark correlation function.

Let Sn, k denote the random graph obtained by placing points in a square box of area n according to a Poisson process of intensity 1 and joining each point to its k nearest neighbours. Balister, Bollobás, Sarkar and Walters (2005) conjectured that, for every 0 < ε < 1 and all sufficiently large n, there exists C = C(ε) such that, whenever the probability that Sn, k is connected is at least ε, then the probability that Sn, k+C is connected is at least 1 - ε. In this paper we prove this conjecture. As a corollary, we prove that there exists a constant C' such that, whenever k(n) is a sequence of integers such that the probability Sn,k(n) is connected tends to 1 as n → ∞, then, for any integer sequence s(n) with s(n) = o(logn), the probability Sn,k(n)+⌊C'slog logn⌋ is s-connected (i.e. remains connected after the deletion of any s − 1 vertices) tends to 1 as n → ∞. This proves another conjecture given in Balister, Bollobás, Sarkar and Walters (2009).

In this paper we consider three-dimensional random tessellations that are stable under iteration (STIT tessellations). STIT tessellations arise as a result of subsequent cell division, which implies that their cells are not face-to-face. The edges of the cell-dividing polygons are the so-called I-segments of the tessellation. The main result is an explicit formula for the distribution of the number of vertices in the relative interior of the typical I-segment. In preparation for its proof, we obtain other distributional identities for the typical I-segment and the length-weighted typical I-segment, which provide new insight into the spatiotemporal construction process.

An asset manager invests the savings of some investors in a portfolio of defaultable bonds. The manager pays the investors coupons at a constant rate and receives a management fee proportional to the value of the portfolio. He/she also has the right to walk out of the contract at any time with the net terminal value of the portfolio after payment of the investors' initial funds, and is not responsible for any deficit. To control the principal losses, investors may buy from the manager a limited protection which terminates the agreement as soon as the value of the portfolio drops below a predetermined threshold. We assume that the value of the portfolio is a jump diffusion process and find an optimal termination rule of the manager with and without protection. We also derive the indifference price of a limited protection. We illustrate the solution method on a numerical example. The motivation comes from the collateralized debt obligations.

We deal with the filtering problem of a general jump diffusion process, X, when the observation process, Y, is a correlated jump diffusion process having common jump times with X. In this setting, at any time t the σ-algebra provides all the available information about Xt, and the central goal is to characterize the filter, πt, which is the conditional distribution of Xt given observations . To this end, we prove that πt solves the Kushner-Stratonovich equation and, by applying the filtered martingale problem approach (see Kurtz and Ocone (1988)), that it is the unique weak solution to this equation. Under an additional hypothesis, we also provide a pathwise uniqueness result.

We study a class of tenable, irreducible, nondegenerate zero-balanced Pólya urn schemes. We give a full characterization of the class by sufficient and necessary conditions. Only forms with a certain cyclic structure in their replacement matrix are admissible. The scheme has a steady state into proportions governed by the principal (left) eigenvector of the average replacement matrix. We study the gradual change for any such urn containing n → ∞ balls from the initial condition to the steady state. We look at the status of an urn starting with an asymptotically positive proportion of each color after jn draws. We identify three phases of jn: the growing sublinear, the linear, and the superlinear. In the growing sublinear phase the number of balls of different colors has an asymptotic joint multivariate normal distribution, with mean and covariance structure that are influenced by the initial conditions. In the linear phase a different multivariate normal distribution kicks in, in which the influence of the initial conditions is attenuated. The steady state is not a good approximation until a certain superlinear amount of time has elapsed. We give interpretations for how the results in different phases conjoin at the ‘seam lines’. In fact, these Gaussian phases are all manifestations of one master theorem. The results are obtained via multivariate martingale theory. We conclude with some illustrating examples.

A classical result about Markov jump processes states that a certain class of dynamical systems given by ordinary differential equations are obtained as the limit of a sequence of scaled Markov jump processes. This approach fails if the scaling cannot be carried out equally across all entities. In the present paper we present a convergence theorem for such an unequal scaling. In contrast to an equal scaling the limit process is not purely deterministic but still possesses randomness. We show that these processes constitute a rich subclass of piecewise-deterministic processes. Such processes apply in molecular biology where entities often occur in different scales of numbers.

In this paper we consider the generalized Hodgkin-Huxley model introduced in Austin (2008). This model describes the propagation of an action potential along the axon of a neuron at the scale of ion channels. Mathematically, this model is a fully coupled piecewise-deterministic Markov process (PDMP) in infinite dimensions. We introduce two time scales in this model in considering that some ion channels open and close at faster jump rates than others. We perform a slow-fast analysis of this model and prove that, asymptotically, this ‘two-time-scale’ model reduces to the so-called averaged model, which is still a PDMP in infinite dimensions, for which we provide effective evolution equations and jump rates.

This paper deals with discrete-time Markov decision processes (MDPs) under constraints where all the objectives have the same form of expected total cost over the infinite time horizon. The existence of an optimal control policy is discussed by using the convex analytic approach. We work under the assumptions that the state and action spaces are general Borel spaces, and that the model is nonnegative, semicontinuous, and there exists an admissible solution with finite cost for the associated linear program. It is worth noting that, in contrast to the classical results in the literature, our hypotheses do not require the MDP to be transient or absorbing. Our first result ensures the existence of an optimal solution to the linear program given by an occupation measure of the process generated by a randomized stationary policy. Moreover, it is shown that this randomized stationary policy provides an optimal solution to this Markov control problem. As a consequence, these results imply that the set of randomized stationary policies is a sufficient set for this optimal control problem. Finally, our last main result states that all optimal solutions of the linear program coincide on a special set with an optimal occupation measure generated by a randomized stationary policy. Several examples are presented to illustrate some theoretical issues and the possible applications of the results developed in the paper.

Let {Xt, t ≥ 1} be a sequence of identically distributed and pairwise asymptotically independent random variables with regularly varying tails, and let {Θt, t ≥ 1} be a sequence of positive random variables independent of the sequence {Xt, t ≥ 1}. We will discuss the tail probabilities and almost-sure convergence of X(∞) = ∑t=1∞ΘtXt+ (where X+ = max{0, X}) and max1≤k<∞∑t=1kΘtXt, and provide some sufficient conditions motivated by Denisov and Zwart (2007) as alternatives to the usual moment conditions. In particular, we illustrate how the conditions on the slowly varying function involved in the tail probability of X1 help to control the tail behavior of the randomly weighted sums. Note that, the above results allow us to choose X1, X2,… as independent and identically distributed positive random variables. If X1 has a regularly varying tail of index -α, where α > 0, and if {Θt, t ≥ 1} is a positive sequence of random variables independent of {Xt}, then it is known – which can also be obtained from the sufficient conditions in this article – that, under some appropriate moment conditions on {Θt, t ≥ 1}, X(∞) = ∑t=1∞ΘtXt converges with probability 1 and has a regularly varying tail of index -α. Motivated by the converse problems in Jacobsen, Mikosch, Rosiński and Samorodnitsky (2009) we ask the question: if X(∞) has a regularly varying tail then does X1 have a regularly varying tail under some appropriate conditions? We obtain appropriate sufficient moment conditions, including the nonvanishing Mellin transform of ∑t=1∞Θt along some vertical line in the complex plane, so that the above is true. We also show that the condition on the Mellin transform cannot be dropped.

Importance sampling is a widely used variance reduction technique to compute sample quantiles such as value at risk. The variance of the weighted sample quantile estimator is usually a difficult quantity to compute. In this paper we present the exact convergence rate and asymptotic distributions of the bootstrap variance estimators for quantiles of weighted empirical distributions. Under regularity conditions, we show that the bootstrap variance estimator is asymptotically normal and has relative standard deviation of order O(n−1/4).

Nonnegative infinitely divisible (i.d.) random variables form an important class of random variables. However, when this type of random variable is specified via Lévy densities that have infinite integrals on (0, ∞), except for some special cases, exact sampling is unknown. We present a method that can sample a rather wide range of such i.d. random variables. A basic result is that, for any nonnegative i.d. random variable X with its Lévy density explicitly specified, if its distribution conditional on X ≤ r can be sampled exactly, where r > 0 is any fixed number, then X can be sampled exactly using rejection sampling, without knowing the explicit expression of the density of X. We show that variations of the result can be used to sample various nonnegative i.d. random variables.

We introduce a discrete-time microscopic single-particle model for kinetic transport. The kinetics are modeled by a two-state Markov chain, and the transport is modeled by deterministic advection plus a random space step. The position of the particle after n time steps is given by a random sum of space steps, where the size of the sum is given by a Markov binomial distribution (MBD). We prove that by letting the length of the time steps and the intensity of the switching between states tend to 0 linearly, we obtain a random variable S(t), which is closely connected to a well-known (deterministic) partial differential equation (PDE), reactive transport model from the civil engineering literature. Our model explains (via bimodality of the MBD) the double peaking behavior of the concentration of the free part of solutes in the PDE model. Moreover, we show for instantaneous injection of the solute that the partial densities of the free and adsorbed parts of the solute at time t do exist, and satisfy the PDEs.

In this paper we consider the optimal dividend strategy under the diffusion model with regime switching. In contrast to the classical risk theory, the dividends can only be paid at the arrival times of a Poisson process. By solving an auxiliary optimal problem we show that the optimal strategy is the modulated barrier strategy. The value function can be obtained by iteration or by solving the system of differential equations. We also provide a numerical example to illustrate the effects of the restriction on the timing of the payment of dividends.