We consider a class of stationary infinite-order moving average processes with margins in the class of infinitely divisible exponential dispersion models. The processes are constructed by means of the thinning operation of Joe (1996), generalizing the binomial thinning used by McKenzie (1986, 1988) and Al-Osh and Alzaid (1987) for integer-valued time series. As a special case we obtain a class of autoregressive moving average processes that are different from the ARMA models proposed by Joe (1996). The range of possible marginal distributions for the new models is extensive and includes all infinitely divisible distributions with finite moment generating functions, hereunder many known discrete, continuous and mixed distributions.