The problem of controlling transmission rate over a randomly varying
channel is cast as a Markov decision process wherein the channel is
modeled as a Markov chain. The objective is to minimize a cost that
penalizes both buffer occupancy (equivalently, delay) and power. The
nature of the optimal policy is characterized using techniques adapted
from classical inventory control.