This paper focuses on an infinite-server queue modulated by an independently evolving finite-state Markovian background process, with transition rate matrix Q≡(qij)i,j=1d. Both arrival rates and service rates are depending on the state of the background process. The main contribution concerns the derivation of central limit theorems (CLTs) for the number of customers in the system at time t≥0, in the asymptotic regime in which the arrival rates λi are scaled by a factor N, and the transition rates qij by a factor Nα, with α∈ℝ+. The specific value of α has a crucial impact on the result: (i) for α>1 the system essentially behaves as an M/M/∞ queue, and in the CLT the centered process has to be normalized by √N; (ii) for α<1, the centered process has to be normalized by N1−α/2, with the deviation matrix appearing in the expression for the variance.