We have performed neutron scattering experiments on rare-earth (La, Pr, Ho) doped phosphate glasses around the metaphosphate composition R(PO3)3. Combining the diffraction experiment with Reverse Monte Carlo simulations we obtain a 3-D model of the structure. Our models propose a rare-earth ion environment primarily consisting of oxygens with the average rare earth-oxygen distances; 2.56, 2.51 and 2.40 Å for the La, Pr and Ho samples respectively. We also observe that the rare earth ions are not uniformly distributed. The first R-R shell is on avergae about 3.3 Å to be compared with a value of 7 Å for a uniform distribution of R ions in the structure. From the models we also conclude that a chain like structure of the phosphate network is in agreement with the experiment.