Based on past astrometric and geodetic VLBI observations, a strategy for implementing differential VLBI (DVLBI) is developed by interpolating the non-geometric delay (NGD) at the target's direction using observations of several reference sources spreaded out within a circular ring centered on the target. In contrast to the ordinary approach, in our design the limitations in the angular distance are relaxed and the effects of observational uncertainties in reference sources are reduced. Analysis shows that in our design a precision of the NGD correction in S-band reaches about 1ns only. Our design can be adopted for observations of weak sources and in deep space exploration.