Aluminum nitride (AlN) thin films with different thickness were synthesized by ion-beam assisted deposition on various substrates, Corning 7059 glass, fused silica, Si single crystal, and sapphire, which show the hardness ranging from 7 to 37 GPa. Effects of substrate materials on indentation-hardness of AlN films were studied by using a nanoindentation system equipped with a diamond Berkovich indenter. The maximum force applied to the films was kept at 3 mN. For the films on the Corning 7059 glass substrate, when the normalized penetration depth to the film thickness is 0.98, the film hardness is found to be about 7 GPa, which is close to the hardness of the substrate. While the normalized penetration depth is reduced to 0.11, the film hardness becomes to be about 16 GPa. On the other hand, for the films on the sapphire substrate, when the normalized penetration depth is 0.83, the film hardness is observed to be about 25 GPa, while the normalized penetration depth is reduced to 0.10, the film hardness is found to be about 15 GPa. These results reveal that when the normalized penetration depth to the film thickness is about 0.1, the hardness of the AlN film can be evaluated to be about 15 GPa without being affected by substrate materials.