With the dangerous and troublesome nature of hollow defects inside building structures, hollowness inspection has always been a challenge in the field of construction quality assessment. Several methods have been proposed for inspecting hollowness inside concrete structures. These methods have shown great advantages compared to manual inspection but still lack autonomy and have several limitations. In this paper, we propose a range-point migration-based non-contact hollowness inspection system with sensor fusion of ultra-wide-band radar and laser-based depth camera to extract both outer surface and inner hollowness information accurately and efficiently. The simulation result evaluates the performance of the system based on the original range-point migration algorithm, and our proposed one and the result of our system show great competitiveness. Several simulation experiments of structures that are very common in reality are carried out to draw more convincing conclusions about the system. At the same time, a set of laboratory-made concrete components were used as experimental objects for the robotic system. Although still accompanied by some problems, these experiments demonstrate the availability of an automated hollow-core detection system.