To solve the on-ground lateral direction control problem of the unswept flying-wing unmanned aerial vehicle (UAV) without rudder, steering system or breaking system, a control approach which uses differential propeller thrust to control the lateral direction is proposed. First, a mathematical model of the unswept flying-wing UAV on-ground moving is established. Second, based on the active disturbance rejection control (ADRC) theory, a yaw angle controller is designed by using the differential propeller thrust as the control output. Finally, a straight line trajectory tracking control law is designed by improving the vector field path following method. Experiment results show that the proposed control laws have a shorter response time, better robustness and better control precision compared with proportional integral derivative (PID) controller. The proposed controller has small computational complexity, simple parameter setting process, and uses practical measurable physical quantities, providing a reference solution for further engineering applications.