In recent years, high-performance flying drones attract attention for many peoples. In particular, the drone equipped with multi-rotor is expanding its range of utilization in video imaging, aerial rescue, logistics, monitoring, measurement, military field, etc. However, the control function of its controller is very simple. In this study, using a G-sensor mounted on a mobile device, implements an enhanced controller to control flying drones through the intuitive gesture of user. The implemented controller improves the gesture recognition performance using a neural network algorithm.