Project Details

The Challenge | Out of This World!

Create an app to pilot an unmanned aerial system (UAS), such as a NASA space drone, utilizing the 6-axis gyro sensor within a smartphone or tablet. The piloting app can be combined with multiple sensors for flight precision and the best maneuverable flight techniques for off-Earth planetary drones.

Drone-se

Drone-se is a mobile application for monitoring and control of UAS used in space exploration, especially in case of autonomy failures.

Background: The challenge was chosen due to the team's area of expertise, which involved Aerospace, Computer, Software and Electrical Engineering. It was also a motivation that drone is a technology widely used for various applications in recent times.


What it does: The application uses the gyroscope, a virtual joystick and was proposed to also use voice commands to control the UAS. To aid navigation, a screen has been implemented that displays the image captured by the drone camera, a button to order the automatic return to the control point and the reading of the various sensors required: camera, battery, velocimeter, altimeter, conectivity, barometer, termometer, magnetometer, Geiger counter and gas concentration. The idea is to enable the re-establishment of autonomous control, if possible after the situation has been controlled, from a manual control mode to a monitoring mode. Were also implemented a screen to display the drone area affected by the fault and another screen that presents recommendations for decision making algorithms and automatic fault recovery mechanisms. In case of camera failure, there is a button to activate the terrain topology view. The goal is to combine this form of visualization with the Inverse Augmented Reality, technique in which a virtual drone recognizes the real drone and is positioned in the last registered position, allowing the control of both with the same commands. This allows the real drone to be guided without any real context visualization, no camera or GPS, which is not a technology available off Earth. One proposed feature is the recording of collected data so that in the worst case at least the data is not lost.


NASA Resources: It is recommended that the UAS to be controlled uses Independent Configurable Architecture for Reliable Operations of Unmanned Systems with Distributed On-Board Services (ICAROUS-2) and Detect and Avoiding Alerting Logic for Unmanned Systems (DAIDALUS) with Dynamic Well-Clear Separation Volumes.


Space Apps Offers: No offers from Space Apps Collaborators were used and no offers from local sponsors were made.


Future Plans: It is necessary to implement the proposed idea of Inverse Augmented Reality and voice commands. The app can be used for UAS control in other contexts such as agriculture and audiovisual. New features can be implemented or extended to control existing types of unmanned vehicles, not just aerial.


Built With: For development of the app was used Flutter SDK and for testing we used smartphones and Parrot-Sphinx simulation tool.


Try it out: https://github.com/ShakaWaka/drone-control.


Tags: #UAS #UAScontrol #augmentedReality #inverseAugmentedReality #failureRecovery #controlApp #spaceExploration #flutter #mobileDev #mobileDevelopment #failureDiagnosis