Simulation of complex scenario with audio and video detectors running in parallel, and communication service listening and communicating event.
Simulation of complex scenario with audio and video detectors running in parallel, and communication service listening and communicating event.

Drone Detection and Communication Service

The Drone Detection and Communication Service is a conceptual solution that will address surveillance and detection capabilities integrating AI models and communication mechanisms for detecting drones flying on restricted areas of urban environments. This solution aims to develop an AI-powered drone detection system in an urban setting, focusing on monitoring and identifying unauthorized drone activity within restricted airspaces around critical infrastructure sites using affordable technology like cameras and arrays of microphones. The operational scope encompasses a diverse group of operators managing a fleet of drones, including those authorized to operate within the monitored airspace and others that deliberately intrude into prohibited zones. The goals of the solution are to use AI models based on multi sensor data such as visual and audio for identifying and differentiating between authorized and unauthorized drone activities within the monitored airspace, and to establish the communication methods and protocols for contacting drone operators. The validation of the solution assesses the real-time performance of the system under various conditions in simulated environments mimicking operation conditions that could hinder its efficacy. The aim is to demonstrate the reliability of artificial intelligence techniques to detect rogue or noncompliant drones, which is of high relevance to protect key infrastructures and identify attacks or access and privacy violations. This solution provides highly accurate drone detection capabilities while reducing costs by using cost-effective sensor data.

Validation scenarios

The scenarios of solution consider urban area with complex layout and simple layout to test the drone detection system’s capabilities across a spectrum of urban environments. These scenarios are designed to test the drone detection system’s capabilities under various conditions, ensuring its potential effectiveness in real-world applications.

Validation Scenario 1: Urban Area with Simple Layout. This scenario simulates an urban environment with a simpler layout, where the focus is on the effectiveness of the drone detection system in less congested areas and a reduced number of flight plans and no complex communication situations such as drones with flight plan authorized to fly over the restricted area, since in these situations it is not necessary to contact the operator when the drone is detected.

Validation Scenario 2: Urban Area with Complex Layout. This scenario simulates an urban environment characterized by a complex layout, including multiple high-rise buildings, busy streets, potential obstructions to drone detection, and complex situations such as drones with an approved flight plan not crossing the restricted area where the drone is being detected, which implies having to contact the operator to correct the situation.

KPAs: Safety, Security, Interoperability

Flight plans for validation. Two flight plans crossing restricted area, and three plans not crossing.

Flight plans for validation. Two flight plans crossing restricted area, and three plans not crossing.

 

Simulation of complex scenario with audio and video detectors running in parallel, and communication service listening and communicating event.

Simulation of complex scenario with audio and video detectors running in parallel, and communication service listening and communicating event.

Graphical user interface of the drone detection model using optical sensor (camera)

Graphical user interface of the drone detection model using optical sensor (camera)

 

Contact info:

Enrique Puertas, european University of Madrid, enrique.puertas@universidadeuropea.es

Simulated UAS traffic scenario - conflicting volumes are highlighted in red, while conflict-free volumes are shown in blue.
Simulated UAS traffic scenario - conflicting volumes are highlighted in red, while conflict-free volumes are shown in blue.

Automated Flight Plan Approval Service

The Autonomous Flight Plan Approval Service (A-FPLAS) is an AI-powered solution designed to streamline the process of evaluating and approving flight plans for drones. As part of the SESAR solution framework, A-FPLAS analyzes essential parameters, including weather, airspace constraints, drone capabilities, and regulatory requirements, ensuring that all flight plans comply with safety and operational standards. The service operates in real-time, comparing each new flight request against a dynamic database of approved plans within a reasonable time to act (RTTA) window, optimizing airspace management in high-density or urban environments.

If a flight plan cannot be approved immediately due to conflicts or other restrictions, A-FPLAS generates a U-Plan recommendation, which provides optimized routing alternatives to help operators adjust and resubmit for swift approval. This functionality enhances the system’s flexibility and efficiency, allowing drone operators to respond quickly to dynamic airspace conditions and reducing bottlenecks in the approval process.

The validation of the Autonomous Flight Plan Approval Service (A-FPLAS) focuses on three key capabilities, each associated with specific validation objectives and key performance indicators (KPIs). The first objective (OBJ-SOL0450-ERP-001) is to assess the compliance of submitted flight plans with the dynamic airspace structure, including geolocation, capacity, restrictions, weather, and turbulence conditions. The KPI for this objective is the system’s ability to return compliance results for all flight plans within the Reasonable Time to Act (RTTA) window. The second objective (OBJ-SOL0450-ERP-002) is to evaluate conflict detection among submitted flight plans, considering their assigned priorities and operational uncertainties (e.g., drone type, performance, wind). The corresponding KPI is the successful assessment of all flight plans within a single RTTA window, providing real-time approval or rejection decisions. The third objective (OBJ-SOL0450-ERP-003) is to generate recommendation actions for rejected flight plans. The KPIs here include the system’s ability to return clear rejection reasons and provide operators with feasible alternative actions, also within the RTTA window. These validation scenarios collectively demonstrate A-FPLAS’s ability to deliver safe, efficient, and real-time autonomous flight plan processing.

 

Autonomous Flight Plan Approval System process flow: Including U-Plan Authorization and U-Plan Recommendation

 

Connection of Autonomous Flight Plan Approval System (A-FPLAS) with other U-space Services

 

Simulated UAS traffic scenario – conflicting volumes are highlighted in red, while conflict-free volumes are shown in blue.

Airspace design service

The Airspace Design service is a conceptual solution to design an airspace structure in an urban area. The airspace could use tubes or free route, but the traffic could also be organised another way. The concept is based on a methodology that identifies different operational and environmental constraints such as for instance wind and turbulence in specific urban areas or the type of UAV’s operations (VLOS or BVLOS). A specific micro-weather AI-based model on wind and turbulence has been developed to define areas of high wind and turbulence intensity that could lead to define restricted areas for UAS.

The proposed Airspace Design tool is an AI-driven tool that will automate the activation of airspace structures (restricted areas and tubes); thus, allowing drones to operate in urban airspace. The structures can be activated or deactivated (meaning that UAV’s operations could be allowed or not) depending on the operational needs for a given day and the reduction of UAS operations noise impact.

Vertiport location and separation minima between structures have been studied, based on the type of the UAVs and the nature of their operations. For instance, the solution could consider a tube (to connect vertiports in case of a UAM traffic) and different volumes for zones of surveillance operation, for transit above the city and for VLOS operation close to the ground (leisure or inspection, etc.). Each volume would organize the traffic differently (e.g., with layers or free route).

This solution is a methodology to support local authorities and U-space stakeholders in designing an airspace by defining and activating structures to facilitate several types of UAS operations in an urban environment while considering safety aspects (e.g., weather) and social impact (e.g., noise).

Validation scenario:

The solution scenario takes place in the city of Prague. Based on the already filled U-plans, the airspace design tool proposes adapted airspace structures to operations that are supposed to be performed that day. Structures will have been defined beforehand, and the model will propose activation of the appropriate ones.

The airspace design concept has identified areas such as no drone zone, restricted airspace, nature reserves and other noise-sensitive areas or environmentally sensitive areas and forbidden areas. It also integrates data coming from the AI-based wind and turbulence model to create, if necessary, micro-weather dangerous or restricted areas.

UAS operators use micro-weather data and the airspace design proposed by the airspace design tool to create and modify, if necessary, details of their operations (e.g., 4D trajectories, cancel operation).

The concept has been tested with two operational scenarios (in FTS): 15 drones and 50 drones.

KPAs: Safety (SAF), Capacity (CAP), Environment (ENV)

15 drones trajectories over Prague in a full-tubes scenario (with the restricted area above the city center)

 

 

 Trajectories of 15 drones in Prague with the computed airspace design (activation of restricted areas)

 

 

Noise hotspots generated by the computed airspace design (activation of restricted areas but no corridors)

 

Contact info

Yannick SEPREY, Sopra Steria, yannick.seprey@soprasteria.com

Report on 2nd Workshop of AI4HyDrop

Summary report of the second meeting of the AI4HyDrop project, funded by SESAR JU and the European Union, focused on the safe and efficient management of urban airspace for drones. The workshop discussed solutions for airspace structuring, flight planning and drone detection, using artificial intelligence to optimize traffic management and predict weather conditions. The need for human supervision in AI systems, high quality data and collaboration between service providers for seamless communication is emphasized. The report includes presentations and discussions on each solution, as well as test and validation results.

Download report here: Workshop 2-Report-v2 clean

Mandar Tabib of SINTEF Digital Norway, and researcher on the EU-funded AI4HyDrop project, explains the use of AI to predict urban-scale wind and turbulence for drone operations.
The goal of this project task is to use AI to predict microscale wind and turbulence patterns, which are affected by turbulence induced by buildings and terrain. Current physics-based models take a long time to compute these predictions, whereas AI can provide fast predictions that are essential for drone operations such as route planning and dynamic airspace management.
The AI model was trained using data generated using computational fluid dynamics (CFD) simulations of a segment of the city of Prague. The CFD simulations were performed for different mesoscale wind directions and intensities, providing a dataset of microscale wind and turbulence patterns. Subsequently, an unsupervised machine learning technique was used to train the AI model using this dataset.The AI model has been used in a reinforcement learning model in which drones learn to avoid regions of high turbulence. The fast prediction speed of the AI model allows real-time decisions to be made for drone route planning.

Shaping the future of U-space: Flight planning, drone detection and airspace design

Shaping the future of U-space: Flight planning, drone detection and airspace design

🗓️ 2nd Workshop of the AI4HyDrop project

September 27, 2024. from 9:00 to 13:00 (F2F event).

We are excited to announce that the AI4HyDrop project will be hosting an insightful workshop dedicated to the advancements and challenges in drone technology. Scheduled for September 27, 2024, from 09:00 to 13:00 at the Campus of the European University of Madrid, this event will be a cornerstone for professionals, researchers, and enthusiasts interested in the intersection of U-space, artificial intelligence, and drone operations.

AGENDA

09:00 – 09:30 – Welcome coffee and introduction.

09:30 – 10:25 – Airspace structure and flight rules.

10:30 – 11:25 – Drone Flight Planning.

11:30 – 12:25 – Drone detection and communication.

12:30 – 12:45 – Conclusions.

12:45 – Lunch.

 


We invite you to participate in this event. Join us to explore the latest advancements in the utilization of AI for future drone operations.

🔗 To secure your spot, we kindly request you to register promptly through the Eventbrite platform by following the registration link provided below.


🎟️ Registration Link: https://www.eventbrite.com/e/ai4hydrop-2nd-workshop-tickets-961354456057

Report on Workshop AI4HyDrop (February 7th, 2024)

Report on Workshop AI4HyDrop

This Workshop report presents the organization of the 1st workshop with the AI4HyDrop Advisory board members and relevant U-Space stakeholders. This event is part of WP2 Requirements and Holistic Conceptual Framework.

The workshop began with a plenary session introducing the AI-based Holistic Dynamic Framework for safe drone operations. It was followed by three separate sessions, each addressing different aspects of UAS (Unmanned Aerial System) integration into airspace. Each session was conducted twice to allow participants to engage with topics of their interest.

  • Session 1: Airspace Design for UAS Operations.  In this sessesion we discussed the design of airspace to accommodate UAS operations, including the structural aspects and considerations for UAS integration. Discussion points included fairness, priority in authorization systems, economic importance and network integration of vertiports, and the role of UTM (Unmanned Traffic Management) in assisting UAS flights. Participants raised questions about accessing airspace information in emergencies, deconfliction strategies, and the necessity for a common language in flight plan formats to ensure conformance monitoring during flight operations.
  • Session 2: Detection and Identification of Drones. This session covered the methods and technologies for detecting and identifying drones in restricted areas. Discussion highlights included the importance of timely detection, the need for additional parameters in drone type data for flight plans. The session also touched upon the challenges associated with drone detection and the best solutions identified for urban environments.
  • Session 3: AI Transformation in Flight Plan Authorization Processes. This session focused on how AI can transform the authorization processes of flight plans, emphasizing automation and efficiency. Discussion points involved the format of flight plans, airspace capacity considerations, deconfliction, and monitoring during flights. The session also explored the integration of various parameters for drone types into the flight plan data to enhance safety and operational efficiency.

Download here the full report

Drone data analytics, abstract background digital data concept, data drone and patterns, dark background in the night
Drone data analytics, abstract background digital data concept, data drone and patterns, dark background in the night

AIHyDrop’s Upcoming Participation in Premier U-Space events

U-ELCOME poster

AIHyDrop, an innovative project dedicated to the application of Artificial Intelligence (AI) for designing urban airspace for drones, is set to attend two significant upcoming events in the aviation sector. These events are the U-welcome workshop and FLY AI Forum 2024, both of which promise insightful discussions and valuable networking opportunities.

Firstly, AIHyDrop will participate in the U-welcome workshop taking place on April 9-10, 2023, in Barcelona (https://u-welcome.eu/the-second-u-welcome-workshop-is-coming-next-9-10-april-in-barcelona/). This event aims to foster collaboration and provide a platform for discussions on the key topics and challenges arising in the early stages of implementing U-space technologies. By attending this workshop, AIHyDrop team members will have the opportunity to engage with current and future implementors, share experiences, and address concerns about U-space and its digital services. Moreover, they will contribute valuable insights during dedicated sessions covering various technical and related topics, which will be collected in a handbook called “U1 and U2 implementation best practices handbook.” This handbook will serve as a crucial output of the U-ELCOME project, helping to harmonize Europe’s approach to U-space implementation.

Secondly, AIHyDrop will present the preliminary outcomes of their research at the FLY AI Forum 2024: How is AI shaping aviation? (https://www.eurocontrol.int/event/fly-ai-forum-2024), scheduled for April 29-30, 2024, in Brussels. Organized by the European Commission, EASA, ASD, CANSO, EDA, EUROCAE, IATA, IFATCA, IFATSEA, ACI EUROPE, NATO, and the SESAR Joint Undertaking, this forum will showcase the latest AI-based applications in aviation and explore ways to further promote AI adoption within the industry. By participating in this event, AIHyDrop will have the opportunity to share their groundbreaking research findings with fellow professionals and learn from other experts in the field, thereby expanding their professional network and staying updated on the latest trends and developments in AI for aviation applications.

AIHyDrop’s participation in these two events marks an exciting milestone for the project as it paves the way for further collaboration, knowledge exchange, and networking opportunities within the aviation sector. Stay tuned for updates on their progress and findings from these events.

4th Workshop on the Future of the Innovative Air Mobility

🌟✈️ The 4th Workshop on the Future of the Innovative Air Mobility” was held in Madrid on 22nd February 🚁🔗
The program had several talks related to the future of air mobility in urban environments, so members of the #AI4HyDrop project attended the event to know the point of view of different stakeholders on issues very close to the objectives of #AI4HyDrop, and to know what other projects are being carried out with the idea of looking for synergies.
In the initial talk of the event, JOSE MARIA Pérez REVENGA spoke about the importance of having a clear regulation on the use of drones in urban environments, emphasising the need to regulate altitudes, distances and maximum number of drones in specific areas. Roberto Trigo from CDTI Innovación – Centro para el Desarrollo Tecnológico y la Innovación presented the programme and commented on the different funding possibilities for projects in the aerospace sector, and that work will be done to ensure that this funding is stable and maintained over time. He commented on the commitment that is being made in Spain for the sector, and highlighted the new facilities that have been set up in the city of Huelva for high-capacity drones.

In the talk by Bobby Healy of Manna Drone Delivery, the company and its parcel delivery services using drones, which are already operating successfully in cities such as Texas and Dublin, were presented. Bobby highlighted that Europe is a prime location for drone business ventures. Healy also addressed noise and privacy concerns as perceptual challenges rather than real obstacles, and cited successful drone delivery experiences in Australia as an example.

EASA’s Maria Algar Ruiz‘s keynote talked a lot about EASA‘s work, and discussed the regulatory framework for vertical take-off and landing (VTOL) drones, EASA’s vision for Innovative Air Mobility and the roadmap for drone technology integration.

In the round table on drone logistics, there were interesting examples and discussions on drone package delivery. Diego Fernández Varela from @Wing talked about how his company is automating most of the delivery process with drones, which is very close to the goals of AI4HyDrop. Enrique Sánchez Hernández y Jose Ignacio Rodriguez also offered interesting points of view on the current state of logistics using drones.

In the second keynote of the workshop, Vassilis AGOURIDAS presented the UIC2 initiative (@Urban-air-mobility Initiative Cites Community) and its focus on urban aviation and the integration of low-altitude air traffic with ground mobility systems. He emphasised the importance of safety in urban aviation and the potential benefits for city mobility systems. He acknowledged the role of local governments in addressing citizens’ concerns about drone operations within cities, and emphasised the need to go hand in hand with municipalities and local governments when working on drone projects.
🌍💡 #FutureAirMobility #SESAR3JU #DigitalSky #AirTrafficManagement #iMOV3D #CDTI

Drone data analytics, abstract background digital data concept, data drone and patterns, dark background in the night
Drone data analytics, abstract background digital data concept, data drone and patterns, dark background in the night

U-plan data and format

Different airspace users will have different mission needs, requiring flight plan formats able to reflect them and also to leverage the flexibility of the drone operations. Besides, future smart services addressed to optimize or support the design of the missions could take as input details that can make a difference in their results. Do you want to help us to identify all these parameters? You can also suggest a candidate format por a future U-plan standard that would boost the compatibility between the services offered by the U-space Service Providers.

SESAR U-plan data formatOn January 7th 2024, during the first AI4HyDrop Workshop, we invited the participants to contribute with their suggestions for U-plan data and format. We will listen to your feedback along the whole project (around the end on 2025), to reflect your ideas in a final report.

Note that here we want to focus in the flight plan sent by the operators to U-space, not in any dataset that could be shared between services.

To introduce the motivation of the survey, it was explained the case of the project Labyrinth. During it, operators were allowed to submit plans where trajectories would be described as a sequence of points or an area to scan, with the possibility to add some area to avoid.

However, during the validations, the final users reported different needs that had to be reflected also in the flight plan, like the possibility to define geo-cages, to fly at a certain altitude, or to define segregated volumes in the origin or destination for the fixed wings to execute their climb/descend manoeuvres. There were also technical limitations and the desire to specify preferences to be allowed if possible.

In Labyrinth, it was selected JSON as the format for the messages to communicate with the U-space.

 

Same as in the project DACUS, Labyrinth selected the GeoJSON standard to represent the flight plans. It allows to describe the trajectories as a sequence of points and areas or volumes.

In GeoJSON, a large number or elements can be added to the coordinates, which allows to specify information and constraints associated to the waypoints.

However, inspired by proposals that suggest high level flight plan specifications, we could consider the possibility of using plans with the capability to reflect complex parts like conditions or loops.

The article in the slide was suggesting a high-level format that would be translated into a list of waypoints to be uploaded to the drone. In our case, a similar high-level specification could be sent to the Operation Plan Preparation/Optimisation service, which would convert it to a more low-level format to be processed by the Flight Authorization service. In the event that the Operation Plan Preparation/Optimisation service is not available, the option to directly send a simpler format should be possible.

All this is just a suggestion and we want to hear your feelings about the existence of both formats and what details or semantics would you need to be reflected on them.

Add your contributions to the following board (choose Guest, write any random name, and then you will be able to add sticky notes)

or just write to us: MiguelAngel.FasMillan@dlr.de

 

Some needs are only identified when final users create their missions for real flights, that is why your feedback is important us!