US Air Force wants AI to assist aerial refueling

The U.S. Air Force is looking to artificial intelligence to improve the performance of its aerial refueling crews.

The goal is for AI to automatically analyze refueling operations from cameras mounted on the tankers and provide “hot wash” feedback to the tanker crews.

According to an Air Force Small Business Innovation Research solicitation, the service wants a system that can “leverage advanced computer vision, machine learning, and aviation (flight dynamics) analytics techniques to automatically extract operationally relevant performance metrics from aerial refueling events, quantify deviations from desired flight profiles, and generate actionable post-flight feedback to improve aircrew proficiency, reduce human-factor-driven mishaps, and enhance mission readiness.”

The application deadline is Nov. 25.

The SBIR is focused on the KC-46 tanker, which will feature a remote vision system that will allow operators to remotely operate the refueling boom via cameras and a 3D display. Though the system has been plagued by teething problems, the Air Force says most will soon be resolved.

The system would automatically track the tanker and refueling boom, as well as the receiving aircraft. It would measure a variety of data, including position, velocity, alignment and closure rate, and assess whether they deviate from nominal parameters.

The Air Force hopes an AI-based assessment system will mitigate the biases inherent in human assessment of aerial refueling, which is among the most demanding tasks for aircrew.

“Current aerial refueling training and post-flight assessment processes rely heavily on instructor observation, pilot self-assessment, manual video review, and subjective evaluation of performance,” the SBIR noted.

The system would create visual displays to improve the performance of pilots of the aircraft receiving fuel, such as “graphic AI overlays, heat maps, event timelines, and immersive or interactive debrief environments.” It would also have the potential to integrate with other training systems, including virtual and augmented reality, simulators, mission rehearsal systems, and other computer-based training tools.

The Air Force sees this as a prototype for future AI-based training systems.

“The desired end state is an operationally demonstrated capability ready to implement for at least one type of receiver aircraft and that can support transition into existing aviation training ecosystems and provide a scalable foundation for future AI-enabled aviation performance assessment across the Department of Defense,” the solicitation reads.