Cases

Augmented reality-based production for Aircraft assembly

The production center in Komsomolsk-on-Amur, a branch of PJSC "Yakovlev" – "Regional Aircrafts" (production center "Yakovlev"), is implementing a project that applies augmented reality (AR) technologies and devices (AR glasses).

The solution is based on the ready-made industrial software platform "IKSAR", which serves as the foundation for the final solution.

AR glasses and the domestic software "IKSAR" are used to provide employees with necessary information during the assembly of the aircraft electrical connector. While working with the assembly map of the technological passport, the AR glasses display on the screen the area of the electrical connector with terminal locations, connector size, wire color, wire cross-section, unused terminals, as well as other information about the harness, technological passport numbers, etc.

This approach allows employees to access the required information directly on the AR glasses display, instead of constantly reviewing paper documents with step-by-step technological operations, and insert the wire into the correct terminal.

All actions on the AR glasses are controlled by voice commands. Active noise cancellation on the microphones helps the device pick up only the user's commands, filtering out background noise or speech from others.

For added convenience, an intelligent optimized voice input system for entering the tag number has been developed, minimizing search time for the required values and reducing the likelihood of errors when recognizing alphanumeric voice commands.

The implemented solution includes both server and mobile components. The server side features an expanded interface for creating and configuring various types of connectors and all technological passport operations, including preparation for assembly, as well as functionality for task planning and performance tracking, involving the coordination of tasks by the production supervisor and quality control inspector during the work process.

The expanded interface for all technological passport operations includes the ability to create detailed work instructions for the assembly card on the device, support for various types of electrical connectors, and the ability to take photos and videos to document the work done and identify defects or faults.

The IKSAR platform allows for video conferencing between the employee wearing the AR glasses and a remote expert or group of experts. The remote expert can view the problem from the first-person perspective in real time and provide guidance on how to resolve the issue, including the ability to annotate the live video feed with augmented reality elements.

The system also supports the mobile component's functionality not only on AR glasses but also on traditional tablets and smartphones, further expanding the application's potential use cases.

The system generates a digital trace of the user's actions in the AR glasses, allowing for the creation of detailed reports on completed tasks from different perspectives.

The combination of these actions in the system may eventually eliminate the need for paper technological passports, significantly enhance employee productivity, and reduce the likelihood of errors.