Safer airports

Date: 2018

  • AI
  • User Centred Design
  • Video Intelligence

Advanced image recognition helps find the owners of unattended luggage

Partners: European airport

An expensive and disruptive problem

Unattended luggage is a major issue for airport operators. Although bags are often left by accident, the potential security risk means that if their owners can’t be tracked down quickly, the entire terminal may have to be evacuated and closed. Most unattended bags are false alarms. But each instance must be taken seriously, so operators deploy large teams of security staff at great expense to make sure even costlier disruption doesn’t happen.

Taking advantage of an existing resource: CCTV

Part of the solution is already installed in modern airports: pervasive CCTV systems mean that passengers and their luggage alike are under constant recorded surveillance. However, reviewing this footage manually to reunite bags with their owners is a prohibitively expensive and time-consuming task. Seeking to explore how CCTV could be used to solve the unattended luggage problem, a major European airport teamed up with Hitachi in Europe and our Global Centre for Social Innovation to explore a new way of matching unattended luggage with its owners.

User-centred design

The questions we wanted to answer were simple. Who left the bag? And where is that person now? We started by understanding how current unattended bags were processed by airport security operations. Our user-centred design methodology makes sure we know the customer’s needs, KPIs and ways of working so that future solutions can be embedded appropriately into their operation.

Communication in motion

Hitachi’s C2X middleware platform is a next-generation system that enables vehicles to exchange information for safer, greener driving:

  • Lightweight and compact for embedded systems
  • Multi-OS support – POSIX compliant systems including RTOS
  • Supports multiple CPUs and hardware: IEEE802.11p or ARIB STD-T109 compliant
  • Compliant with ETSI ITS, IEEE 1609.X, SAE and ITS Connect standards
  • Extensively field-tested

Unique mix of AI technologies

We developed a solution that for the first time blended artificial intelligence technologies for both object detection and person tracking. To spot unattended luggage, the object-detection system uses algorithms to detect whether an object of a certain size, such as a bag, appears within a video frame. It then starts a timer that raises an alert if the object, in this case luggage, is left alone for a specific time period. The system then suggests the moment when the bag was left by its owner, which is confirmed by the security team. At this point, the team can decide whether to invoke Hitachi’s person-tracking technology to find the individual. This advanced system applies deep learning to physical attributes – for example the colour and style of hair and clothing – to accurately identify, locate and track the individual in real time. Unlike facial recognition, it doesn’t depend on people’s position relative to cameras or cause privacy issues.

Labs Involved

European Big Data Lab

Contact Lab

Experience Design Lab

Contact Lab

The Team

{{ person.fullName }}
{{ person.jobTitle }}

email icon

Co-creation

Our co-creation approach develops breakthrough innovations with our partners.

Find out more

People & Labs

Our labs are present across Europe, located in key areas related to our work.

View People & Labs

Get in touch

Contact us for more information on how we can work together.

Contact Us