In order to maintain and improve Safety Performance, it is important to understand and measure the level of effectiveness of the Safety Management System. For this reason it is fundamental to have information that can guide ongoing improvement (leading indicators) and data that represent the effectiveness of the system (lagging indicators). However, data by itself is not enough: it is essential to understand it and to represent its significant information to improve the levels of safety in our operations (safety intelligence).
-
Effectiveness of Safety Management (EoSM)
-
Level of application of the Risk Analysis Tool (RAT)
-
Level of presence/absence of the Just Culture principles in our Organisation
The results achieved in the essential area of safety, as well as those for other performance areas, are assessed by the Performance Review Body that presents them annually in a report for the European Commission (PRB Annual Monitoring Report), which compares the results achieved against the set objectives.
Effectiveness of Safety Management - (EoSM)
The EoSM measures the level of effectiveness of the Safety Management System. This measurement is conducted internally according to specific EASA instructions and is validated by ENAC, the Italian Civil Aviation Authority, in line with specific European legislation.
The effectiveness of the Safety Management System is calculated according to “Management Objectives” by referring to a scale of values which expresses the level of implementation, maturity and effectiveness of the Safety Management System.
As defined at a European level, the objective requires at least level C for the “Safety Culture” Management Objective and level D for all the others, by 2019.
The performances need to be validated by ENAC and are then published on the website of the European Commission and included in the PRB annual report (PRB Annual Monitoring Report).
Percentage of application of the Risk Analysis Tool - RAT Application
In accordance with the European Regulation on the reporting, analysis and monitoring of events in civil aviation, ENAV reports, collects and analyses significant events that occur in the provision of air navigation services.
In accordance with the European Regulation on the minimum performances that providers of Air Navigation Services must ensure in the event of any incidents that may, even potentially, pose a real risk for operations, ENAV determines the “ATM Ground” severity level by using the EUROCONTROL Risk Analysis Tool (RAT).
The RAT identifies the severity level by using pre-determined criteria that allocate a value relating to the severity (potential impact) and the repeatability (probability of frequency of occurrence).
As regards to the reported incidents, the analysis is carried out for those in which the air traffic management procedures have a direct or indirect contribution (events with an ATM contribution) and, specifically, at least for the events that determine:
-
a violation of the applicable minimum separation distances (Separation Minima Infringement - SMI)
-
undue interference with operations on the runway (Runway Incursion - RIN)
-
technical events that lead to deterioration and disruption of a service needed for air traffic management (ATM Specific Occurrence – ASO)
The objective defined at a European level requires at least 80% analysis by 2017 and the achievement of 100% analysis by 2019. The performances need to be validated by ENAC and are then published on the website of the European Commission and included in the PRB annual report (PRB Annual Monitoring Report).
Level of presence/absence of the Just Culture principles
The measurement of the presence (or absence) of Just Culture principles is an essential indicator to support both the development of an effective Safety Culture and the free reporting of events not otherwise known by operators. This parameter is measured using the percentage of positive responses to questions on a specific questionnaire developed by EASA for the European Commission.
The objective defined at a European level requires at least 50% of positive responses . The performances achieved, after validation of ENAC, are published on the website of the European Commission and are included in the PRB annual report (PRB Annual Monitoring Report).