What is the INTEGRA process?
|
|
|
 |
The INTEGRA Validation Process was developed to accommodate the known limitations of current real-time simulations – the reasons why simulations have so far failed to give the validation results we need.
The INTEGRA Validation Process aims to recognise the highlighted limitations of real-time simulation experiments, and to work within them to achieve meaningful and conclusive validation results.
1. The first element is to be clear about the objectives of the simulation experiment: is it really a validation simulation, and what are the validation objectives? Recognition of the inherent limitations of real-time simulations, and careful experimental design to work within those limitations is essential.
2. Validation experiments require faithful simulation of a stable, relatively mature and well-defined Operational Concept.
3. Simulated airspace and traffic samples must be such that proposed tools are evaluated in their foreseen operating environment.
4. Subject controllers must adhere to the defined operating procedures ensuring that measurements relate to the intended concept
5. Use the INTEGRA Metrics, which offer objective measures of capacity, safety and efficiency from a single simulation experiment.
The metrics used in any simulation experiment are essentially the public interface of a whole measurement process, encompassing:
a. experimental design,
b. training of participants,
c. specifying the simulated system,
d. trials execution,
e. data recording and analysis.
No set of metrics can be considered in isolation from that process, because it determines the meaning behind the recorded data.
|
|
|
|
| |
What are the INTEGRA metrics?
|
|
|
|
The INTEGRA metrics have been designed to provide quantitative measures to establish the benefit or otherwise of advanced ATM systems containing a degree of controller assistance tools.
They have been designed to operate at the ATM system level measuring Capacity, Safety and Efficiency without directly affecting the workload of the controller. This provides a more realistic and stable set of metrics which give a good indication of system performance.
|
|
|
|
| |
Why do we need the INTEGRA metrics?
|
|
|
|
Previous simulations that have included advanced tools, such as PHARE, have been beneficial in demonstrating tools and concepts but have not provided quantitative measures of performance.
Typically current metrics for Capacity are based on controller workload assessment. These are largely subjective measures, questionnaires etc., the results of these subjective measures can vary widely based on the controllers experience, training, area or operation and general outlook on advanced support tools in their environment. These measures are only linked to Capacity because the controller task is seen as the bottleneck. The INTEGRA metrics examine the system and performance as a whole and do not focus on the idea that the controller will always be the constraint on capacity.
|
|
|
|
| |
How do the INTEGRA metrics work?
|
|
|
|
The INTEGRA metrics work at an abstract level, independent of the simulation facilities but they operate on the data input to and output from the simulation.
In the case of the Capacity metric there is also a requirement to understand the underlying operational concept for the system (the roles and rules for the various actors in the system). It is important to understand and introduce the roles and procedures for each actor during the initial phases of simulation planning as this will ease the collection and processing of data for metric calculation.
|
|
|
|
| |
How much does it cost me to deploy the INTEGRA process as part of my simulation?
|
|
|
|
Once familiar with the process typical effort levels for a simulation comprising 2 weeks of trials with 8 controllers performing 3 1hour runs per day would be:
1 man month for analysis of the operational concept and roles and subsequent configuration of the metrics
½ man month for determination of data to be recorded and identification of any items not currently available
1 man month for processing the recorded data by the metrics, analysing and presenting the data
|
|
|
|
| |
Is there support available if I want to apply the INTEGRA process?
|
|
|
|
EUROCONTROL provides software and support to address all stages of the INTEGRA Validation process for your initial use of the process.
For further information contact the INTEGRA Action Manager.
|
|
|
|
| |
Can the INTEGRA process be applied to fast-time experiments or shadow mode trials?
|
|
|
|
The INTEGRA metrics could be used for fast time experiments but the lack of feedback within the system would mean that the results obtained would be similar to existing fast time experiments.
With shadow mode trials the experiment is limited to existing traffic levels and we are interested in being able to try different levels of traffic. The metrics could be used for shadow mode trials and in this case would provide a measure against operational traffic.
|
|
|
|
| |
