Future Regional Data Lake - Archived Data System Functionality
Subsystem Description
The 'Archived Data System' collects, archives, manages, and distributes data generated from ITS sources for use in transportation administration, policy evaluation, safety, planning, performance monitoring, program assessment, operations, and research applications. The data received is formatted and tagged with attributes that define the data source, conditions under which it was collected, data transformations, and other information (i.e. meta data) necessary to interpret the data. The archive can fuse ITS generated data with data from non–ITS sources and other archives to generate information products utilizing data from multiple functional areas, modes, and jurisdictions. The archive prepares data products that can serve as inputs to federal, state, and local data reporting systems. The 'Archived Data System' may reside within an operational center and provide focused access to a particular agency's data archives. Alternatively, it may operate as a distinct center that collects data from multiple agencies and sources and provides a general data warehouse service.
Functional Object: Archive Data Repository
'Archive Data Repository' collects data and data catalogs from one or more data sources and stores the data in a focused repository that is suited to a particular set of ITS data users. It includes capabilities for performing quality checks on the incoming data, error notification, and archive to archive coordination. It includes the capability to define a data registry that allows registration of data identifiers or data definitions for interoperable use throughout a region. It supports a broad range of implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large–scale data warehouses that collect, integrate, and summarize transportation data from multiple sources and serve a broad array of users within a region. Repositories may be established to support operations planning, performance monitoring and management, and policy and investment decisions.
Functional Object: Archive Government Reporting
'Archive Government Reporting' selects and formats data residing in an ITS archive to facilitate local, state, and federal government data reporting requirements. It provides transportation system statistics and performance measures in required formats to support investment and policy decisions.
Functional Object: Archive On-Line Analysis and Mining
'Archive On–Line Analysis and Mining' provides advanced data analysis, summarization, and mining features that facilitate discovery of information, patterns, and correlations in large data sets. Multidimensional analysis, selective summarization and expansion of data details, and many other advanced analysis services may be offered. Complex performance measures that are derived from multiple data sources may also be produced.
Functional Object: Archive Situation Data Archival
'Archive Situation Data Archival' collects and archives traffic, roadway, and environmental information for use in off–line planning, research, and analysis. It controls and collects information directly from equipment at the roadside, reflecting the deployment of traffic detectors that are used primarily for traffic monitoring and planning purposes, rather than for traffic management. It also collects situation data from connected vehicles. The data collected, quality checks performed, and aggregation strategies are defined to support transportation system performance monitoring and management.