Challenges and opportunities for handling the volume, velocity, and variety of transportation data and harnessing for decision-making purposes.
- Cloud computing will be key to cope with increased volumes, velocity, and variety of data. Agencies, however, may have to give up the ability to store data internally and will need to be convinced that collected data is stored sufficiently safely.
- The sheer volume of big transportation data will likely necessitate horizontally scaled systems deployed using distributed architectural approaches. Ever-larger quantities of data will continue to place pressure on traditional vertically based Database Management Systems.
- Agencies will likely need to increasingly devote resources to Stream Processing methods. Organizations will need to process data coming in at different rates and in real-time, which traditional batch-processing may be unable to perform.
- Flexible, non-relational database systems may be needed to cope with a variety of data formats. Traditional structured relational database management systems that require defined data schemas may be incapable of handling and integrating data from different sources