Vehicle Road Coverage Extractor allows users to perform large scale data analytics in understanding vehicle road coverage and sensor data as a function of multiple variables. This customizable pipeline template processes archived SDII data stored in the versioned/index layer to calculate the vehicle road coverage of this data. It consists of two pipelines:
The vehicle-road-coverage-processor-pipeline reads SDII data from the versioned/index layer. It map matches the data and calculates the total number of probes and messages in each segment of the given bounding box for every 12 hours in the given time period. It publishes the results for every 12 hours as a CSV in a HERE Tile partition.
Every version in the output catalog of the pipeline corresponds to aggregated results for each 12 hours of the time-period. This time period to output version mapping information is also published in the log-mapping layer of the output catalog.
The vehicle-road-coverage-aggregator-pipeline aggregates the results published for every 12 hours by the vehicle-road-coverage-processor-pipeline and calculates the coverage information for the entire time period given by the user.
The final output gives the information of the number of messages, number of probes, and hourly messages distribution for each segment in a HERE Tile, along with attributes of the segment like, segment Id, direction (Forward/Backward), functional class, length, autoAccess (automobile access of the segment).
The result can be analyzed using the available Jupyter notebook present in vehicle-road-coverage-aggregator-pipeline/notebooks directory.
In order to deploy and run this pipeline template, you will need the Wizard Deployer. The Wizard executes interactively, asking questions about the application, and expects the user to provide needed answers. Follow the Wizard's documentation instructions and set up needed parameters, then follow these steps:
You can use your existing output layer or let the Wizard create a new catalog/layer for you. If you are using existing catalog, make sure it is shared with the GROUP_ID that will be used for this deployment.
PLEASE NOTE: You will need to run the Wizard twice, first for the vehicle-road-coverage-processor-pipeline. Once the processor pipeline finishes publishing results to the output catalog, the Wizard must be run for the vehicle-road-coverage-aggregator pipeline to get the final aggregated results. Follow the instructions in the README.md of the individual pipelines for further instructions.
In the Platform Portal select the Pipelines tab where you can see your Pipeline deployed and running. After your Pipeline finishes and your data is published, you can find your output catalog under the Data tab and inspect your data visually, or query/retrieve your data programmatically using one of the following options:
Executing this pipeline template will incur the following costs:
Cost will depend on the amount of data that will be published to a Versioned layer as an output from execution.
Cost will depend on the amount of:
Cost will depend on the amount and size of partitions(metadata) stored in the Versioned layer.
Cost will depend on the workers you set when running the Wizard.
Cost will depend on the log level set for the execution of this pipeline template. To minimize this cost, the user can set log level to WARN.
If you need support with this pipeline template, please contact us.