The Map Matcher pipeline template reads SDII data from either Versioned or Index layer. It then aggregates messages and sorts by timestamp, and then map matches per message. The results of map matching is written to an Index layer as parquet format. The output index layer has time (1 hour) and HERETile (zoom=12) indices. If the path-based map matcher is used, additional routing information is also stored to a different layer as parquet format with the same indexing of time and HERE Tile.
In order to deploy and run this pipeline template, you will need the Wizard Deployer. The Wizard executes interactively, asking questions about the application, and expects the user to provide needed answers. Assuming you followed the Wizard's documentation instructions and set up the needed parameters beforehand, follow these steps:
You can use your existing output layer or let the Wizard script create a new catalog/layer for you. If using existing catalog, make sure it is shared with GROUP_ID which will be used for this deployment.
If you do not use the Wizard to create the output catalog then refer to the file config/output-catalog.json to find the structure of the output layers needed in the output catalog to publish results of the pipeline.
The output catalog of the pipeline consists of 2 layers:
- layer_1: - stores map-matched information as parquet format - index layer - timewindow (1 hour), HERE Tiles (zoom level 12) - layer_2 - stores routing information as parquet format - index layer - timewindow (1 hour), HERE Tiles (zoom level 12)
In Platform Portal select the Pipelines tab where you should be able to see your Pipeline deployed and running. After your Pipeline finishes and your data is published, you can find your output catalog under the Data tab and inspect your data visually or query/retrieve your data programmatically using one of the following options:
Executing this pipeline template will incur the following costs:
Cost will depend on the amount of data that will be published to a Versioned layer as an output from execution.
Will depend on:
Will depend on the amount and size of partitions (metadata) stored in the Versioned layer.
Depends on the number of workers you specify in the Wizard questions
To minimize this cost log level is set to WARN.
If you need support with this pipeline template, please contact us.