Stream pipelines have a useful tool for monitoring and inspecting stream jobs' execution. The Flink framework includes a Web Console that is active for all Flink jobs in the
Running state. Similar to the Flink Dashboard, it is called the Flink Dashboard and can be accessed directly from within OLP. This article explains how to access the Flink UI and some of its basic functions.
Flink Dashboard is automatically started when a stream pipeline job is initiated. It can be accessed from the OLP Portal or from the OLP CLI.
The best way to reach the Flink Dashboard is through the OLP Portal. Figure 1 shows a typical display for a running batch pipeline. On the right side of the screen you can see two links:
See Log and
Open Flink Dashboard.
Alternately, OLP CLI command
pipeline job show can be used to get the
pipeline UI URL for the Flink Dashboard for a Stream pipeline.
Note: Logging in
If you have not already logged into the Flink Dashboard in your current session, you will be requested to do so using the normal OLP sign-in dialog. Use your normal OLP credentials. Cookies are used to maintain your current session information.
Open Flink Dashboard link in the Portal or the
pipeline UI URL link in the CLI opens the Flink Dashboard in your browser as illustrated in figure 2.
The Flink Dashboard provides important details about the Running jobs, Taskmanager, Jobmanager, Backpressure.
This version of the Flink Dashboard has been modified to be compatible with OLP. There are some functions that might be available in a native Flink environment that are not available here. For example, it is not allowed to manage the Flink job from within the Flink Dashboard, i.e., a job cannot be submitted or canceled from the Flink Dashboard in OLP. All pipeline operations are only allowed from the OLP Pipelines UI. When referring to other Flink Dashboard documentation references, you may see discussions of features that are missing here. Those missing features are not compatible with OLP.