Table of Contents

Driven User Guide

version 1.2

Starting with the Status View

When you first log in to Driven, you see a broad view of the status for multiple application runs in the past and present. This page is an unfiltered status view, which rolls up information about application execution for all teams of which you are a member. You can return to this view by clicking Show All in the left side panel.

If you do not see any data for your Cascading application, ensure that you are a member of a team that is associated with a Driven API key and verify the key is exposed to your application. See Installing and Configuring the Driven Plugin for more information.

To gain meaningful insights into the root causes or patterns of application misbehavior, you likely need to focus on a subset of the data that is displayed in the Show All status view. Figure 1 shows the filtering options above the Status Timeline and the Status Frequency graphs and in the graphic area itself. After you filter or search to focus on a subset of data, the status graphs present the information in an accumulated format.

Apps View
Figure 1. Status view graphs with filtering and searching controls highlighted

While Driven graphs provide a perspective of rolled-up data, the table below the graphs presents a detailed breakdown of the graphical data. Tabular data is presented under the graphical rendering of data on each Driven view. In tables you can view many additional dimensions of the selected application execution data. Depending on your immediate goals, the table is potentially more helpful than the graphs because information in tabular format is presented on a more granular level. See the Tabular Data section below for more information.

status view table extract
Figure 2. First four rows of a sample table

Search, Status Timeline, and Status Frequency

The Search feature supports several application-level query attributes. If you use the search field, you can filter the data that appears in all parts of the status view. Refer to searching documentation for detailed information.

Application and flow status throughout Driven, including the Status Timeline and Status Frequency graphs, are represented by color-coded status categories of Cascading application and flow states:

Table 1. Cascading Application and Flow Status Represented in Driven
State Color Icon

SUCCESSFUL

Green

Successful_State

STOPPED

Yellow

Stopped_State

FAILED

Red

Failed_State

PENDING, STARTED, RUNNING, or SUBMITTED

Blue

Running_State

SKIPPED (applies to flows only)

Green

Skipped_State

Status Timeline

The Status Timeline represents a snapshot of application activity within a certain timeframe. The x-axis is the number of application runs, while the y-axis is time. By clicking on a bar in the graph, you can view the specific time intervals of application execution.

Status Frequency

By default, the Status Frequency graph displays the number of times (x-axis) that an application (y-axis) has been in each of four status categories and accumulates the data into a view of total application runs. This allows for comparison of application performance on a broad scale. However, use the first drop-down menu in Status Frequency to change the metric of the y-axis to measure performance along dimensions other than unique applications:

status_frequency_nameMenu

Owner - Displays application data compiled by each application owner name.

Team - Displays application data compiled by each team.

Tags - Displays application data compiled by each tag term.

If you want to calibrate the data by relative frequency of application runs, use the second drop-down menu of the Status Frequency graph. Selecting a quartile filter displays the applications that are contained in one fourth of the total frequency distribution timeline.

status_frequency_AlldataMenu

The status frequency counters as displayed in the following screenshot shows the number of times that Driven recorded applications were in each status. If you click on the any of the numbers, you can toggle the counters to display percentage breakdown for each status.

status_frequency_counters

Hover your cursor on a metric parameter on the y-axis for a quick view of the status frequency. Click the application name to display the graphic representation of that particular application.

Tabular Data

The table under the Status Timeline and Status Frequency graphs provides a detailed breakdown of application execution data by instance of each application run. Use the table to drill down and gain insights to application performance from your cluster. Some key monitoring assets of the tabular interface include the following capabilities:

  • Export application-level tabular data to a tab-separated values text file

  • Add or remove metrics that are displayed

  • Click on a hyperlinked application name to view app data on more granular levels, including visualization of flows and steps as directed acyclic graphs (DAGs)

The Driven page displays a maximum of 25 rows. Use the pagination arrows to navigate a table that spans more than one page.

apps-table-pagination

Tip
The columns can be arranged by drag and drop to your preferred order after clicking on a column heading. You can also sort the items within a column by clicking on the bidirectional arrow.

Exporting Data to a .tsv File

As part of your analytical process, the application data that is presented in a Driven table can be downloaded as a tab-separated values (.tsv) file, which then can populate a spreadsheet for detecting patterns, metrics, and usage.

Click the download icon tsv_icon to capture the Driven table data and download it to a file.

Track Cascading Applications by Various Metrics

Driven lets you customize most of the information that the table displays. Click the column chooser icon Counter_Chooser to reveal or conceal columnar metrics. The Status and Name columns cannot be hidden.

The columnar metrics are categorized in the column chooser. Each category can be collapsed or expanded. This helps with retrievability because the number of choosable columns can grow large.

A key feature of the table and column chooser is the ability to import and view counter attributes. See Counter Data and Other Metrics in Tables for more information.

Next