Unify Logo Footer.svg
Unify Data
Logo
Pipelines Manager

Pipelines Manager

Logo

4 mins read READ

The Pipelines Manager is the home screen for every data pipeline in your workspace. From here you can see what's running, create new pipelines, clone or share existing ones, pause or resume them, and jump into dashboards that track their health over time.

Overview

When you open Pipelines, the header shows a running count of pipelines alongside three tabs — Pipelines, Insights, and Alerts — and a New Pipeline button, which only appears if you have permission to create pipelines. The main list is searchable and loads more rows automatically as you scroll.

Each row shows the pipeline's name, status, source, destination, ingestion mode (Real Time or Scheduled), tags, owner, and when it was last updated. If you're viewing pipelines across all workspaces, a Workspace column appears too. A dash under Last Updated means the record hasn't been touched since it was created — hover over it to see the audit details. Open the columns menu to reveal two hidden-by-default columns, Created On and Last Updated By; your choice of visible columns is remembered the next time you visit. You can also drag column headers to reorder them. Click anywhere on a row to open that pipeline's detail view.

What do the statuses mean?

Every pipeline is in one of three states:

  • Draft — the pipeline has never been deployed.

  • Live — the pipeline is deployed and currently running, or scheduled with a next run coming up.

  • Paused — the pipeline was deployed at some point but isn't running right now.

The status also controls the pause/resume toggle on each row. The toggle is disabled until the pipeline's first deployment, with a message telling you to deploy it first, and it's temporarily unavailable while a deploy or stop is already in progress.

Creating a pipeline

Click New Pipeline to open the Create New Pipeline dialog. Give the pipeline a name (required), choose the workspace it belongs to, and optionally attach tags — pick from existing tags or create new ones on the spot. Once you create it, the pipeline's detail view opens so you can connect a source and a destination. Everything else, including objects, schema, and settings, unlocks only after those two steps are complete.

Managing a pipeline from the list

Open the row menu on any pipeline to see the actions available to you, depending on your permissions:

  • Edit Details — rename the pipeline or change its tags.

  • Clone — create a copy. The Clone Pipeline dialog pre-fills a name like "Original Name (clone)", lets you choose a different destination workspace, and offers a toggle to share the clone with the same users who have access to the original.

  • Share — grant other users access to the pipeline.

  • Delete — permanently remove the pipeline. You'll be asked to type the pipeline's name to confirm, since this action can't be undone.

Pausing and resuming a pipeline

Use the toggle on a pipeline's row to pause or resume it without opening the detail view. Pausing shows a warning that leaving a pipeline paused longer than its log retention period can cause a permanent failure, so confirm only when you're sure. Resuming a paused pipeline restarts it from where it left off; if too much time has passed for it to resume safely, you'll see guidance in the pipeline's deploy screen instead.

Insights and Alerts tabs

The Insights tab opens a dashboard of aggregated metrics across every pipeline in the workspace, useful for spotting trends or problem pipelines at a glance. The Alerts tab lists alert rules scoped to pipelines and lets you create new ones — an alert set up here is tied to pipeline assets, so you can get notified about pipeline events without having to open each pipeline individually.

Notes

  • If you haven't created any pipelines yet, the list shows an empty state with a prompt to set up your first one, along with a New Pipeline button if you have create access.

  • If a search returns no results, try a different search term — the empty state for a search is separate from the no-pipelines-yet state.

  • The New Pipeline button, and every row action, only appears when your permissions allow it, so your menu may look different from a teammate's.