Skip to content

Add Pipelines Show Command - #6033

Merged
andrewnester merged 6 commits into
databricks:mainfrom
tanishgupta-db:preview-datasets
Aug 6, 2026
Merged

Add Pipelines Show Command#6033
andrewnester merged 6 commits into
databricks:mainfrom
tanishgupta-db:preview-datasets

Conversation

@tanishgupta-db

@tanishgupta-db tanishgupta-db commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

Changes

Adds databricks pipelines show <catalog.schema.table> command: shows a table's columns and sample data (or --output json). Runs SELECT * FROM <table> LIMIT n on a SQL warehouse. The warehouse is taken from --warehouse-id, DATABRICKS_WAREHOUSE_ID (env set), the workspace default, or picked.

Also adds renderStaticWithTruncation in tableview for detecting terminal width and rendering a formatted table

Why

Users want a quick look at the data and schema of a dataset quickly without leaving the terminal. Mirrors the Catalog Explorer "Sample Data" experience for the CLI. Lives under the pipelines command group.

Tests

  • Unit tests and Acceptance tests

E2E testing:

Screen.Recording.2026-07-23.at.11.05.36.PM.mov

@tanishgupta-db
tanishgupta-db marked this pull request as ready for review July 23, 2026 04:47
@github-actions

github-actions Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Approval status: pending

/acceptance/pipelines/ - needs approval

13 files changed
Suggested: @kanterov
Also eligible: @jefferycheng1, @lennartkats-db

/cmd/pipelines/ - needs approval

7 files changed
Suggested: @kanterov
Also eligible: @jefferycheng1, @lennartkats-db

General files (require maintainer)

Files: NOTICE, go.mod
Based on git history:

  • @pietern -- recent work in cmd/pipelines/, ./

Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose, @lennartkats-db) can approve all areas.
See OWNERS for ownership rules.

@tanishgupta-db
tanishgupta-db force-pushed the preview-datasets branch 2 times, most recently from ef8b086 to a77e404 Compare July 24, 2026 05:15
@tanishgupta-db tanishgupta-db changed the title preview-datasets v1 Add Pipelines Show Command Jul 24, 2026
Comment thread acceptance/pipelines/show/basic/output.txt Outdated
Comment thread acceptance/pipelines/show/help/output.txt Outdated
Comment thread acceptance/pipelines/show/basic/output.txt
Comment thread libs/tableview/static.go Outdated
Comment thread libs/tableview/static.go Outdated
Comment thread cmd/pipelines/show_render.go
Comment thread cmd/pipelines/show_render.go
Comment thread cmd/pipelines/show_render.go
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

An authorized user can trigger integration tests manually by following the instructions below:

Trigger:
go/deco-tests-run/cli

Inputs:

  • PR number: 6033
  • Commit SHA: 8e894299b5d187aac6a5e48be1b65b7fdd3112e7

Checks will be approved automatically on success.

@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 8e89429

Run: 30992664995

Env 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 4 4 306 1093 9:12
💚​ aws windows 4 4 308 1091 7:21
🔄​ azure linux 1 4 4 304 1093 8:33
💚​ azure windows 4 4 307 1091 6:53
💚​ gcp linux 1 5 306 1093 7:40
💚​ gcp windows 1 5 308 1091 6:57
9 interesting tests: 4 RECOVERED, 4 SKIP, 1 flaky
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🔄​ TestSyncIncrementalFileSync ✅​p ✅​p 🔄​f ✅​p ✅​p ✅​p
💚​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 💚​R 💚​R 🙈​S 🙈​S
💚​ TestFetchRepositoryInfoAPI_FromRepo/root 💚​R 💚​R 💚​R 💚​R
💚​ TestFetchRepositoryInfoAPI_FromRepo/subdir 💚​R 💚​R 💚​R 💚​R
Top 6 slowest tests (at least 2 minutes):
duration env testname
6:21 gcp windows TestAccept
6:14 azure windows TestAccept
5:59 aws windows TestAccept
2:51 aws linux TestAccept
2:46 gcp linux TestAccept
2:45 azure linux TestAccept

@andrewnester
andrewnester merged commit 8d5735b into databricks:main Aug 6, 2026
11 of 31 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants