Skip to content

datalake_agent: Hive Metastore catalog #2016

Description

@MisterRaindrop

Part of #2008. Letters (A, B0–B7, C, D, E) are the PRs listed there; this is B6.

Scope

  • HiveCatalog (iceberg-hive-metastore): thrift URI (hive_metastore_uri already accepted as a second spelling), HMS lock and commit semantics, pinned hive-metastore / hadoop-common.
  • Kerberos through the UGI shim from the reference implementation: principal and keytab from server and user-mapping options, login once per credential fingerprint.
  • HMS errors mapped through the B1 interceptor (NOT_FOUND, ALREADY_EXISTS, …).
  • End-to-end against HMS plus MinIO in docker (the compose stack exists); Kerberos login path at unit level. No KDC in CI unless cheap.

Out of scope

Hive tables that are not Iceberg.

Depends on

B3.

Acceptance

  • Conformance suite green against HMS; Spark and Cloudberry see each other's tables through the same HMS.
  • Kerberos without a keytab fails at the first call naming the missing file.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    datalakecontrib/datalake_fdw and contrib/datalake_agent: Iceberg lake tables

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions