Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
ccadaf8
Initial development of resource-info-fetcher
sbernauer Jul 16, 2026
a1da9db
feat: Implement Trino catalog and schema
sbernauer Jul 16, 2026
d56a198
feat: Cache tag and user lookups
sbernauer Jul 20, 2026
f28fdb7
feat: Lookup Superset things (by id)
sbernauer Jul 20, 2026
90b010d
chore: More parallism
sbernauer Jul 20, 2026
53e83c6
feat: Add Kafka topic support
sbernauer Jul 20, 2026
0e2857a
Crying in GraphQL
sbernauer Jul 20, 2026
551c2f6
feat: Also fetch domains and data products
sbernauer Jul 21, 2026
a8310f6
RawDataHubUrn -> DataHubUrn
sbernauer Jul 21, 2026
a25da2b
refactor: Move user-info-fetcher sidecar creation into separate module
sbernauer Jul 21, 2026
e5d1f05
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer Jul 21, 2026
9698dc8
Merge branch 'refactor/uif-sidecar' into spike/rif
sbernauer Jul 21, 2026
f5b5bf9
Re-add Tiltfile
sbernauer Jul 21, 2026
2cfd78d
Implement RIF into operator
sbernauer Jul 22, 2026
86127a6
Improve test
sbernauer Jul 23, 2026
554a7f2
chore: Switch endpoints from complex enum to path based
sbernauer Jul 24, 2026
e5ff314
chore: Move env out of global config to the requests
sbernauer Jul 24, 2026
970da87
WIP for Maxi :)
sbernauer Jul 27, 2026
2e4655f
fix kuttl test
sbernauer Jul 27, 2026
8c9d8c5
refactor Python assert script
sbernauer Jul 27, 2026
dff0f99
refactor Python script
sbernauer Jul 27, 2026
74c648d
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer Jul 27, 2026
32cd6e2
Remove leftover files
sbernauer Jul 27, 2026
9d95f1f
cargo fmt
sbernauer Jul 27, 2026
d52110c
Fix OpenShift on high disk usage
sbernauer Jul 30, 2026
26f51e9
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer Jul 30, 2026
7c11523
cargo update
sbernauer Jul 30, 2026
fc889ca
Slightly improve docs
sbernauer Jul 30, 2026
59af952
Stupid YAML linter
sbernauer Jul 30, 2026
215d4b9
feat: Add rootPath field for DataHub
sbernauer Jul 31, 2026
4dc05fc
changelog
sbernauer Jul 31, 2026
6571afa
Improve code comments
sbernauer Jul 31, 2026
f770b04
regenerate nix
sbernauer Jul 31, 2026
8c2a0df
Update rust/resource-info-fetcher/src/main.rs
sbernauer Aug 5, 2026
af16a08
Merge branch 'main' into spike/rif
sbernauer Aug 5, 2026
bf85e53
docs: Link in nav
sbernauer Aug 6, 2026
cd9a38e
WIP: Error when too many data products are returned
sbernauer Aug 7, 2026
fde8854
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer Aug 10, 2026
c20d1d1
fix: Use utils::http::client_builder helper
sbernauer Aug 10, 2026
e3e84ed
clippy
sbernauer Aug 10, 2026
f481d44
feat: Allow configuring max cache size.
sbernauer Aug 10, 2026
fdcb012
regenerate nix
sbernauer Aug 10, 2026
ea4f5b7
fix: Mount the log volume into the info-fetcher sidecars
maltesander Aug 17, 2026
38d4773
docs: Document that a failed metadata lookup does not deny by itself
maltesander Aug 17, 2026
dde8df3
chore: Remove dead code from the resource-info-fetcher
maltesander Aug 17, 2026
28a1808
fix: Treat dashboard and chart ids as opaque strings
maltesander Aug 17, 2026
2ebbd09
fix: Bound the length of query parameter values
maltesander Aug 17, 2026
3836ea1
fix: Answer 400 instead of 500 for identifiers DataHub rejects
maltesander Aug 17, 2026
cd65817
fix: Warn when a URN resolves to an entity type we cannot read
maltesander Aug 17, 2026
481baa8
fix: Raise the data product page size to 1000
maltesander Aug 17, 2026
71b635a
feat: Add a cached bearer token to info-fetcher-commons
maltesander Aug 17, 2026
22e7f06
feat: Cache the OAuth2 access token in the Keycloak and Entra backends
maltesander Aug 17, 2026
97ec049
docs: Document that metadata is not inherited from parent containers
maltesander Aug 17, 2026
3c9d7a9
fix: Reject resource names DataHub cannot express as a URN
maltesander Aug 17, 2026
66160b4
test: Cover the URN mapping and the GraphQL response mapping
maltesander Aug 17, 2026
94a4034
fix: Rotate the file logs of the Stackable Rust containers
maltesander Aug 17, 2026
931b0ae
fix: set log rotation period to minutely
maltesander Aug 17, 2026
9e223cc
fix: Cache failed lookups briefly
maltesander Aug 17, 2026
e19ac0a
fix: Log a failed lookup where the backend is queried
maltesander Aug 17, 2026
1f3290a
docs: Fix the broken rustdoc links
maltesander Aug 17, 2026
7fc75e4
Merge pull request #878 from stackabletech/spike/rif-review
maltesander Aug 21, 2026
93dcdb5
Merge remote-tracking branch 'origin/main' into spike/rif
maltesander Aug 21, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,14 @@ All notable changes to this project will be documented in this file.

## [Unreleased]

### Added

- Add an initial version of resource-info-fetcher, which is similar to user-info-fetcher, but allows to fetch additional metadata about resource information from a data catalog.
For now only DataHub is supported.
Also, a rego-rule library has been added to make it easier to call resource-info-fetcher from within OPA.
The API (especially the response) might change in the future once more data catalogs are supported ([#863]).
- Allow specifying the maximum number of cached entries in the user-info-fetcher ([#863]).

### Changed

- Internal operator refactoring: introduce a build() step in the reconciler that
Expand All @@ -12,6 +20,10 @@ All notable changes to this project will be documented in this file.
- The RBAC ServiceAccount and RoleBinding are now built with the operator-rs `v2::rbac`
functions and carry the full set of recommended labels ([#861]).
- All product containers now run with `securityContext.runAsNonRoot` set to `true` to improve security ([#871]).
- The user-info-fetcher Keycloak and Entra backends now cache their OAuth2 access token for the
lifetime the identity provider reports, instead of minting a new one for every user lookup. This
removes one round trip per lookup. If the provider rejects the cached token before it expires, it is
re-minted and the lookup is retried once ([#863]).
- Bump `stackable-operator` to 0.116.0 ([#867], [#880]).
- Environment variable overrides (`envOverrides`) are now applied after all environment
variables set by the operator. In particular, `CONTAINERDEBUG_LOG_DIRECTORY` can now be
Expand All @@ -27,11 +39,15 @@ All notable changes to this project will be documented in this file.
- Fix a longstanding problem of including empty `categories`, `shortNames` and `additionalPrinterColumns` in the CRDs,
which could cause problems with GitOps tools (e.g. ArgoCD) reporting a diff in the custom resources.
See [our internal issue](https://github.com/stackabletech/hdfs-operator/issues/626) and [the fix](https://github.com/kube-rs/kube/pull/2042) for details ([#871]).
- The file logs of the user-info-fetcher and resource-info-fetcher sidecars are now collected by the
Vector agent. Both sidecars log below `/stackable/log`, but did not mount the shared `log` volume,
so their logs were unreachable for Vector and not accounted for in the volume's size limit ([#863]).
- The reconciler now applies resources and derives the cluster status in discrete
apply and update_status steps for the `opa_controller` ([#872]).

[#852]: https://github.com/stackabletech/opa-operator/pull/852
[#861]: https://github.com/stackabletech/opa-operator/pull/861
[#863]: https://github.com/stackabletech/opa-operator/pull/863
[#867]: https://github.com/stackabletech/opa-operator/pull/867
[#871]: https://github.com/stackabletech/opa-operator/pull/871
[#872]: https://github.com/stackabletech/opa-operator/pull/872
Expand Down
140 changes: 140 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading