Skip to content

feat(openwebui): model api key support - #9

Draft
cmdoret wants to merge 12 commits into
mainfrom
feat/api-keys
Draft

feat(openwebui): model api key support#9
cmdoret wants to merge 12 commits into
mainfrom
feat/api-keys

Conversation

@cmdoret

@cmdoret cmdoret commented Aug 21, 2026

Copy link
Copy Markdown
Member

Goal

Allows users to define OpenAI API keys in openwebui to access models programmatically.

Summary:

  • adds openwebui as a jwt provider in envoy.
  • provide signing key for openwebui to mint and sign jwts

Advantage:

  • lets users generate their own tokens from the UI.
  • simple to use from user perspective.

Limitations

  • openwebui is in the middle of every API request (bottleneck)
  • tokens do not share the idp identities -> rate limits and billing not working
  • more complex envoy policies, default catch-all rate limit, ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant