forked from BerriAI/litellm
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
f2ca244
commit 9a1c050
Showing
1 changed file
with
40 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,40 @@ | ||
## Langfuse Prompt Management | ||
|
||
Langfuse Prompt Management is being labelled as BETA. This allows us to iterate quickly on the feedback we're receiving, and making the status clearer to users. We expect to make this feature to be stable by next month (February 2025). | ||
|
||
Changes: | ||
- Include the client message in the LLM API Request. (Previously only the prompt template was sent, and the client message was ignored). | ||
- Log the prompt template in the logged request (e.g. to s3/langfuse). | ||
- Log the 'prompt_id' and 'prompt_variables' in the logged request (e.g. to s3/langfuse). | ||
|
||
|
||
[Start Here](https://docs.litellm.ai/docs/proxy/prompt_management) | ||
|
||
## Team/Organization Management + UI Improvements | ||
|
||
Managing teams and organizations on the UI is now easier. | ||
|
||
Changes: | ||
- Support for editing user role within team on UI. | ||
- Support updating team member role to admin via api - `/team/member_update` | ||
- Show team admins all keys for their team. | ||
- Add organizations with budgets | ||
- Assign teams to orgs on the UI | ||
- Auto-assign SSO users to teams | ||
|
||
[Start Here](https://docs.litellm.ai/docs/proxy/self_serve) | ||
|
||
## Hashicorp Vault Support | ||
|
||
We now support writing LiteLLM Virtual API keys to Hashicorp Vault. | ||
|
||
[Start Here](https://docs.litellm.ai/docs/proxy/vault) | ||
|
||
## Custom Prometheus Metrics | ||
|
||
Define custom prometheus metrics, and track usage/latency/no. of requests against them | ||
|
||
This allows for more fine-grained tracking - e.g. on prompt template passed in request metadata | ||
|
||
[Start Here](https://docs.litellm.ai/docs/proxy/prometheus#beta-custom-metrics) | ||
|