mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-02 04:21:34 +00:00
[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team (#13943)
* allow setting team_member_rpm_limit on creating * create_team_member_rate_limits * docs fix * fix img
This commit is contained in:
@@ -309,6 +309,37 @@ curl -X POST '<PROXY_BASE_URL>/team/new' \
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
### Team Member Rate Limits
|
||||
|
||||
Set a default tpm/rpm limit for an individual team member.
|
||||
|
||||
You can do this when creating a new team, or by updating an existing team.
|
||||
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="ui" label="UI">
|
||||
|
||||
<Image img={require('../../img/create_team_member_rate_limits.png')} style={{ width: '600px', height: 'auto' }} />
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="api" label="API">
|
||||
|
||||
```bash
|
||||
curl -X POST '<PROXY_BASE_URL>/team/new' \
|
||||
-H 'Authorization: Bearer <PROXY_MASTER_KEY>' \
|
||||
-H 'Content-Type: application/json' \
|
||||
-D '{
|
||||
"team_alias": "team_1",
|
||||
"team_member_rpm_limit": 100,
|
||||
"team_member_tpm_limit": 1000
|
||||
}'
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
|
||||
|
||||
### Set default params for new teams
|
||||
|
||||
When you connect litellm to your SSO provider, litellm can auto-create teams. Use this to set the default `models`, `max_budget`, `budget_duration` for these auto-created teams.
|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 100 KiB |
@@ -55,7 +55,7 @@ pip install litellm==1.75.8
|
||||
## Team Member Rate Limits
|
||||
|
||||
<Image
|
||||
img={require('../img/release_notes/team_member_rate_limits.png')}
|
||||
img={require('../../img/release_notes/team_member_rate_limits.png')}
|
||||
style={{width: '100%', display: 'block', margin: '2rem auto'}}
|
||||
/>
|
||||
<p style={{textAlign: 'left', color: '#666'}}>
|
||||
|
||||
@@ -1383,6 +1383,20 @@ const Teams: React.FC<TeamProps> = ({
|
||||
>
|
||||
<TextInput placeholder="e.g., 30d" />
|
||||
</Form.Item>
|
||||
<Form.Item
|
||||
label="Team Member RPM Limit"
|
||||
name="team_member_rpm_limit"
|
||||
tooltip="The RPM (Requests Per Minute) limit for individual team members"
|
||||
>
|
||||
<NumericalInput step={1} width={400} />
|
||||
</Form.Item>
|
||||
<Form.Item
|
||||
label="Team Member TPM Limit"
|
||||
name="team_member_tpm_limit"
|
||||
tooltip="The TPM (Tokens Per Minute) limit for individual team members"
|
||||
>
|
||||
<NumericalInput step={1} width={400} />
|
||||
</Form.Item>
|
||||
<Form.Item
|
||||
label="Metadata"
|
||||
name="metadata"
|
||||
|
||||
Reference in New Issue
Block a user