[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team (#13943)

* allow setting team_member_rpm_limit on creating

* create_team_member_rate_limits

* docs fix

* fix img
This commit is contained in:
Ishaan Jaff
2025-08-25 09:12:50 -07:00
committed by GitHub
parent 7c5e9b666b
commit c1ee8c26af
4 changed files with 46 additions and 1 deletions
+31
View File
@@ -309,6 +309,37 @@ curl -X POST '<PROXY_BASE_URL>/team/new' \
</TabItem>
</Tabs>
### Team Member Rate Limits
Set a default tpm/rpm limit for an individual team member.
You can do this when creating a new team, or by updating an existing team.
<Tabs>
<TabItem value="ui" label="UI">
<Image img={require('../../img/create_team_member_rate_limits.png')} style={{ width: '600px', height: 'auto' }} />
</TabItem>
<TabItem value="api" label="API">
```bash
curl -X POST '<PROXY_BASE_URL>/team/new' \
-H 'Authorization: Bearer <PROXY_MASTER_KEY>' \
-H 'Content-Type: application/json' \
-D '{
"team_alias": "team_1",
"team_member_rpm_limit": 100,
"team_member_tpm_limit": 1000
}'
```
</TabItem>
</Tabs>
### Set default params for new teams
When you connect litellm to your SSO provider, litellm can auto-create teams. Use this to set the default `models`, `max_budget`, `budget_duration` for these auto-created teams.
Binary file not shown.

After

Width:  |  Height:  |  Size: 100 KiB

@@ -55,7 +55,7 @@ pip install litellm==1.75.8
## Team Member Rate Limits
<Image
img={require('../img/release_notes/team_member_rate_limits.png')}
img={require('../../img/release_notes/team_member_rate_limits.png')}
style={{width: '100%', display: 'block', margin: '2rem auto'}}
/>
<p style={{textAlign: 'left', color: '#666'}}>
@@ -1383,6 +1383,20 @@ const Teams: React.FC<TeamProps> = ({
>
<TextInput placeholder="e.g., 30d" />
</Form.Item>
<Form.Item
label="Team Member RPM Limit"
name="team_member_rpm_limit"
tooltip="The RPM (Requests Per Minute) limit for individual team members"
>
<NumericalInput step={1} width={400} />
</Form.Item>
<Form.Item
label="Team Member TPM Limit"
name="team_member_tpm_limit"
tooltip="The TPM (Tokens Per Minute) limit for individual team members"
>
<NumericalInput step={1} width={400} />
</Form.Item>
<Form.Item
label="Metadata"
name="metadata"