TPM reservation

​

Overview

• Capacity guarantee: The reserved TPM capacity is dedicated to your workload and is not shared with other users.
• Dedicated model code: After you create a throughput reservation, the system automatically generates a dedicated model code. You must replace the model parameter in your API requests with this code.
• Overflow strategy: When creating a reservation, you can choose how to handle excess traffic — automatically overflow to pay-as-you-go (default, no service interruption) or use reserved capacity only (excess requests return 429, no additional charges incurred).
• Add-on capacity package: Purchase additional capacity instances on top of an existing reservation. New instances share the same dedicated model code, and the total reserved capacity increases accordingly after the add-on. For more information, see Management operations.
• 8-hour time-window reservation: In Standard mode, you can choose a prepaid plan (by 8-hour time window) with a fixed 8-hour duration and immediate effect, suitable for scenarios where load is concentrated in specific time windows. For more information, see Throughput Reservation billing.

​

Compare and select a plan

​

Supported models

​

Billing and usage notes

• Billing starts once deployment succeeds. Calls within the reserved capacity incur no additional charges; prepaid fees are paid in a one-off upfront payment and remain in effect from the moment of purchase. Refer to the Bailian console for the actual charges.
• For the billing rules and sales constraints of 8-hour time-window reservations (billed by 8-hour time window), see Throughput Reservation billing.
• When the overflow policy is "Auto overflow": requests exceeding the quota degrade to standard pay-as-you-go billing without service interruption. You can view the degradation count on the detail page at Overflow degradation statistics. When set to "Reserved capacity only": requests exceeding the quota return 429 and incur no additional charges.
• Within 2 hours after the service expires, the instance can still be called and renewed; from 2 to 14 hours after expiry, it is stopped, cannot be called, but can still be renewed; after 14 hours, it is released and cannot be recovered. (Applies to daily reservations; 8-hour time-window reservations are not eligible for this grace period. See 8-hour time-window reservation billing)

​

Create a throughput reservation

On the Create throughput reservation page, fill in parameters such as reservation name, model, billing cycle, input TPM, output TPM, purchase duration, auto-renewal on expiry, and overflow policy in turn. The right side of the page provides a TPM capacity calculator to help with estimation.

1. Fill in the following parameters:

   Parameter	Description	Required	Value description
   Reservation name	Custom name for identification.	Yes	≤ 50 characters
   Select model	Select the model for which to reserve capacity. A dedicated model code is generated automatically upon submission.	Yes	Only models that support throughput reservation are available; refer to the console display.
   Performance mode	Inference performance tier, determining the throughput capacity of a single instance.	Yes	Standard mode (same TPS as the standard API) / High-speed mode (equivalent to PTU model deployment, with a 1.5-2x TPS improvement over the standard API)
   Billing cycle	Billing cycle.	Yes	By day; by 8-hour time window (Standard mode only, fixed 8 hours, immediate effect; for more information, see Throughput Reservation billing)
   Input TPM	Reserved input throughput, in kTPM (1 kTPM = 1,000 tokens/minute).	Yes	The starting value and step vary by model; refer to the console display.
   Output TPM	Reserved output throughput, in kTPM.	Yes	The starting value and step vary by model; refer to the console display.
   Purchase duration	Valid duration of the reservation.	Yes	Enter the number of days in the input box. Supported values: 1-30, 60, 90, 120, 365 days.
   Auto-renewal on expiry	Automatically deducts payment and renews one day before expiry (for execution rules, see Throughput Reservation billing). Enabled by default. By 8-hour time window does not support renewal; this parameter does not apply.	No	On / Off
   Single renewal duration	Duration of each automatic renewal.	No	Enter the number of days in the input box. The value range is the same as the purchase duration.
   Overflow policy	How requests exceeding the reserved capacity are handled when it is exhausted.	Yes	Auto overflow to per-token pay-as-you-go (default; overflow switches to pay-as-you-go, no service interruption) / Reserved capacity only (overflow returns 429, no additional charges)

2. After confirming the parameters, click Buy now. In the fee confirmation dialog, verify the charges and click Confirm payment.
3. On the Overview tab of the throughput reservation detail page, find the Dedicated model code and click copy.
4. Replace the model parameter in your API request with the copied dedicated model code:

   Prerequisite: a throughput reservation instance has been created and its status is Running.

   The thinking_budget parameter of GLM-5.2 (which limits thinking length) does not take effect when called.

# When the request volume surges within a short period, the system needs a brief warm-up to match the required compute.
# During warm-up, some requests may experience latency fluctuations. Stability recovers after warm-up completes.
# Ensure you have request queuing or retry mechanisms in place.

import dashscope

response = dashscope.Generation.call(
    api_key="your-api-key",
    model="your-dedicated-model-code",   # Replace with your dedicated model code
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.output.text)

# When the request volume surges within a short period, the system needs a brief warm-up to match the required compute.
# During warm-up, some requests may experience latency fluctuations. Stability recovers after warm-up completes.
# Ensure you have request queuing or retry mechanisms in place.
curl -X POST https://dashscope.aliyuncs.com/compatible-mode/v1/chat/completions \
  -H "Authorization: Bearer $DASHSCOPE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"your-dedicated-model-code","messages":[{"role":"user","content":"Hello"}]}'

​

TPM capacity calculator

​

View and manage

On the throughput reservation page, each model card displays the active reservation count, reserved input/output TPM, and peak ratio. The reservation list table contains columns such as reservation ID, input/output TPM, status, and billing method (by day, by 8-hour time window, by hour, etc.)·expiry time, and supports filtering by model, time, and status.

​

Reservation details

• Overview
• Monitoring
• API access

• Basic information: reservation name, dedicated model code (copyable), base model, input/output capacity.
• Statistics cards (last 7 days): active reservation count, total and peak TPM usage, average utilization.
• Utilization trend: switch between input/output directions; shows the reserved capacity line and actual usage.
• Overflow degradation statistics: shows the number of requests degraded after exceeding the reserved capacity (degradation occurs only under the "Auto overflow" policy).

Provides detailed runtime monitoring data: utilization, quota usage (input/output), number of calls inside and outside the quota, and cache hit volume; for 8-hour time-window reservations, it additionally displays the package utilization within the 8-hour window. For more details, see: Model monitoring.

Displays the dedicated model code and invocation examples.

​

Management operations

• Add-on capacity package
• Scaling
• Renewal
• Unsubscribe

The throughput reservation page centrally manages two types of capacity instances: TPM reservations and PTUs (Provisioned Throughput Units). Add-on capacity packages apply to both. In the "Active capacity instances" area of a target card on the reservation list page, click Add-on capacity package to purchase additional capacity instances on top of an existing reservation. After the add-on, the total capacity of the reservation equals the sum of the base reservation and all add-on capacity packages. The dedicated model code remains unchanged and no API call changes are required.The top of the dialog displays the following information about the base reservation:

• Dedicated model code, base model, performance mode (Standard mode/High-speed mode), and overflow policy: inherited from the base reservation and cannot be changed.
• Existing capacity packages: the number of capacity packages currently added.

Fill in the following purchase parameters:

Parameter	Description	Required	Value description
Billing cycle	The billing cycle of the add-on capacity package is constrained by the base reservation's billing method: if the base is prepaid, only prepaid add-on packages can be selected; if the base is pay-as-you-go, either prepaid or pay-as-you-go add-on packages can be selected. High-speed mode supports pay-as-you-go or subscription; standard mode supports subscription only (by day or by 8-hour time window).	Yes	Pay-as-you-go/by hour / Subscription/by day / Subscription/by 8-hour time window (Standard mode only; capacity increases within the window and becomes invalid outside the window; for rules, see Throughput Reservation billing)
Input capacity	Added input throughput, in kTPM.	Yes	Starting at 10 kTPM, in steps of 10 kTPM.
Output capacity	Added output throughput, in kTPM.	Yes	Starting at 1 kTPM, in steps of 1 kTPM.
Purchase duration	Valid duration of the add-on capacity package. Required only for Subscription/by day; Pay-as-you-go/by hour is billed based on actual duration and does not require this field.	Yes	1~30, 60, 90, 120, 365 days.
Auto-renewal on expiry	Applies only to Subscription/by day. Automatically deducts payment and renews at 08:00 one day before expiry.	No	On / Off

At most one undeleted pay-as-you-go (by hour) capacity instance can exist under a single Model Code: if a pay-as-you-go instance already exists, the billing cycle of the add-on capacity package can only be set to Subscription/by day.

The bottom displays the input reservation fee, output reservation fee, and total. After confirmation, click Confirm purchase. After the purchase succeeds, the new capacity instance enters the "Active capacity instances" list and the total reserved capacity increases accordingly.

Click Scaling and adjust the input TPM and output TPM in the dialog.

Input TPM and output TPM can be set to 0: after zeroing, no capacity charges accrue and the dedicated model code is retained, avoiding code invalidation caused by expiry or unsubscription. However, zeroing is a downgrade, and the used portion is settled at a 1.2x coefficient for refund (see Billing and usage notes above).

Click Renew, select a renewal duration, and complete the payment. If Auto-renewal on expiry is enabled, the system automatically deducts payment and renews at 08:00 one day before expiry.

Click Unsubscribe and the system redirects to the Billing Center to complete the unsubscribe process.

Unsubscription is irreversible. After unsubscription, the dedicated model code becomes invalid and existing requests fall back to public resource processing. When unsubscribing, the used portion is settled at a 1.2x coefficient for refund. See the formula above.

​

FAQ