Gateway section¶
Gateway section
The following statistics are available:
| Statistic | Description |
|---|---|
| Budget | Spend and cap of the gateway in the selected budget period (This month, Today, or All time), with the |
| Cache TTL | Lifetime of the cache in seconds. |
| Retries | Number of retries of a failed call to the provider. The default is 2. |
| Timeout | Time to wait for the provider before the request fails. The default is 120000 ms. |
| Auth | required or open. |
| Rate Limit | Permitted requests per time window. If no rate limit is set, the — entry appears. |
| Log Payloads | yes or no. |
| Webhook | The forwarded events or the all events entry. If no webhook URL is set, the — entry appears. |
| Tracing | on or off. If the trace contains the message bodies, the + bodies entry appears as well. |
| Web Search | on or off. |
| Image Gen | on or off. |
| Prompt Caching | The configured lifetime of the prompt cache, or the off entry. |
| Compaction | on or off. |
| Compact err | Threshold in the form |
| Endpoint URL | Address to which an application sends its requests. The selection list sets the provider for which the view builds the address. |
Note
If the currency of the workspace is euro, the ≈ converted at today's rate; the cap is stored and enforced in USD. hint appears below the budget.