Skip to main content
Version: 21 R3 BETA

OpenAIChatCompletionsStreamResult

Inherits

Properties

PropertyTypeDescription
dataObjectContains the stream data sent by the server.

Computed Properties

PropertyTypeDescription
choiceOpenAIChoiceReturns a choice data, with a delta message.
choicesCollectionReturns a collection of OpenAIChoice data, with delta messages.

Overridden properties

PropertyTypeDescription
successBooleanReturns True if the streaming data was successfully decoded as an object.
terminatedBooleanA Boolean indicating whether the HTTP request was terminated. ie onTerminate called.
usageObjectReturns token usage information from the stream data (only available in the final chunk when stream_options.include_usage is set to True).

usage

The usage property returns an object containing token usage information, available only in the final streaming chunk when enabled via stream_options.include_usage: True in the request parameters.

The structure is the same as OpenAIChatCompletionsResult:

FieldTypeDescription
prompt_tokensIntegerNumber of tokens in the prompt.
completion_tokensIntegerNumber of tokens in the completion.
total_tokensIntegerTotal tokens used (prompt + completion).
prompt_tokens_detailsObjectBreakdown of prompt tokens (optional).
completion_tokens_detailsObjectBreakdown of completion tokens (optional).

Note: To receive usage information in streaming responses, you must set stream_options: {include_usage: True} in your request parameters. See OpenAIChatCompletionsParameters for details.