Interface InternalInferencingOptions

Interface representing internal options for inferencing. InternalInferencingOptions

interface InternalInferencingOptions {
    maxTokens?: number;
    repeatPenalty?: number;
    repeatPenaltyLastNTokenCount?: number;
    temperature?: number;
    topK?: number;
    topP?: number;
}

Properties

maxTokens? repeatPenalty? repeatPenaltyLastNTokenCount? temperature? topK? topP?

Properties

OptionalmaxTokens

maxTokens?: number

OptionalrepeatPenalty

repeatPenalty?: number

OptionalrepeatPenaltyLastNTokenCount

repeatPenaltyLastNTokenCount?: number

Optionaltemperature

temperature?: number

OptionaltopK

topK?: number

OptionaltopP

topP?: number

Settings

Member Visibility

On This Page

Properties