Interface InferencingOptions

Hierarchy

  • InferencingOptions

Properties

maxTokens?: number
repeatPenalty?: number
repeatPenaltyLastNTokenCount?: number
temperature?: number
topK?: number
topP?: number

Generated using TypeDoc