Preparing search index...
The search index is not available
@fermyon/spin-sdk
@fermyon/spin-sdk
Llm
InferencingOptions
Interface InferencingOptions
Interface representing options for inferencing. InferencingOptions
interface
InferencingOptions
{
maxTokens
?:
number
;
repeatPenalty
?:
number
;
repeatPenaltyLastNTokenCount
?:
number
;
temperature
?:
number
;
topK
?:
number
;
topP
?:
number
;
}
Index
Properties
max
Tokens?
repeat
Penalty?
repeat
Penalty
LastNToken
Count?
temperature?
topK?
topP?
Properties
Optional
max
Tokens
max
Tokens
?:
number
Optional
repeat
Penalty
repeat
Penalty
?:
number
Optional
repeat
Penalty
LastNToken
Count
repeat
Penalty
LastNToken
Count
?:
number
Optional
temperature
temperature
?:
number
Optional
topK
topK
?:
number
Optional
topP
topP
?:
number
Settings
Member Visibility
Protected
Inherited
Theme
OS
Light
Dark
On This Page
Properties
max
Tokens
repeat
Penalty
repeat
Penalty
LastNToken
Count
temperature
topK
topP
@fermyon/spin-sdk
Loading...
Interface representing options for inferencing. InferencingOptions