Function spin_sdk::llm::llm::infer

source ·
pub fn infer(
    model: &InferencingModel,
    prompt: &str,
    params: Option<InferencingParams>
) -> Result<InferencingResult, Error>
Expand description

Perform inferencing using the provided model and prompt with the given optional params