Struct LlmFactor

pub struct LlmFactor { /* private fields */ }

The factor for LLMs.

Implementations

impl LlmFactor

pub fn new<F: LlmEngineCreator + 'static>(default_engine_creator: F) -> Self

Creates a new LLM factor with the given default engine creator.

The default engine creator is used to create the engine if no runtime configuration is provided.

Trait Implementations

impl Factor for LlmFactor

type RuntimeConfig = RuntimeConfig

The particular runtime configuration relevant to this factor.

type AppState = AppState

The application state of this factor.

type InstanceBuilder = InstanceState

The builder of instance state for this factor.

fn init<T: Send + 'static>( &mut self, ctx: InitContext<'_, T, Self>, ) -> Result<()>

Initializes this Factor for a runtime once at runtime startup.

fn configure_app<T: RuntimeFactors>( &self, ctx: ConfigureAppContext<'_, T, Self>, ) -> Result<Self::AppState>

Performs factor-specific validation and configuration for the given [App].

fn prepare<T: RuntimeFactors>( &self, ctx: PrepareContext<'_, T, Self>, ) -> Result<Self::InstanceBuilder>

Creates a new FactorInstanceBuilder, which will later build per-instance state for this factor.