Interface InferenceUsage

Interface representing usage statistics for inferencing. InferenceUsage

interface InferenceUsage {
    generatedTokenCount: number;
    promptTokenCount: number;
}

Properties

generatedTokenCount: number
promptTokenCount: number