RoutingStrategy

const RoutingStrategy: object

Defined in: packages/ai.matey.types/src/router.ts:52

Routing strategies for selecting backends.

Type Declaration

COST_OPTIMIZED

readonly COST_OPTIMIZED: "cost-optimized" = 'cost-optimized'

Route to least-cost backend.

CUSTOM

readonly CUSTOM: "custom" = 'custom'

Use custom routing logic.

EXPLICIT

readonly EXPLICIT: "explicit" = 'explicit'

Use backend specified in request options.

LATENCY_OPTIMIZED

readonly LATENCY_OPTIMIZED: "latency-optimized" = 'latency-optimized'

Route to fastest backend (lowest latency).

MODEL_BASED

readonly MODEL_BASED: "model-based" = 'model-based'

Route based on model name.

RANDOM

readonly RANDOM: "random" = 'random'

Random backend selection.

ROUND_ROBIN

readonly ROUND_ROBIN: "round-robin" = 'round-robin'

Round-robin load balancing.