ModelCache

Defined in: model-cache.ts:55

In-memory cache for model lists with TTL-based expiration.

Usage:

const cache = new ModelCache();

// Set with 1 hour TTL
cache.set('openai-backend', modelResult, 3600000);

// Get (returns null if expired or not found)
const cached = cache.get('openai-backend');

// Invalidate specific backend
cache.invalidate('openai-backend');

// Clear all
cache.clear();

Constructors

Constructor

new ModelCache(): ModelCache

Defined in: model-cache.ts:58

Returns

ModelCache

Methods

clear()

clear(): void

Defined in: model-cache.ts:123

Clear all cached model lists.

Returns

void

---

get()

get(backendName): ListModelsResult | null

Defined in: model-cache.ts:68

Get cached model list for a backend.

Parameters

backendName

string

Unique backend identifier

Returns

ListModelsResult | null

Cached result or null if not found/expired

---

has()

has(backendName): boolean

Defined in: model-cache.ts:107

Check if backend has cached models.

Parameters

backendName

string

Unique backend identifier

Returns

boolean

true if cache exists and not expired

---

invalidate()

invalidate(backendName): void

Defined in: model-cache.ts:116

Invalidate (remove) cached models for a backend.

Parameters

backendName

string

Unique backend identifier

Returns

void

---

keys()

keys(): string[]

Defined in: model-cache.ts:150

Get all cached backend names (excluding expired).

Returns

string[]

---

set()

set(backendName, result, ttl): void

Defined in: model-cache.ts:92

Cache a model list result.

Parameters

backendName

string

Unique backend identifier

result

ListModelsResult

Model list result to cache

ttl

number

Time to live in milliseconds

Returns

void

---

size()

size(): number

Defined in: model-cache.ts:130

Get number of cached backends.

Returns

number