Skip to content

PromptTemplate

Defined in: packages/ai.matey.types/src/model-runner.ts:303

Prompt template for formatting messages.

optional addGenerationPrompt: boolean

Defined in: packages/ai.matey.types/src/model-runner.ts:340

Add generation prompt at the end.


optional assistantTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:325

Assistant message wrapper.

'{content}'

optional bosToken: string

Defined in: packages/ai.matey.types/src/model-runner.ts:330

Beginning of sequence token.


optional eosToken: string

Defined in: packages/ai.matey.types/src/model-runner.ts:335

End of sequence token.


name: string

Defined in: packages/ai.matey.types/src/model-runner.ts:307

Template name/identifier.


optional systemTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:313

System message wrapper.

'<<SYS>>\n{content}\n<</SYS>>'

optional userTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:319

User message wrapper.

'[INST] {content} [/INST]'