Skip to content
ai.matey

PromptTemplate

Defined in: packages/ai.matey.types/src/model-runner.ts:303

Prompt template for formatting messages.

Properties

Section titled “Properties”

addGenerationPrompt?

Section titled “addGenerationPrompt?”

optional addGenerationPrompt: boolean

Defined in: packages/ai.matey.types/src/model-runner.ts:340

Add generation prompt at the end.

assistantTemplate?

Section titled “assistantTemplate?”

optional assistantTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:325

Assistant message wrapper.

Example

Section titled “Example”
'{content}'

bosToken?

Section titled “bosToken?”

optional bosToken: string

Defined in: packages/ai.matey.types/src/model-runner.ts:330

Beginning of sequence token.

eosToken?

Section titled “eosToken?”

optional eosToken: string

Defined in: packages/ai.matey.types/src/model-runner.ts:335

End of sequence token.

name

Section titled “name”

name: string

Defined in: packages/ai.matey.types/src/model-runner.ts:307

Template name/identifier.

systemTemplate?

Section titled “systemTemplate?”

optional systemTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:313

System message wrapper.

Example

Section titled “Example”
'<<SYS>>\n{content}\n<</SYS>>'

userTemplate?

Section titled “userTemplate?”

optional userTemplate: string

Defined in: packages/ai.matey.types/src/model-runner.ts:319

User message wrapper.

Example

Section titled “Example”
'[INST] {content} [/INST]'