Class GradientLLM

The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.

Hierarchy (view full)

Constructors

constructor

Properties

model modelSlug adapterId? gradientAccessKey? inferenceParameters? workspaceId?

Methods

setModel

Constructors

constructor

Properties

model

model: any

modelSlug

modelSlug: string = "llama2-7b-chat"

Optional adapterId

adapterId?: string

Optional gradientAccessKey

gradientAccessKey?: string

Optional inferenceParameters

inferenceParameters?: Record<string, unknown>

Optional workspaceId

workspaceId?: string

Methods

setModel

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc