Class ChatBaiduQianfan

Wrapper around Baidu ERNIE large language models that use the Chat endpoint.

To use you should have the QIANFAN_AK and QIANFAN_SK environment variable set.

Hierarchy (view full)

Implements

  • BaiduQianfanChatInput

Constructors

constructor

Properties

model modelName streaming client? penaltyScore? prefixMessages? qianfanAK? qianfanAccessKey? qianfanSK? qianfanSecretKey? temperature? topP? userId?

Accessors

callKeys

Methods

identifyingParams invocationParams

Constructors

constructor

Properties

model

model: string = "ERNIE-Lite-8K"

Model name to use. Available options are: ERNIE-Bot, ERNIE-Lite-8K, ERNIE-Bot-4

Default

"ERNIE-Lite-8K"

modelName

modelName: string = "ERNIE-Lite-8K"

Model name to use. Available options are: ERNIE-Bot, ERNIE-Lite-8K, ERNIE-Bot-4 Alias for model

Default

"ERNIE-Lite-8K"

streaming

streaming: boolean = false

Whether to stream the results or not. Defaults to false.

Optionalclient

client?: any

OptionalpenaltyScore

penaltyScore?: number

Penalizes repeated tokens according to frequency. Range from 1.0 to 2.0. Defaults to 1.0.

OptionalprefixMessages

prefixMessages?: Qianfan[]

Messages to pass as a prefix to the prompt

OptionalqianfanAK

qianfanAK?: string

Access key to use when making requests by Qianfan SDK. Defaults to the value of QIANFAN_KEY environment variable.

OptionalqianfanAccessKey

qianfanAccessKey?: string

Access key to use when making requests by Qianfan SDK with auth. Defaults to the value of QIANFAN_ACCESS_KEY environment variable.

OptionalqianfanSK

qianfanSK?: string

Secret key to use when making requests by Qianfan SDK. Defaults to the value of QIANFAN_KEY environment variable.

OptionalqianfanSecretKey

qianfanSecretKey?: string

Secret key to use when making requests by Qianfan SDK with auth. Defaults to the value of QIANFAN_SECRET_KEY environment variable.

Optionaltemperature

temperature?: number

Amount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0.95.

OptionaltopP

topP?: number

Total probability mass of tokens to consider at each step. Range from 0 to 1.0. Defaults to 0.8.

OptionaluserId

userId?: string

ID of the end-user who made requests.

Accessors

callKeys

Methods

identifyingParams

  • identifyingParams(): {
        model_name: string;
        penalty_score?: number;
        stream?: boolean;
        system?: string;
        temperature?: number;
        top_p?: number;
        user_id?: string;
    }

  • Get the identifying parameters for the model

    Returns {
        model_name: string;
        penalty_score?: number;
        stream?: boolean;
        system?: string;
        temperature?: number;
        top_p?: number;
        user_id?: string;
    }

    • model_name: string
    • Optionalpenalty_score?: number
    • Optionalstream?: boolean
    • Optionalsystem?: string
    • Optionaltemperature?: number
    • Optionaltop_p?: number
    • Optionaluser_id?: string

invocationParams

Settings

Member Visibility

On This Page

Constructors
Properties
Accessors
Methods