Google PaLM

The palm provider is compatible with Google's PaLM offering, which offers access to models such as text-bison-001.

You can use it by specifying one of the available models offered by PaLM. Currently, the following model is supported:

• palm:chat-bison-001

Supported environment variables:

• PALM_API_KEY (required) - Google PaLM API token
• PALM_API_HOST - used to override the Google API host, defaults to generativelanguage.googleapis.com

The PaLM provider supports various configuration options such as safetySettings, stopSequences, temperature, maxOutputTokens, topP, and topK that can be used to customize the behavior of the model like so:

providers:
  - id: palm:text-bison-001
    config:
      temperature: 0
      maxOutputTokens: 1024