Skip to main content

Using SambaNova With Zoo Code

SambaNova specializes in providing high-speed inference for large language models, utilizing their Reconfigurable Dataflow Units (RDUs) through their SambaCloud portal. This delivers fast response times for supported models.

Website: https://cloud.sambanova.ai/

Getting an API Key​

To use SambaNova with Zoo Code, you'll need an API key from the SambaCloud. After signing up, navigate to the API Keys section in the left panel to create and copy your SambaCloud API key.

Available Models​

Zoo Code automatically fetches all available models from the SambaNova API.

For the complete, up-to-date model list and capabilities, see SambaCloud's supported models documentation.

Configuration in Zoo Code​

  1. Open Zoo Code Settings: Click the gear icon () in the Zoo Code panel.
  2. Select Provider: Choose "SambaNova" from the "API Provider" dropdown.
  3. Enter API Key: Paste your SambaNova API key into the "SambaNova API Key" field.
  4. Select Model: Choose your desired model from the "Model" dropdown.
  5. (Optional) Custom Base URL: If using a private deployment, check "Use custom base URL" and enter your endpoint URL.