Files
bifrost/tests/e2e/api/provider_config
Beyhan Oğur 880f412e2c first commit
2026-04-26 21:52:23 +03:00
..
2026-04-26 21:52:23 +03:00

Provider config (Postman env files)

Per-provider Postman environment .json files for running the Bifrost V1 API Newman e2e tests. Each file defines base_url, provider, model, and other model-type variables for that provider.

Variables

Each bifrost-v1-<provider>.postman_environment.json typically includes:

Key Description
base_url Gateway base URL (default http://localhost:8080)
provider Provider name (e.g. openai, anthropic, gemini)
model Chat/completions model
embedding_model Embeddings model
speech_model TTS model
transcription_model Transcription model
image_model Image generation model
batch_id, file_id, container_id Placeholders; overwritten at runtime when tests create resources

Usage

From tests/e2e/api:

# Run for all providers (each bifrost-v1-*.postman_environment.json in this folder, except sgl and ollama)
./runners/run-newman-inference-tests.sh

# Run for a single provider
./runners/run-newman-inference-tests.sh --env openai
./runners/run-newman-inference-tests.sh --env provider_config/bifrost-v1-openai.postman_environment.json

Ensure the Bifrost server is running and the chosen provider(s) are configured (API keys, etc.). Depending on provider capabilities, tests may either succeed (2xx) or return expected unsupported-operation responses.

Provider-specific notes

  • Cohere Requires a valid Cohere API key in Bifrost provider config. Key format and auth may differ from other providers; 401 is expected if the key is missing or invalid.
  • Vertex Requires region in the key config for embeddings and other operations. Set this in Bifrost provider config (project, region, credentials). Embeddings typically require a supported region such as us-central1.
  • Replicate Set replicate_owner (e.g. via environment or Postman env) when running Replicate tests; otherwise API calls may fail.

Files

All Bifrost providers are included except sgl and ollama (excluded in runners/run-newman-inference-tests.sh when running “all providers”).

  • bifrost-v1-openai.postman_environment.json
  • bifrost-v1-anthropic.postman_environment.json
  • bifrost-v1-azure.postman_environment.json
  • bifrost-v1-bedrock.postman_environment.json
  • bifrost-v1-cerebras.postman_environment.json
  • bifrost-v1-cohere.postman_environment.json
  • bifrost-v1-elevenlabs.postman_environment.json
  • bifrost-v1-gemini.postman_environment.json
  • bifrost-v1-groq.postman_environment.json
  • bifrost-v1-huggingface.postman_environment.json
  • bifrost-v1-mistral.postman_environment.json
  • bifrost-v1-nebius.postman_environment.json
  • bifrost-v1-openrouter.postman_environment.json
  • bifrost-v1-parasail.postman_environment.json
  • bifrost-v1-perplexity.postman_environment.json
  • bifrost-v1-replicate.postman_environment.json
  • bifrost-v1-vertex.postman_environment.json
  • bifrost-v1-xai.postman_environment.json

To add a provider, copy an existing env file, rename it to bifrost-v1-<provider>.postman_environment.json, and set the provider and model values for that provider.