first commit

This commit is contained in:
Beyhan Oğur
2026-04-26 21:52:23 +03:00
commit 880f412e2c
2662 changed files with 866266 additions and 0 deletions

View File

@@ -0,0 +1,64 @@
# Provider config (Postman env files)
Per-provider Postman environment `.json` files for running the Bifrost V1 API Newman e2e tests. Each file defines `base_url`, `provider`, `model`, and other model-type variables for that provider.
## Variables
Each `bifrost-v1-<provider>.postman_environment.json` typically includes:
| Key | Description |
|-----|-------------|
| `base_url` | Gateway base URL (default `http://localhost:8080`) |
| `provider` | Provider name (e.g. `openai`, `anthropic`, `gemini`) |
| `model` | Chat/completions model |
| `embedding_model` | Embeddings model |
| `speech_model` | TTS model |
| `transcription_model` | Transcription model |
| `image_model` | Image generation model |
| `batch_id`, `file_id`, `container_id` | Placeholders; overwritten at runtime when tests create resources |
## Usage
From `tests/e2e/api`:
```bash
# Run for all providers (each bifrost-v1-*.postman_environment.json in this folder, except sgl and ollama)
./runners/run-newman-inference-tests.sh
# Run for a single provider
./runners/run-newman-inference-tests.sh --env openai
./runners/run-newman-inference-tests.sh --env provider_config/bifrost-v1-openai.postman_environment.json
```
Ensure the Bifrost server is running and the chosen provider(s) are configured (API keys, etc.). Depending on provider capabilities, tests may either succeed (2xx) or return expected unsupported-operation responses.
## Provider-specific notes
- **Cohere** Requires a valid Cohere API key in Bifrost provider config. Key format and auth may differ from other providers; 401 is expected if the key is missing or invalid.
- **Vertex** Requires `region` in the key config for embeddings and other operations. Set this in Bifrost provider config (project, region, credentials). Embeddings typically require a supported region such as `us-central1`.
- **Replicate** Set `replicate_owner` (e.g. via environment or Postman env) when running Replicate tests; otherwise API calls may fail.
## Files
All Bifrost providers are included except **sgl** and **ollama** (excluded in `runners/run-newman-inference-tests.sh` when running “all providers”).
- `bifrost-v1-openai.postman_environment.json`
- `bifrost-v1-anthropic.postman_environment.json`
- `bifrost-v1-azure.postman_environment.json`
- `bifrost-v1-bedrock.postman_environment.json`
- `bifrost-v1-cerebras.postman_environment.json`
- `bifrost-v1-cohere.postman_environment.json`
- `bifrost-v1-elevenlabs.postman_environment.json`
- `bifrost-v1-gemini.postman_environment.json`
- `bifrost-v1-groq.postman_environment.json`
- `bifrost-v1-huggingface.postman_environment.json`
- `bifrost-v1-mistral.postman_environment.json`
- `bifrost-v1-nebius.postman_environment.json`
- `bifrost-v1-openrouter.postman_environment.json`
- `bifrost-v1-parasail.postman_environment.json`
- `bifrost-v1-perplexity.postman_environment.json`
- `bifrost-v1-replicate.postman_environment.json`
- `bifrost-v1-vertex.postman_environment.json`
- `bifrost-v1-xai.postman_environment.json`
To add a provider, copy an existing env file, rename it to `bifrost-v1-<provider>.postman_environment.json`, and set the `provider` and model values for that provider.

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-anthropic",
"name": "Bifrost V1 anthropic",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "anthropic",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "claude-3-5-sonnet-20241022",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "claude-3-5-sonnet-20241022",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "claude-sonnet-4-5",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-azure",
"name": "Bifrost V1 azure",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "azure",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "gpt-4o",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "gpt-35-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "text-embedding-ada-002",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "gpt-4o-mini-tts",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "whisper",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "gpt-image-1",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "gpt-4o",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "gpt-35-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "gpt-4o",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,156 @@
{
"id": "bifrost-v1-env-bedrock",
"name": "Bifrost V1 bedrock",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "bedrock",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "global.anthropic.claude-sonnet-4-20250514-v1:0",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "amazon.titan-text-express-v1",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "global.cohere.embed-v4:0",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "unsupported_speech_model",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "unsupported_transcription_model",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "amazon.nova-canvas-v1:0",
"type": "default",
"enabled": true
},
{
"key": "image_variation_model",
"value": "amazon.nova-canvas-v1:0",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "bedrock_api_key",
"value": "",
"type": "secret",
"enabled": true
},
{
"key": "bedrock_access_key",
"value": "",
"type": "secret",
"enabled": true
},
{
"key": "bedrock_secret_key",
"value": "",
"type": "secret",
"enabled": true
},
{
"key": "bedrock_region",
"value": "us-east-1",
"type": "default",
"enabled": true
},
{
"key": "bedrock_session_token",
"value": "",
"type": "secret",
"enabled": true
},
{
"key": "s3_bucket",
"value": "bifrost-batch-api-file-upload-testing",
"type": "default",
"enabled": true
},
{
"key": "s3_key",
"value": "test-file.txt",
"type": "default",
"enabled": true
},
{
"key": "job_arn",
"value": "arn:aws:bedrock:us-east-1:123456789012:model-invocation-job/abc123",
"type": "default",
"enabled": true
},
{
"key": "role_arn",
"value": "arn:aws:iam::123456789012:role/BedrockBatchRole",
"type": "default",
"enabled": true
},
{
"key": "output_s3_uri",
"value": "s3://bifrost-batch-api-file-upload-testing/batch-output/",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "global.anthropic.claude-sonnet-4-20250514-v1:0",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "amazon.titan-text-express-v1",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "anthropic.claude-3-5-haiku-20241022-v1:0",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-cerebras",
"name": "Bifrost V1 cerebras",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "cerebras",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "llama3.1-8b",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-cohere",
"name": "Bifrost V1 cohere",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "cohere",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "command-a-03-2025",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "command-a-03-2025",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "embed-v4.0",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "unsupported_speech_model",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "unsupported_transcription_model",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "unsupported_image_model",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "command-a-03-2025",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "command-a-03-2025",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "command-a-03-2025",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,96 @@
{
"id": "bifrost-v1-env-elevenlabs",
"name": "Bifrost V1 elevenlabs",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "elevenlabs",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "unsupported_embedding_model",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "scribe_v1",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "unsupported_image_model",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "voice",
"value": "21m00Tcm4TlvDq8ikWAM",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "eleven_multilingual_v2",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,102 @@
{
"id": "bifrost-v1-env-gemini",
"name": "Bifrost V1 gemini",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "gemini",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "gemini-2.0-flash",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "unsupported_model_invoke",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "gemini-2.0-flash",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "gemini-2.0-flash",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "gemini-2.0-flash",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "gemini-embedding-001",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "gemini-2.5-flash-preview-tts",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "gemini-2.5-flash",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "gemini-2.5-flash-image",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "voice",
"value": "achernar",
"type": "default",
"enabled": true
},
{
"key": "speech_input",
"value": "The quick brown fox jumped over the lazy dog.",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-groq",
"name": "Bifrost V1 groq",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "groq",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "llama-3.1-8b-instant",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "llama-3.1-8b-instant",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "llama-3.3-70b-versatile",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-huggingface",
"name": "Bifrost V1 huggingface",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "huggingface",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "groq/meta-llama/Llama-3.3-70B-Instruct",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "groq/meta-llama/Llama-3.3-70B-Instruct",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "sambanova/intfloat/e5-mistral-7b-instruct",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "fal-ai/hexgrad/Kokoro-82M",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "fal-ai/openai/whisper-large-v3",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "fal-ai/fal-ai/flux/dev",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "groq/meta-llama/Llama-3.3-70B-Instruct",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "groq/meta-llama/Llama-3.3-70B-Instruct",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "groq/meta-llama/Llama-3.3-70B-Instruct",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-mistral",
"name": "Bifrost V1 mistral",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "mistral",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "mistral-medium-2508",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "mistral-medium-2508",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "codestral-embed",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "unsupported_speech_model",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "voxtral-mini-latest",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "unsupported_image_model",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "mistral-medium-2508",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "mistral-medium-2508",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "mistral-medium-2508",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,108 @@
{
"id": "bifrost-v1-env-openai",
"name": "Bifrost V1 openai",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "openai",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "gpt-4o",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "gpt-3.5-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "text-embedding-3-small",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "tts-1",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "whisper-1",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "gpt-image-1",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "s3_bucket",
"value": "openai-files",
"type": "default",
"enabled": true
},
{
"key": "s3_output_bucket",
"value": "openai-output",
"type": "default",
"enabled": true
},
{
"key": "role_arn",
"value": "not-required-for-openai",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "gpt-4o",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "gpt-3.5-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "gpt-4o",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,96 @@
{
"id": "bifrost-v1-env-openrouter",
"name": "Bifrost V1 openrouter",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "openrouter",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "google/gemini-3-flash-preview",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "openai/gpt-3.5-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "__openrouter_unsupported_embedding__",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "__openrouter_unsupported_speech__",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "__openrouter_unsupported_transcription__",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "__openrouter_unsupported_image__",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "completions_prompt",
"value": "what is two plus two, answer in one word",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "google/gemini-3-flash-preview",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "openai/gpt-3.5-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "google/gemini-3-flash-preview",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-parasail",
"name": "Bifrost V1 parasail",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "parasail",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "parasail-llama-33-70b-fp8",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "parasail-llama-33-70b-fp8",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "unsupported",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "unsupported",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "unsupported",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "unsupported",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "parasail-llama-33-70b-fp8",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "parasail-llama-33-70b-fp8",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "parasail-llama-33-70b-fp8",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-perplexity",
"name": "Bifrost V1 perplexity",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "perplexity",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "sonar-pro",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "sonar-pro",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "unsupported_embedding_model",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "unsupported_speech_model",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "unsupported_transcription_model",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "unsupported_image_model",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "sonar-pro",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "sonar-pro",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "sonar-pro",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,102 @@
{
"id": "bifrost-v1-env-replicate",
"name": "Bifrost V1 replicate",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "replicate",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "openai/gpt-4.1-mini",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "openai/gpt-3.5-turbo-instruct",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "__replicate_unsupported_embedding__",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "__replicate_unsupported_speech__",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "__replicate_unsupported_transcription__",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "black-forest-labs/flux-dev",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "replicate_owner",
"value": "",
"type": "default",
"enabled": true
},
{
"key": "replicate_expiry",
"value": "1830297599",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "openai/gpt-4.1-mini",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "openai/gpt-4.1-mini",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "openai/gpt-4.1-mini",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,102 @@
{
"id": "bifrost-v1-env-vertex",
"name": "Bifrost V1 vertex",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "vertex",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "gemini-2.5-flash",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "gemini-1.5-flash",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "gemini-embedding-001",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "__vertex_unsupported_speech__",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "__vertex_unsupported_transcription__",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "imagen-4.0-generate-001",
"type": "default",
"enabled": true
},
{
"key": "image_edit_model",
"value": "imagen-3.0-capability-001",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "region",
"value": "us-central1",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "gemini-2.5-flash",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "gemini-1.5-flash",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "gemini-2.5-flash",
"type": "default",
"enabled": true
}
]
}

View File

@@ -0,0 +1,90 @@
{
"id": "bifrost-v1-env-xai",
"name": "Bifrost V1 xai",
"values": [
{
"key": "base_url",
"value": "http://localhost:8080",
"type": "default",
"enabled": true
},
{
"key": "provider",
"value": "xai",
"type": "default",
"enabled": true
},
{
"key": "model",
"value": "grok-3",
"type": "default",
"enabled": true
},
{
"key": "model_invoke",
"value": "grok-3",
"type": "default",
"enabled": true
},
{
"key": "embedding_model",
"value": "__xai_unsupported_embedding__",
"type": "default",
"enabled": true
},
{
"key": "speech_model",
"value": "__xai_unsupported_speech__",
"type": "default",
"enabled": true
},
{
"key": "transcription_model",
"value": "__xai_unsupported_transcription__",
"type": "default",
"enabled": true
},
{
"key": "image_model",
"value": "grok-imagine-image",
"type": "default",
"enabled": true
},
{
"key": "batch_id",
"value": "batch_123",
"type": "default",
"enabled": true
},
{
"key": "file_id",
"value": "file_123",
"type": "default",
"enabled": true
},
{
"key": "container_id",
"value": "container_123",
"type": "default",
"enabled": true
},
{
"key": "chat_model",
"value": "grok-3",
"type": "default",
"enabled": true
},
{
"key": "text_completion_model",
"value": "grok-3",
"type": "default",
"enabled": true
},
{
"key": "responses_model",
"value": "grok-3",
"type": "default",
"enabled": true
}
]
}