Skip to main content

Prompt

POST 
/v1/customers/:customer_id/projects/:project_id/prompts

Prompt sends a prompt to an upstream LLM and returns the model's completion. The gateway selects an eligible data plane, retrieves and applies the project's BYOK key, enforces quota, records a request log entry, and proxies the call to the upstream provider. Streaming, multi-turn conversations, tools, and vision are not yet supported on this path.

Request​

Responses​

Success