Operayde Gateway API

OpenAI-compatible chat completions. Routing decisions (local vs cloud, which model, which silicon) are made by the appliance based on the virtual key's policy.

{
  "model": "operayde/llama-3.1-70b",
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant."
    },
    {
      "role": "user",
      "content": "Summarise the attached contract."
    }
  ],
  "temperature": 0.2
}

Returns a dense vector embedding for each input string. Embeddings are computed locally on the appliance by default.