This API specification outlines two endpoints for interacting with large language models - /completions and /streams. Referenced types and details of each endpoint follow.

Todos

• [x] PR to modify Alpaca Turbo: https://github.com/ViperX7/Alpaca-Turbo/pull/16
• [ ] Move this to github?
• [x] Create OpenAPI spec
• [x] Create a reference python implementation using async Flask or Sanic.

Contact for edit access: [email protected] or @xanderatallah on Twitter.

OpenAPI spec

Reference implementations

Types

• Attachment: {"image": <raw bytes> }. Images can be any format.
• Communication: string | Array<string | Attachment>
• Message: {"role": string, "content": Communication}

POST /completions

This endpoint accepts a request body containing the following parameters: