as discussed in #774
My proposed change is something like this:
| api |
previous |
new |
proposed |
| foundry |
/openai/status |
/status |
foundry/v1/status |
| foundry |
|
/shutdown |
foundry/v1/shutdown |
| foundry |
/openai/loadedmodels |
/models/loaded |
foundry/v1/models/loaded |
| foundry |
/openai/load/{name} |
/models/load/{name} |
foundry/v1/models/load/{name} |
| foundry |
/openai/unload/{name} |
/models/unload/{name} |
foundry/v1/models/unload/{name} |
| openai |
|
/v1/models |
openai/v1/models |
| openai |
|
/v1/models/{name} |
openai/v1/models/{name} |
| openai |
/v1/chat/completions |
/v1/chat/completions |
openai/v1/chat/completions |
| openai |
/v1/audio/transcriptions |
/v1/audio/transcriptions |
openai/v1/audio/transcriptions |
| openai |
|
/v1/embeddings |
openai/v1/embeddings |
| openai |
|
/v1/responses |
openai/v1/responses |
| openai |
|
/v1/responses/{id} |
openai/v1/responses/{id} |
| openai |
|
/v1/responses/{id}/input_items |
openai/v1/responses/{id}/input_items |
When using an openai compatible client you would then use http://localhost:xxxx/openapi/v1 as the base url
This also leaves a path for non-breaking upgrades to foundry api, and adding other rest apis like ollama or anthropic.
as discussed in #774
My proposed change is something like this:
When using an openai compatible client you would then use
http://localhost:xxxx/openapi/v1as the base urlThis also leaves a path for non-breaking upgrades to foundry api, and adding other rest apis like ollama or anthropic.