evroc Think Models API

API for managing AI model instances on the evroc Think platform

Version: v1beta1

Contact information: evroc Support https://www.evroc.com/ support@evroc.com

Security

BearerAuth

apiKeyAPI Key
DescriptionBearer token for authentication (format: Bearer )
Inheader
NameAuthorization

OrganizationHeader

apiKeyAPI Key
DescriptionOrganization identifier header
Inheader
Nameorganization

/

GET

Summary:

Test endpoint

Description:

Just a test endpoint. Says hello.

Responses
CodeDescriptionSchema
200OKstring

/instances

GET

Summary:

List model instances

Description:

Retrieve all model instances belonging to the authenticated organization

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
Responses
CodeDescriptionSchema
200List of model instances[ v1beta1.ListInstancesResponse ]
401Unauthorized - authentication requiredv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

POST

Summary:

Create model instance

Description:

Deploy a new model instance with specified configuration

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
instancebodyModel instance configurationYesv1beta1.InstanceCreateRequest
Responses
CodeDescriptionSchema
201Model instance created successfullyv1beta1.CreateInstanceResponse
400Invalid request - missing or invalid parametersv1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
403Forbidden - model or size not allowed for organizationv1beta1.ErrorResponse
409Conflict - instance with same name already existsv1beta1.ErrorResponse
429Too Many Requests - quota exceeded for selected sizev1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
OrganizationHeader
BearerAuth
OrganizationHeader

/instances/

DELETE

Summary:

Delete model instance

Description:

Delete model instance

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
namepathName of the model instance to deleteYesstring
Responses
CodeDescriptionSchema
202Deletion initiated successfullyobject
400Invalid request - missing instance namev1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
404Model instance not foundv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

PUT

Summary:

Update model instance

Description:

Update configuration of an existing model instance. Note that changing the model is not allowed - delete and recreate instead.

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
namepathName of the model instance to updateYesstring
instancebodyUpdated model instance configuration. You can only change size, args and env varsYesv1beta1.InstanceUpdateRequest
Responses
CodeDescriptionSchema
202Update accepted and processingobject
400Invalid request - name mismatch or invalid parametersv1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
403Forbidden - cannot change model or size not allowedv1beta1.ErrorResponse
404Model instance not foundv1beta1.ErrorResponse
429Too Many Requests - not enough resources for new sizev1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/instances/{name}/start

GET

Summary:

Start model instance

Description:

Start a stopped model instance to resume serving requests

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
namepathName of the model instance to startYesstring
Responses
CodeDescriptionSchema
202Start request accepted and processingobject
400Invalid request - missing instance namev1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
404Model instance not foundv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/instances/{name}/stop

GET

Summary:

Stop model instance

Description:

Stop a running model instance to save resources while preserving configuration

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
namepathName of the model instance to stopYesstring
Responses
CodeDescriptionSchema
202Stop request accepted and processingobject
400Invalid request - missing instance namev1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
404Model instance not foundv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/logs/

GET

Summary:

Get instance logs

Description:

Retrieve logs for a specific model instance

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
namepathName of the model instanceYesstring
Responses
CodeDescriptionSchema
200Returns logs of the pod as array of log lines[ string ]
400Invalid request - missing instance namev1beta1.ErrorResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
404Model instance not foundv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/models

GET

Summary:

Get all models

Description:

Retrieve a list of all available models with their specifications

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
Responses
CodeDescriptionSchema
200Returns map of models with the model's respective specificationsv1beta1.ListModelsResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/models/

GET

Summary:

Get model details

Description:

Retrieve detailed information about a specific model

Parameters
NameLocated inDescriptionRequiredSchema
modelpathModel handle (e.g., 'microsoft/DialoGPT-medium', 'meta-llama/Llama-2-7b-hf')Yesstring
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
Responses
CodeDescriptionSchema
200Model specificationv1beta1.ModelSpec
401Unauthorized - authentication requiredv1beta1.ErrorResponse
404Model not foundv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

/sizes

GET

Summary:

Get all sizes

Description:

Retrieve a list of all available compute sizes with their resource specifications

Parameters
NameLocated inDescriptionRequiredSchema
AuthorizationheaderBearer token for authenticationYesstring
organizationheaderOrganization identifierYesstring
Responses
CodeDescriptionSchema
200Map of size names to their specificationsv1beta1.ListSizesResponse
401Unauthorized - authentication requiredv1beta1.ErrorResponse
500Internal server errorv1beta1.ErrorResponse
Security
Security SchemaScopes
BearerAuth
OrganizationHeader

Models

v1beta1.CreateInstanceResponse

NameTypeDescriptionRequired
instancev1beta1.InstanceNo
messagestringNo

v1beta1.ErrorResponse

NameTypeDescriptionRequired
detailsobjectNo
errorstringNo

v1beta1.Instance

NameTypeDescriptionRequired
arguments[ string ]No
created_atstringNo
endpointstringNo
environmentobjectNo
modelstringNo
namestringNo
organizationstringNo
sizestringNo
statusv1beta1.InstanceStatusNo
stoppedbooleanNo
tokenstringNo
updated_atstringNo

v1beta1.InstanceCreateRequest

NameTypeDescriptionRequired
arguments[ string ]No
environmentobjectNo
modelstringNo
namestringNo
sizestringNo
stoppedbooleanNo
tokenstringNo

v1beta1.InstanceStatus

NameTypeDescriptionRequired
error_countintegerNo
last_errorstringNo
last_updatedstringNo
messagestringNo
phasestringNo
readybooleanNo
ready_replicasintegerNo

v1beta1.InstanceUpdateRequest

NameTypeDescriptionRequired
arguments[ string ]No
environmentobjectNo
namestringNo
sizestringNo
tokenstringNo

v1beta1.ListInstancesResponse

NameTypeDescriptionRequired
instancesobjectNo

v1beta1.ListModelsResponse

NameTypeDescriptionRequired
modelsobjectNo

v1beta1.ListSizesResponse

NameTypeDescriptionRequired
sizesobjectNo

v1beta1.ModelSpec

NameTypeDescriptionRequired
default_args[ string ]No
default_envobjectNo
descriptionstringNo
handlestringNo
instance_typestringNo
licensestringNo
license_urlstringNo

v1beta1.SizeSpec

NameTypeDescriptionRequired
cpustringNo
descriptionstringNo
gpustringNo
labelsobjectNo
memorystringNo
namestringNo