For the complete documentation index, see llms.txt. This page is also available as Markdown.

Bring your own Models

Register, validate, map, secure, and operate private HTTP inference models inside Unitlab workflows.

Bring Your Own Model (BYOM) connects a private HTTP inference endpoint to Unitlab so proprietary, fine-tuned, or domain-specific models can participate in annotation and workflow automation.

Current My AI Models catalog and Integrate External Model entry point
Bring your model into the Unitlab annotation workflow

Operating model

Unitlab stores the integration configuration and invokes the approved endpoint. Your team owns the model runtime, capacity, availability, version, authentication, and change control. Integrated models are private to the workspace and appear under My AI Models.

Supported contracts

Dimension
Current support

Inputs

Image, video, audio, text, medical

Visual outputs

Bounding box, polygon, mask, skeleton, line, point, cuboid

Audio outputs

Event and optional speech-recognition transcript

Text outputs

Entity

Lifecycle states

Running, Stopped, Integration unfinished

Workflow use

Model stage and supported assisted/batch operations

Before you start

  • Deploy a reachable HTTPS endpoint that accepts POST requests.

  • Identify the model owner, version, and on-call owner.

  • Prepare authentication headers without exposing secrets in documentation.

  • Define the exact input and output schema.

  • Prepare representative validation data, including failure cases.

  • Create or approve the destination ontology classes and integer mappings.

  • Confirm the endpoint can handle the intended batch concurrency.

Integration wizard

1

Registration

Open My AI Models and choose Integrate External Model. Select the generic input type and output data type, then enter the model name, description, endpoint, headers, and parameters.

2

Validation

Upload a representative sample. Unitlab calls the endpoint and displays the validation status and raw response. Continue only when the endpoint is reachable and the response matches the selected schema.

3

Integration

Add organizational tags and define output classes. Map each integer class value to the intended class name, color, and annotation geometry.

4

Confirmation

Review the complete contract: model identity, input type, endpoint, validation status, tags, classes, and mappings. Confirm to create the private model.

Representative image request

The exact payload depends on the configured data type. A typical image request contains a signed source URL and optional crop context:

Field
Meaning

src

Time-limited source URL the endpoint downloads

coordinates

Optional crop bounds; omitted or null for full-image inference

rotation

Source orientation in degrees

A representative bounding-box response maps each result to an integer class:

Treat these examples as a contract starting point. The Validation step is authoritative for the selected input and output type.

Class mapping

For every emitted class, define:

  • stable integer value;

  • human-readable name;

  • destination geometry;

  • destination ontology class;

  • confidence interpretation;

  • behavior for unknown or unmapped classes.

Never silently coerce an unsupported class into another ontology label. Reject or quarantine unmapped output.

Production readiness

Control
Acceptance evidence

Endpoint security

HTTPS, approved authentication, secret rotation owner

Availability

Health checks, timeout, retry, capacity plan

Schema

Successful and malformed-response tests

Mapping

Every output has an intentional destination or rejection rule

Calibration

Threshold validated on target-domain data

Human control

Annotate/Review route and correction policy

Observability

Correlation ID, model version, latency, status, redacted error

Change control

Revalidation after model, endpoint, schema, or mapping change

Use the model in a workflow

  1. Open the project workflow.

  2. Add or select a Model stage.

  3. Choose the integrated private model.

  4. Configure thresholds, generic type, queue scope, and class mappings.

  5. Route success to Annotate or Review.

  6. Keep failure visible with a named owner.

  7. Save and apply on a controlled cohort.

  8. Monitor correction and failure rates before scaling.

Manage the integration

From My AI Models, operators can:

  • inspect Running, Stopped, or unfinished status;

  • continue an unfinished integration;

  • update endpoint or configuration;

  • review tags and supported output;

  • stop or retire a model under change control.

Re-run validation after material changes. Record model version and mapping version in the release provenance used for training or evaluation.

Failure handling

Failure
Response

Non-200 endpoint response

Check availability, authentication, and server logs

200 with invalid schema

Compare the raw response with the selected output contract

Empty predictions

Distinguish a valid abstention from a model/runtime failure

Timeout

Inspect remote task state before retrying

Unknown class integer

Stop routing and correct the class mapping

Capacity saturation

Reduce concurrency or scale the endpoint