Batch Queues and processing

Inspect, wait for, and diagnose asynchronous server processing.

Outcome: Inspect, wait for, and diagnose asynchronous server processing.

queues = project.batch_queues()
queue = project.batch_queue("BATCH_QUEUE_ID")

print(queue.refresh())
print(queue.status())
print(queue.data())
final = queue.wait(timeout=1800)

ProcessingStatus exposes status, total, completed, processing, and failed. Completion means processing == 0; it does not mean every row succeeded. ProcessingTimeoutError includes the last observed status so a caller can log progress and resume monitoring without guessing.

Operating contract

Concern	Required behavior
Execution surface	Pinned unitlab==3.0.0 application environment on Python 3.10+.
Identity	Least-privilege API key supplied through approved configuration.
Target resolution	Stable resource IDs and an explicitly bounded target set.
Success evidence	Typed return fields, server-side state, and downstream acceptance of the result.

Failure and recovery boundary

Condition	Response
Authentication or authorization fails	Stop, correct the service identity or access model, rotate exposed credentials, and rerun a read-only check.
Validation or entitlement rejects the operation	Correct the input or entitlement; do not retry an unchanged request.
A request times out	Inspect remote state before repeating a mutation because the server may have accepted it.
Asynchronous processing exceeds its deadline	Preserve the Batch Queue or release ID, continue bounded monitoring, and inspect item-level failures.
Only part of a batch succeeds	Keep successful identifiers, isolate failed rows, and retry only the corrected subset.

Pin and test the production SDK version. Use stable IDs, keep secrets out of logs and command history, and record the correlation ID, target IDs, counts, final state, and redacted error details for material state changes.

---

Related Unitlab capability guides: training-data curation workflows