Module autodep::worker

source ·
Expand description

An inference worker listens for requests from the Manager and computes model inference in an isolated environment

Structs

  • A worker runs as a separate process, spawned by the resource manager. A worker runs an RPC server listening for requests to compute inference on its own local copy of the model

Enums