Expand description
An inference worker listens for requests from the Manager
and computes
model inference in an isolated environment
Structs
- A worker runs as a separate process, spawned by the resource manager. A worker runs an RPC server listening for requests to compute inference on its own local copy of the model
Enums
- The current status of a worker