Module autodep::manager

source ·
Expand description

The manager (worker manager, resource allocator, allocator) is responsible for interfacing with a set of workers. The manager starts and stops workers, and forwards inference requests

Structs

  • Handle
    A handle to a worker
  • Manager
    The worker manager. Right now, assumes that all workers are on the same host
  • PartialHandle
    A (pid, port) tuple