Skip to content

Semaphore for model deletion and model processing. #91

Description

@mattjhawken

Currently models can be taken offline, either due to an expired job or disconnected worker, and any requests still being processed by the model will throw key errors. (eg. _handle_forward in torch_node.py).

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingnodePeer-to-peer node features and optimizations.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions