Skip to content

API to cancel pending inference requests #493

Description

@leoll2

OpenVINO async API provides a cancel method to abort running inference requests. This method gives more control to the user over the pending requests, allowing for example to cancel requests that are taking too long.

As far as I know, Model API doesn't expose a similar method. It would be nice if it could be added to Model and AsyncPipeline.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions