icecube.ml_suite.triton_plugin module

SPDX-FileCopyrightText: 2024 The IceTray Contributors SPDX-License-Identifier: BSD-2-Clause

Date 2024-05-14 Author briedel

Triton Plugin to allow for token auth, as proposed here: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/client/README.html#python-client-plugin-api-beta

class icecube.ml_suite.triton_plugin.TokenAuthPlugin(auth_token, *args, **kwargs)

Bases: object