Tgis auto finder

[gabe-l-hart]

Description

This PR introduces the TGISAutoFinder which implements the ModelFinderBase interface. When configured in model_management.finders, this allows caikit.load (and by extension caikit.runtime model loading) to automatically find models that are managed by TGIS for the text-generation task without needing those models to exist on-disk with a config.yml file.

Example

k port-forward svc/bloom-560m-inference-server 8033

import caikit
from caikit_nlp.model_management import TGISAutoFinder
caikit.configure(
    config_dict={
        "model_management": {
            "finders": {
                "default": {
                    "type": TGISAutoFinder.name,
                    "config": {},
                }
            },
            "initializers": {
                "default": {
                    "type": "LOCAL",
                    "config": {
                        "backend_priority": [
                            {
                                "type": "TGIS",
                                "config": {
                                    "connection": {
                                        "hostname": "localhost:8033",
                                    }
                                }
                            }
                        ]
                    }
                }
            }
        }
    }
)

model = caikit.load("flan-t5-xl")

[gkumbhat]

Looks great to me. Thanks Gabe!