health_multimodal.image.utils

Functions

Create a ImageInferenceEngine for the image model.

Classes

An enumeration.

class health_multimodal.image.utils.ImageModelType(value)[source]: An enumeration.

health_multimodal.image.utils.get_image_inference(image_model_type=ImageModelType.BIOVIL_T)[source]

Create a ImageInferenceEngine for the image model.

Parameters: image_model_type (ImageModelType) – The type of image model to use, BIOVIL or BIOVIL_T.

The model is downloaded from the Hugging Face Hub. The engine can be used to get embeddings from text prompts or masked token predictions.