embedding_client
Embedding Client for text-extractor service.
Provides a unified interface for embedding generation using self-hosted IBM Granite embedding model via vLLM.
Classes
EmbeddingClientProtocol
Protocol defining the embedding client interface.
Methods
generate_embeddings
def generate_embeddings(self, texts: list[str], batch_size: int = 32) -> list[list[float]]
Generate embeddings for a list of texts.
Functions
get_embedding_client
def get_embedding_client() -> EmbeddingClientProtocol
Get the Granite embedding client.
Returns the self-hosted IBM Granite embedding client using vLLM.
Returns: GraniteEmbeddingClient instance implementing EmbeddingClientProtocol
get_default_embedding_client
def get_default_embedding_client() -> EmbeddingClientProtocol
Get or create the default singleton embedding client.