Skip to main content

embedding_client

Embedding Client for text-extractor service.

Provides a unified interface for embedding generation using self-hosted IBM Granite embedding model via vLLM.

Classes

EmbeddingClientProtocol

Protocol defining the embedding client interface.

Methods

generate_embeddings

def generate_embeddings(self, texts: list[str], batch_size: int = 32) -> list[list[float]]

Generate embeddings for a list of texts.

Functions

get_embedding_client

def get_embedding_client() -> EmbeddingClientProtocol

Get the Granite embedding client.

Returns the self-hosted IBM Granite embedding client using vLLM.

Returns: GraniteEmbeddingClient instance implementing EmbeddingClientProtocol

get_default_embedding_client

def get_default_embedding_client() -> EmbeddingClientProtocol

Get or create the default singleton embedding client.