agents.clients.ollama

Module Contents

Classes

OllamaClient

An HTTP client for interaction with ML models served on ollama

API

class agents.clients.ollama.OllamaClient(model: Union[agents.models.LLM, Dict], host: str = '127.0.0.1', port: int = 11434, inference_timeout: int = 30, init_on_activation: bool = True, logging_level: str = 'info', **kwargs)

Bases: agents.clients.model_base.ModelClient

An HTTP client for interaction with ML models served on ollama