ballerinax/ai.mistral Ballerina library

Overview

Mistral AI provides high-performance, open-weights large language models (LLMs) designed for efficiency and versatility. The Mistral connector enables integration with Mistral AI's models, allowing you to build advanced natural language processing applications.

Key Features

• Seamless integration with high-performance Mistral LLMs
• Support for chat completions and text generation
• Efficient handling of model parameters and prompts
• Simplified access to Mistral AI's API endpoints
• Secure communication with API key authentication
• GraalVM compatible for native image builds

Prerequisites

Before using this module in your Ballerina application, first you must obtain the nessary configuration to engage the LLM.

• Create a Mistral account.
• Obtain an API key by following these instructions

Quickstart

To use the ai.mistral module in your Ballerina application, update the .bal file as follows:

Step 1: Import the module

Import the ai.mistral module.

import ballerinax/ai.mistral;

Step 2: Intialize the Model Provider

Here's how to initialize the Model Provider:

import ballerina/ai;
import ballerinax/ai.mistral;

final ai:ModelProvider mistralModel = check new mistral:ModelProvider("mistralApiKey", mistral:MINISTRAL_3B_2410);

Step 4: Invoke chat completion

ai:ChatMessage[] chatMessages = [{role: "user", content: "hi"}];
ai:ChatAssistantMessage response = check mistralModel->chat(chatMessages, tools = []);

chatMessages.push(response);