ballerinax/ai.mistral Ballerina library

Overview

This module offers APIs for connecting with MistralAI Large Language Models (LLM).

Prerequisites

Before using this module in your Ballerina application, first you must obtain the nessary configuration to engage the LLM.

• Create a Mistral account.
• Obtain an API key by following these instructions

Quickstart

To use the ai.mistral module in your Ballerina application, update the .bal file as follows:

Step 1: Import the module

Import the ai.mistral module.

import ballerinax/ai.mistral;

Step 2: Intialize the Model Provider

Here's how to initialize the Model Provider:

import ballerina/ai;
import ballerinax/ai.mistral;

final ai:ModelProvider mistralModel = check new mistral:ModelProvider("mistralApiKey", mistral:MINISTRAL_3B_2410);

Step 4: Invoke chat completion

ai:ChatMessage[] chatMessages = [{role: "user", content: "hi"}];
ai:ChatAssistantMessage response = check mistralModel->chat(chatMessages, tools = []);

chatMessages.push(response);