Overview

Available LLM-APIs on AI Foundation Services

LLM model serving, allowing you to effortlessly query open-source LLM models like Llama3, Mistral open-source models through a simple, OpenAI-compatible API.

Introduction

Models	Provider	Availability
Llama-3.1-70B-Instruct	Meta	Yes
Mixtral-8x7b Instruct v.01	Mistral AI	Yes
CodeLlama-2	Meta	Yes
LLaVA-NeXT	Community	Yes
GPT-4-Omni	OpenAI (via Azure)	Yes
GPT-4-Turbo-2024-05-09	OpenAI (via Azure)	Yes
GPT-3.5-Turbo-0314	OpenAI (via Azure)	On request
Claude 3.5 Sonnet	Anthropic	On request
Claude 3 Opus	Anthropic	On request
Gemini 1.5 Pro	Google	On request
Gemini 1.5 Flash	Google	On request
Llama-3.1-405B-Instruct	Google	On request
Mistral-Large-2407	Mistral AI	On request
Mistral-Nemo-2407	Mistral AI	On request

Magenta SmartChat

SmartChat - an intelligent chat application powered by our LLM endpoints and RAG API. SmartChat allows you to build dynamic conversational interfaces for customer service, internal knowledge bases, and more.

Magenta SmartChat

LLM Playground

Playground: Experiment with different LLMs, Prompt Templates and Documents by providing your API key.

LLM Playground

create-tsi

create-tsi is a generative AI RAG toolkit that generates AI Applications using LlamaIndex with low code.

Create TSI on GitHub

LLM model serving, allowing you to effortlessly query open-source LLM models like Llama3, GPT-4, and Mistral AI models through a simple, OpenAI-compatible API.

API Key Portal

PI Portal - Allows you to manage your LLM API Keys and monitor your token usage

LLM API Key Portal