Skip to main content

Mistral 3

Community contribution welcome

This guide is currently under development. If you have experience deploying Mistral 3 with SGLang, please help us complete this documentation.

To contribute, fork the repo, edit this page, and open a PR.

1. Model Introduction

This page will cover practical deployment configs and usage patterns for Mistral 3 with SGLang.

2. SGLang Installation

Please refer to the official SGLang installation guide.

3. Model Deployment

Coming soon: recommended launch configs (TP/PP, quantization, context length) and tuning tips.

4. Model Invocation

Coming soon: OpenAI-compatible API examples and tool-calling notes.

Contributing

git clone https://github.com/YOUR_USERNAME/sgl-cookbook.git
cd sgl-cookbook
git checkout -b add-mistral-3-guide
# Edit this file and submit a PR

Reference