An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

The official Meta Llama 3 GitHub site

A high-throughput and memory-efficient inference and serving engine for LLMs

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

Ongoing research training transformer models at scale

Reference implementation of Mistral AI 7B v0.1 model.

A series of large language models trained from scratch by developers @01-ai

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

Official release of InternLM2 7B and 20B base and chat models. 200K context support

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

TigerBot: A multi-language multi-task LLM

DeepSeek LLM: Let there be answers