Skip to content

FastDeploy 2.0: Large Language Model Deployement

FastDeploy Installation

Initializing search

FastDeploy 2.0: Large Language Model Deployement

FastDeploy 2.0
Quick Start
Quick Start
- Installation
  Installation
- Quick Deployment For ERNIE-4.5-21B-A3B
- Quick Deployment for ERNIE-4.5-VL-28B-A3B
- ERNIE-4.5-300B-A47B
- ERNIE-4.5-VL-424B-A47B
Online Serving
Online Serving
Offline Inference
Quantiation
Quantiation
Features
Features
Supported Models
Benchmark
Usage
Usage

FastDeploy Installation

FastDeploy currently supports installation on the following hardware platforms:

NVIDIA GPU Installation
Kunlun XPU Installation
Enflame S60 GCU Installation
Iluvatar GPU Installation

Made with Material for MkDocs