PaddleX Pipelines (CPU/GPU)

1. Basic Pipelines

Pipeline Name	Pipeline Modules	Baidu AIStudio Community Experience URL	Pipeline Introduction	Applicable Scenarios
Image Classification	Image Classification	Online Experience	Image classification is a technique that assigns images to predefined categories. It is widely used in object recognition, scene understanding, and automatic annotation. Image classification can identify various objects such as animals, plants, traffic signs, etc., and categorize them based on their features. By leveraging deep learning models, image classification can automatically extract image features and perform accurate classification. The General Image Classification Pipeline is designed to solve image classification tasks for given images.	Automatic classification and recognition of product images Real-time monitoring of defective products on production lines Personnel recognition in security surveillance
Object Detection	Object Detection	Online Experience	Object detection aims to identify the categories and locations of multiple objects in images or videos by generating bounding boxes to mark these objects. Unlike simple image classification, object detection not only recognizes what objects are in the image, such as people, cars, and animals, but also accurately determines the specific location of each object, usually represented by a rectangular box. This technology is widely used in autonomous driving, surveillance systems, and smart photo albums, relying on deep learning models (e.g., YOLO, Faster R-CNN) that efficiently extract features and perform real-time detection, significantly enhancing the computer's ability to understand image content.	Tracking moving objects in video surveillance Vehicle detection in autonomous driving Defect detection in industrial manufacturing Shelf product detection in retail
Semantic Segmentation	Semantic Segmentation	Online Experience	Semantic segmentation is a computer vision technique that assigns each pixel in an image to a specific category, enabling detailed understanding of image content. Semantic segmentation not only identifies the types of objects in an image but also classifies each pixel, allowing entire regions of the same category to be marked. For example, in a street scene image, semantic segmentation can distinguish pedestrians, cars, sky, and roads at the pixel level, forming a detailed label map. This technology is widely used in autonomous driving, medical image analysis, and human-computer interaction, often relying on deep learning models (e.g., FCN, U-Net) that use Convolutional Neural Networks (CNNs) to extract features and achieve high-precision pixel-level classification, providing a foundation for further intelligent analysis.	Analysis of satellite images in Geographic Information Systems Segmentation of obstacles and passable areas in robot vision Separation of foreground and background in film production
Instance Segmentation	Instance Segmentation	Online Experience	Instance segmentation is a computer vision task that identifies object categories in images and distinguishes the pixels of different instances within the same category, enabling precise segmentation of each object. Instance segmentation can separately mark each car, person, or animal in an image, ensuring they are processed independently at the pixel level. For example, in a street scene image with multiple cars and pedestrians, instance segmentation can clearly separate the contours of each car and person, forming multiple independent region labels. This technology is widely used in autonomous driving, video surveillance, and robot vision, often relying on deep learning models (e.g., Mask R-CNN) that use CNNs for efficient pixel classification and instance differentiation, providing powerful support for understanding complex scenes.	Crowd counting in malls Counting crops or fruits in agricultural intelligence Selecting and segmenting specific objects in image editing
Document Scene Information Extraction v3	Table Structure Recognition	Online Experience	Document Image Scene Information Extraction v3 (PP-ChatOCRv3-doc) is a PaddlePaddle-specific intelligent document and image analysis solution that integrates LLM and OCR technologies to solve common complex document information extraction challenges such as layout analysis, rare characters, multi-page PDFs, tables, and seal recognition. By integrating the Wenxin large model, it combines vast data and knowledge, providing high accuracy and wide applicability. The open-source version supports local experience and deployment, and fine-tuning training for each module.	Construction of knowledge graphs Detection of information related to specific events in online news and social media Extraction and analysis of key information in academic literature (especially in scenarios requiring recognition of seals, distorted images, and more complex tables)
	Layout Area Detection
	Text Detection
	Text Recognition
	Seal Text Detection
	Text Image Correction
	Document Image Orientation Classification
OCR	Text Detection	Online Experience	OCR (Optical Character Recognition) is a technology that converts text in images into editable text. It is widely used in document digitization, information extraction, and data processing. OCR can recognize printed text, handwritten text, and even certain types of fonts and symbols. The General OCR Pipeline is designed to solve text recognition tasks, extracting text information from images and outputting it in text form. PP-OCRv4 is an end-to-end OCR system that achieves millisecond-level text content prediction on CPUs, achieving state-of-the-art (SOTA) performance in general scenarios. Based on this project, developers from academia, industry, and research have quickly implemented various OCR applications covering general, manufacturing, finance, transportation.	Document digitization Information extraction Data processing
	Text Recognition
Table Recognition	Layout Detection	Online Experience	Table recognition is a technology that automatically identifies and extracts table content and its structure from documents or images. It is widely used in data entry, information retrieval, and document analysis. By leveraging computer vision and machine learning algorithms, table recognition can convert complex table information into editable formats, facilitating further data processing and analysis by users	Processing of bank statements recognition and extraction of various indicators in medical reports extraction of tabular information from contracts
	Table Structure Recognition
	Text Detection
	Text Recognition
Time Series Forecasting	Time Series Forecasting Module	Online Experience	Time series forecasting is a technique that utilizes historical data to predict future trends by analyzing patterns in time series data. It is widely applied in financial markets, weather forecasting, and sales prediction. Time series forecasting typically employs statistical methods or deep learning models (such as LSTM, ARIMA, etc.), which can handle time dependencies in data to provide accurate predictions, assisting decision-makers in better planning and response. This technology plays a crucial role in many industries, including energy management, supply chain optimization, and market analysis	Stock prediction climate forecasting disease spread prediction energy demand forecasting traffic flow prediction product lifecycle prediction electric load forecasting
Time Series Anomaly Detection	Time Series Anomaly Detection Module	Online Experience	Time series anomaly detection is a technique that identifies abnormal patterns or behaviors in time series data. It is widely used in network security, device monitoring, and financial fraud detection. By analyzing normal trends and patterns in historical data, it discovers events that significantly differ from expected behaviors, such as sudden increases in network traffic or unusual transaction activities. Time series anomaly detection often employs statistical methods or machine learning algorithms (like Isolation Forest, LSTM, etc.), which can automatically identify anomalies in data, providing real-time alerts to enterprises and organizations to help promptly address potential risks and issues. This technology plays a vital role in ensuring system stability and security	Financial fraud detection network intrusion detection equipment failure detection industrial production anomaly detection stock market anomaly detection power system anomaly detection
Time Series Classification	Time Series Classification Module	Online Experience	Time series classification is a technique that categorizes time series data into predefined classes. It is widely applied in behavior recognition, speech recognition, and financial trend analysis. By analyzing features that vary over time, it identifies different patterns or events, such as classifying a speech signal as "greeting" or "request" or dividing stock price movements into "rising" or "falling." Time series classification typically utilizes machine learning and deep learning models, effectively capturing time dependencies and variation patterns to provide accurate classification labels for data. This technology plays a key role in intelligent monitoring, voice assistants, and market forecasting applications	Electrocardiogram Classification Stock Market Behavior Classification Electroencephalogram Classification Emotion Classification Traffic Condition Classification Network Traffic Classification Equipment Operating Condition Classification
Multi-label Image Classification	Multi-label Image Classification	None	Image multi-label classification is a technology that assigns an image to multiple related categories simultaneously. It is widely used in image tagging, content recommendation, and social media analysis. It can identify multiple objects or features present in an image, such as both "dog" and "outdoor" labels in a single picture. By using deep learning models, image multi-label classification can automatically extract image features and perform accurate classification to provide more comprehensive information for users. This technology is significant in applications like intelligent search engines and automatic content generation.	Medical image diagnosis Complex scene recognition Multi-target monitoring Product attribute recognition Ecological environment monitoring Security monitoring Disaster warning
Small Object Detection	Small Object Detection	None	Small object detection is a technology specifically for identifying small objects in images. It is widely used in surveillance, autonomous driving, and satellite image analysis. It can accurately find and classify small-sized objects like pedestrians, traffic signs, or small animals in complex scenes. By using deep learning algorithms and optimized convolutional neural networks, small object detection can effectively enhance the recognition ability of small objects, ensuring that important information is not missed in practical applications. This technology plays an important role in improving safety and automation levels.	Pedestrian detection in autonomous vehicles Identification of small buildings in satellite images Detection of small traffic signs in intelligent transportation systems Identification of small intruding objects in security surveillance Detection of small defects in industrial inspection Monitoring of small animals in drone images
Image Anomaly Detection	Image Anomaly Detection	None	Image anomaly detection is a technology that identifies images that deviate from or do not conform to normal patterns by analyzing their content. It is widely used in industrial quality inspection, medical image analysis, and security surveillance. By using machine learning and deep learning algorithms, image anomaly detection can automatically identify potential defects, anomalies, or abnormal behavior in images, helping us detect problems and take appropriate measures promptly. Image anomaly detection systems are designed to automatically detect and label abnormal situations in images to improve work efficiency and accuracy.	Industrial quality control Medical image analysis Anomaly detection in surveillance videos Identification of violations in traffic monitoring Obstacle detection in autonomous driving Agricultural pest and disease monitoring Pollutant identification in environmental monitoring
Layout Parsing	Table Structure Recognition	None	Layout analysis is a technology for extracting structured information from document images, primarily used to convert complex document layouts into machine-readable data formats. This technology has wide applications in document management, information extraction, and data digitization. By combining optical character recognition (OCR), image processing, and machine learning algorithms, layout analysis can identify and extract text blocks, titles, paragraphs, images, tables, and other layout elements from documents. This process typically includes three main steps: layout analysis, element analysis, and data formatting, ultimately generating structured document data that enhances data processing efficiency and accuracy.	Financial and legal document analysis Digitization of historical documents and archives Automated form filling Page structure analysis
	Layout Area Detection
	Text Detection
	Text Recognition
	Formula Recognition
	Seal Text Detection
	Text Image Correction
	Document Image Orientation Classification
Formula Recognition	Layout Area Detection	None	Formula recognition is a technology that automatically identifies and extracts LaTeX formula content and its structure from documents or images. It is widely used in document editing and data analysis in fields such as mathematics, physics, and computer science. By using computer vision and machine learning algorithms, formula recognition can convert complex mathematical formula information into an editable LaTeX format, facilitating further data processing and analysis by users.	Document digitization and retrieval Formula search engine Formula editor Automated typesetting
	Formula Recognition
Seal Text Recognition	Layout Area Detection	None	Seal text recognition is a technology that automatically extracts and recognizes seal content from documents or images. Recognizing seal text is part of document processing and has applications in many scenarios, such as contract comparison, inventory audit, and invoice reimbursement audit.	Contract and agreement validation Check processing Loan approval Legal document management
	Seal Text Detection
	Text Recognition
General Image Recognition	Subject Detection	None	The general image recognition production line is designed to address open-domain target localization and recognition issues. It can effectively identify and differentiate various target objects in different environments and conditions, making it widely applicable in autonomous driving, intelligent security, medical image analysis, and industrial automation, among other fields.	Automated Identity Verification Unmanned Retail Autonomous Driving
	Image Features
Pedestrian Attribute Recognition	Pedestrian Detection	None	Pedestrian attribute recognition is a key function in computer vision systems used to locate and tag specific features of pedestrians in images or videos, such as gender, age, clothing color, and style.	Smart City Security Monitoring
	Pedestrian Attribute Recognition
Vehicle Attribute Recognition	Vehicle Detection	None	Vehicle attribute recognition is an important component of computer vision systems. Its main task is to locate and tag specific attributes of vehicles in images or videos, such as vehicle type, color, and license plate number. This task not only requires accurate detection of vehicles but also the recognition of detailed attribute information for each vehicle.	Intelligent Parking Traffic Management Autonomous Driving
	Vehicle Attribute Recognition
Face Recognition	Face Detection	None	The facial recognition task is an important component of the computer vision field, aiming to realize automatic personal identity recognition through the analysis and comparison of facial features.	Security Authentication Monitoring Systems Social Media
	Face Features

2. Featured Pipelines

Pipeline Name	Pipeline Modules	Baidu AIStudio Community Experience Link	Pipeline Introduction	Applicable Scenarios
Semi-supervised Learning for Large Models - Image Classification	Semi-supervised Learning for Large Models - Image Classification	Online Experience	Image classification is a technique that assigns images to predefined categories. It is widely used in object recognition, scene understanding, and automatic annotation. Image classification can identify various objects such as animals, plants, traffic signs, etc., and categorize them based on their features. By leveraging deep learning models, image classification can automatically extract image features and perform accurate classification. The general image classification pipeline is designed to solve image classification tasks for given images.	Commodity image classification Artwork style classification Crop disease and pest identification Animal species recognition Classification of land, water bodies, and buildings in satellite remote sensing images
Semi-supervised Learning for Large Models - Object Detection	Semi-supervised Learning for Large Models - Object Detection	Online Experience	The semi-supervised learning for large models - object detection pipeline is a unique offering from PaddlePaddle. It utilizes a joint training approach with large and small models, leveraging a small amount of labeled data and a large amount of unlabeled data to enhance model accuracy, significantly reducing the costs of manual model iteration and data annotation. The figure below demonstrates the performance of this pipeline on the COCO dataset with 10% labeled data. After training with this pipeline, on COCO 10% labeled data + 90% unlabeled data, the large model (RT-DETR-H) achieves an 8.4% higher accuracy (47.7% -> 56.1%), setting a new state-of-the-art (SOTA) for this dataset. The small model (PicoDet-S) also achieves over 10% higher accuracy (18.3% -> 28.8%) compared to direct training.	Pedestrian, vehicle, and traffic sign detection in autonomous driving Enemy facility and equipment detection in military reconnaissance Seabed organism detection in deep-sea exploration
Semi-supervised Learning for Large Models - OCR	Text Detection	Online Experience	The semi-supervised learning for large models - OCR pipeline is a unique OCR training pipeline from PaddlePaddle. It consists of a text detection model and a text recognition model working in series. The input image is first processed by the text detection model to obtain and rectify all text line bounding boxes, which are then fed into the text recognition model to generate OCR text results. In the text recognition part, a joint training approach with large and small models is adopted, utilizing a small amount of labeled data and a large amount of unlabeled data to enhance model accuracy, significantly reducing the costs of manual model iteration and data annotation. The figure below shows the effects of this pipeline in two OCR application scenarios, demonstrating significant improvements for both large and small models in different contexts.	Digitizing paper documents Reading and verifying personal information on IDs, passports, and driver's licenses Recognizing product information in retail
	Large Model Semi-supervised Learning - Text Recognition
General Scene Information Extraction v2	Text Detection	Online Experience	The General Scene Information Extraction Pipeline (PP-ChatOCRv2-common) is a unique intelligent analysis solution for complex documents from PaddlePaddle. It combines Large Language Models (LLMs) and OCR technology, leveraging the Wenxin Large Model to integrate massive data and knowledge, achieving high accuracy and wide applicability. The system flow of PP-ChatOCRv2-common is as follows: Input the prediction image, send it to the general OCR system, predict text through text detection and text recognition models, perform vector retrieval between the predicted text and user queries to obtain relevant text information, and finally pass these text information to the prompt generator to recombine them into prompts for the Wenxin Large Model to generate prediction results.	Key information extraction from various scenarios such as ID cards, bank cards, household registration books, train tickets, and paper invoices
	Text Recognition

Comments