title: Step 1: Create Knowledge Pipeline¶
Step 1: Create Knowledge Pipeline¶
Navigate to Knowledge at the top, then click Create from Knowledge Pipeline on the left. There're three ways for you to get started.
Build from Scratch¶
Click Blank Knowledge Pipeline to build a custom pipeline from scratch. Choose this option when you need custom processing strategies based on specific data source and business requirements.
Templates¶
FlexAI offers two types of templates: Built-in Pipeline and Customized. Both template cards display name of knowledge base, description, and tags (including chunk structure).
Built-in Pipeline¶
Built-in pipelines are official knowledge base templates pre-configured by FlexAI. These templates are optimized for common document structures and use cases. Simply click Choose to get started.
Types | Name | Chunk Structure | Index Method | Retrieval Setting | Description | |------|-----------------|--------------|-------------------|-------------| | General Mode-ECO | General | Economical | Inverted Index | Divide document content into smaller paragraphs, directly used for matching user queries and retrieval. | | Parent-child-HQ | Parent-Child | High Quality | Hybrid Search | Adopt advanced chunking strategy, dividing document text into larger parent chunks and smaller child chunks. The parent chunks contain child chunks which ensure both retrieval precision and maintain contextual integrity. | | Simple Q&A | Question & Answer | High Quality | Vector Search | Convert tabular data into question-answer format, using question matching to quickly hit corresponding answer information. | | LLM Generated Q&A | Question & Answer | High Quality | Vector Search | Generate structured question-answer pairs with large language models based on original text paragraphs. Find relevant answer by using question matching mechanism. | | Convert to Markdown | Parent-child | High Quality | Hybrid Search - Weighted Score | Designed for Office native file formats such as DOCX, XLSX, and PPTX, converting them to Markdown format for better information processing. ⚠️ Note: PDF files are not recommended. |
To preview the selected built-in pipeline, click Details on any template card. Then, check information in the popup window, including: orchestration structure, pipeline description, and chunk structure. Click Use this Knowledge Pipeline for orchestration.
Customized¶
Customized templates are user-created and published knowledge pipeline. You can choose a template to start, export the DSL, or view detailed information for any template.
To create a knowledge base from a template, click Choose on the template card. You can also create knowledge base by clicking Use this Knowledge Pipeline when previewing a template. Click More to edit pipeline information, export pipeline, or delete the template.
Import Pipeline¶
Import a pipeline of a previously exported knowledge pipeline to quickly reuse existing configurations and modify them for different scenarios or requirements. Navigate to the bottom left of the page and click Import from a DSL File. FlexAI DSL is a YAML-based standard that defines AI application configurations, including model parameters, prompt design, and workflow orchestration. Similar to workflow DSL, knowledge pipeline uses the same YAML format standard to define processing workflows and configurations within a knowledge base.
What's in a knowledge pipeline DSL:
| Name | Description |
|---|---|
| Data Sources | Local files, websites, online documents, online drive, web crawler |
| Data Processing | Document extraction, content chunking, cleaning strategies |
| Knowledge Configuration | Indexing methods, retrieval settings, storage parameters |
| Node Orchestration | Arrangement and sequence |
| User Input Form | Custom parameter fields (if configured) |