Ingest Sources

Ingest and index sources of different types.

This endpoint supports two source types:

1. Files: Upload files via multipart form data. All files are grouped under a single file connector.
2. Web pages: Provide URLs to scrape. Each web source creates a separate connector.

The API only returns once all documents have completed indexing (success or failure).

Request Format:

• Use multipart/form-data

• Include files in the ‘files’ field (for file sources)

• Include source configuration as JSON string in ‘sources_json’ field

  Example sources_json:

{
    "sources": [
        {
            "type": "file",
            "name": "My Documents"
        },
        {
            "type": "web", 
            "name": "Company Documentation",
            "web_config": {
                "url": "https://docs.company.com",
                "web_connector_type": "recursive",
                "mintlify_cleanup": true
            }
        }
    ]
}