Create Resource
Create a new resource within a datasource. Resources are individual pieces of content like documents, web pages, files, or data that will be processed and made available for agent interactions.Path Parameters
The unique identifier of the datasource
Request Body
Resource name or title
Resource type. Supported values:
text/plain- Plain text filesapplication/pdf- PDF documentstext/csv- CSV data filestext/markdown- Markdown documentstext/html- HTML contentWEBPAGE- Web page to be scrapedURL- Generic URL resourceaudio/wav- WAV audio filesvideo/mp4- MP4 video filesvideo/youtube- YouTube videosimage/png- PNG imagesimage/jpeg- JPEG imagesimage/webp- WebP images
URL to the resource content (required for web/URL resources)
Direct content (for text-based resources when not using URL)
Resource-specific configuration options (default: )
Resource metadata following the datasource schema (default: )
Additional information about the resource (default: )
External reference URL
External system resource identifier
Whether to store the processed content (default: true)
URL to call when processing is complete
ID of the folder to place this resource in
Response
Resource unique identifier
Resource name
Resource type
Processing status (IN_PROGRESS, VECTORIZING, SCRAPING, SUMMARIZING, DONE, FAILED)
URL to the resource content
Direct content (for text resources)
Auto-generated summary of the resource
Resource metadata
Number of vector embeddings created
Resource size in bytes
When the resource was created (ISO 8601 format)
When the resource was last updated (ISO 8601 format)
List Resources
List resources in a datasource with filtering and pagination support.Path Parameters
The unique identifier of the datasource
Query Parameters
JSON string for filtering by metadata fields
Filter by resource type
Filter by processing status (IN_PROGRESS, VECTORIZING, SCRAPING, SUMMARIZING, DONE, FAILED)
Filter by resource name (partial matching)
Filter by folder ID
Page number (default: 1)
Items per page (default: 20, max: 100)
Response
Total number of resources
Current page number
URL for the next page
URL for the previous page
Array of resource objects
Get Resource
Get detailed information about a specific resource.Path Parameters
The unique identifier of the datasource
The unique identifier of the resource
Response
Returns the complete resource object with all details.Update Resource
Update resource metadata and properties.Path Parameters
The unique identifier of the datasource
The unique identifier of the resource
Request Body
Updated resource name
Updated resource summary
Move resource to different datasource
Response
Returns the updated resource object.Delete Resource
Delete a resource and all associated data.Path Parameters
The unique identifier of the datasource
The unique identifier of the resource to delete
Response
Returns a 204 status code on successful deletion.Retry Resource Processing
Retry processing for a failed resource or reprocess with updated settings.Path Parameters
The unique identifier of the datasource
The unique identifier of the resource
Request Body
Array of resource statuses to retry (e.g., [“FAILED”, “IN_PROGRESS”])
Only retry resources created/updated after this date
Only retry resources created/updated before this date
Response
Returns a success confirmation.Download Resource
Get a download URL for the processed resource content.Path Parameters
The unique identifier of the datasource
The unique identifier of the resource
Response
Temporary signed URL for downloading the resource content
Get Scraping Status
Get the scraping status for web-based resources (WEBPAGE, URL types).Path Parameters
The unique identifier of the resource
Response
Resource unique identifier
Total number of links found during scraping
Number of links successfully processed
Number of links currently being processed
Number of links that failed to process
Resource Processing Pipeline
Understanding how resources are processed helps you monitor and troubleshoot issues:1
Upload/Submit
Resource is created with initial metadata and content reference
2
Content Extraction
System extracts text/data from the resource based on its type
3
Processing
Content is chunked, cleaned, and prepared for vectorization
4
Vectorization
Text chunks are converted to vector embeddings for semantic search
5
Indexing
Vectors are stored and indexed for fast retrieval
6
Completion
Resource status is updated to DONE and becomes available to agents
Resource Status Meanings
IN_PROGRESS
IN_PROGRESS
Initial processing stage - content extraction and preparation
SCRAPING
SCRAPING
For web resources - actively scraping content from URLs
SUMMARIZING
SUMMARIZING
Generating automatic summaries of the content
VECTORIZING
VECTORIZING
Converting text content to vector embeddings
DONE
DONE
Processing complete - resource is ready for agent use
FAILED
FAILED
Processing encountered an error - check logs and retry if needed
Content Type Support
- Documents
- Web Content
- Media
- PDF: Full text extraction with metadata
- Text/Markdown: Direct processing with formatting preservation
- HTML: Clean text extraction with structure preservation
- CSV: Structured data processing with schema inference
Processing times vary based on resource type and size. Web scraping can take longer due to external dependencies and rate limiting.