Skip to main content
A Workflow replaces the manual work of copying one agent’s output into the next prompt: define each step once, and the engine runs the full chain for you. This includes steps that wait on external services β€” like a web scrape or an API webhook β€” without you having to poll for completion.

Core Concept

A workflow is essentially a directed acyclic graph (DAG) where:
  • Nodes represent discrete work units (agent calls, API requests, data processing)
  • Edges represent dependencies between nodes
  • Variables flow between nodes via Jinja2 interpolation
  • Execution follows a tick-based scheduling model driven by Pub/Sub

Why Use Workflows?

Automate Complex Processes

Chain multi-step operations without manual intervention

Coordinate Multiple Agents

Have different AI agents work together on the same task

Handle Async Operations

Wait for long-running tasks (web scraping, external APIs)

Reuse & Compose

Build subworkflows and compose them into larger systems

Real-time Monitoring

Track execution progress step-by-step with detailed logs

Data Transformation

Process and enrich data through multiple stages

Workflow vs Single Agent

Single Agent Chat

  • Direct response
  • Real-time only
  • No state persistence between calls
  • Linear reasoning

Workflow

  • Multi-step orchestration
  • Handles async operations
  • Persistent state across steps
  • Parallel and sequential execution
  • Detailed monitoring per step

Key Components

1. Nodes

Individual units of work:
  • Agent Nodes: Call your agents with specific inputs
  • Data Nodes: Process or transform data
  • Integration Nodes: Call external APIs or scrape websites
  • Container Nodes: Group other nodes (sequential, parallel, loops)

2. Dependencies

Define execution order:

3. Variables

Share data between steps:

4. Input Schema

Define what your workflow accepts:

Workflow Lifecycle

1. Creation

Define your workflow with nodes, dependencies, and parameters

2. Execution

Trigger the workflow with input data

3. Tracking

Monitor progress in real-time
Returns current status, progress, and outputs for each step

4. Completion

Workflow either:
  • Succeeds: All nodes completed, output available
  • Fails: A node failed, workflow halted

Common Use Cases

Case 1: Market Research

Case 2: Customer Support

Case 3: Content Creation

Case 4: Data Pipeline


Workflow Structure


Execution Model at a Glance

Workflows use tick-based scheduling:
  1. Workflow is triggered via API
  2. System publishes execution start message to Pub/Sub
  3. Workflow engine processes one β€œtick” (up to 5 nodes)
  4. Completed nodes trigger dependent nodes
  5. Process repeats until all nodes complete or a node fails
  6. Real-time monitoring shows progress at each step
This model enables:
  • Asynchronous execution - Long operations don’t block
  • Scalability - Multiple workflows execute concurrently
  • Observability - Each step is logged and tracked
  • Resilience - Failures are isolated to affected branches

Next Steps