×
Home About Playground Resume

Agent Builder

Teams spent their days answering routine questions instead of solving real problems. I designed Agent Builder, a no-code builder that lets support teams create, configure, and deploy AI agents without writing a single line of code.

Agent Builder — hands holding a laptop displaying the full Agent Builder interface
Role
Product Designer 2
Company
DevRev
Platform
Web (SaaS)
Focus
AI Agent Configuration, No-Code Tooling
Status
Shipped
01

Context

DevRev is a OneCRM platform that unifies product, customer, and work data. It serves teams across the entire organisation: Product, Support, Admin, Engineering, Sales, and Growth, all operating within a single connected system.

Each persona has its own responsibilities, workflows, and tools. Product Managers focus on scoping, analysis, and roadmapping. Support teams handle ticketing, troubleshooting, and prioritization. Account Managers drive engagement, reporting, and expansion.

While their goals differ, all of them rely on a shared foundation of connected data and integrated tooling. The vision was clear: enable agents for everyone, in the system, in a connected network.

Product
Product manager
Ships the roadmap.
Goals
  • Roadmapping
  • Scoping
  • Forecasting
  • Analysis
  • Monitoring
Tools
Jira Datadog GitHub
Support
Support manager
Keeps customers moving.
Goals
  • Ticketing
  • Troubleshooting
  • Routing
  • Data entry
  • Prioritization
Tools
Freshdesk Zendesk ServiceNow
Account
Account manager
Grows the relationship.
Goals
  • Advocacy
  • Upselling
  • Optimization
  • Reporting
  • Engagement
Tools
ServiceNow Salesforce
02

Problem

Teams were spending their days answering routine questions instead of handling core issues. The existing workflow system could automate simple tasks, but without cognition it couldn't understand intent, adapt to context, or learn from interactions.

When AI agents arrived, they solved the cognition gap, but introduced a new problem: there was no surface for non-technical teams to build, configure, or manage them. Every change required engineering involvement. Every adjustment meant filing a ticket and waiting.

We needed to give agent-building superpowers to the people who understood customer problems best, without requiring them to write code or understand the underlying AI infrastructure.

03

Anatomy of an Agent

Diagram showing agent building blocks: Knowledge, Instructions, and Skills, flowing from Trigger to Output

Before designing the builder, I needed to deeply understand the system I was designing for. Working with the engineering team, I mapped the internal architecture of how agents work within DevRev's AgentOS, the platform layer powered by AirSync that supports workflows, search, analytics, and autonomous agent capabilities.

Every agent is composed of four core building blocks, each of which needs to be configurable:

Knowledge
What the agent knows. DevRev objects, uploaded documents and media, and external sources connected through AirSync integrations.
Instructions
How the agent behaves. Runtime instructions that guide the agent's goals, tone, escalation logic, and decision-making framework.
Skills
What the agent can do. Individual actions, workflow automations, and external integrations that give the agent its functional capabilities.
Triggers & Surfaces
Where the agent operates. PLuG widget, Support Portal, Slack, and email, plus the routing logic that connects users to the right agent.
04

AirSync: backbone of knowledge and skill

Your data lives across ten different tools (Salesforce, Jira, Zendesk, Slack) and it's always out of sync. AirSync is a two-way sync engine that solves this. It pulls everything into one place, and writes changes back. When an agent resolves a ticket or updates a record, that action reflects in the original tool automatically.

AirSync ships as a marketplace of apps. Once an integration is installed, it becomes the source of both Knowledge (what the agent reads and reasons over) and Skills (what the agent can act on). Users don't wire up data pipelines. They just install an app, and the agent becomes capable.

05

The Routing Layer

At the centre of the system sits an Omnipresent Agent: a routing layer that intercepts every user query, identifies intent, and figures out which specialised agents to invoke and in what order.

PLuG & Portal
Ext. surfaces like Slack
DevRev Objects, Search
SURFACES
Workflows
Omnipresent agent
Surface configurations
ROUTING
Scope of my project
Sales
RCA
Support
AGENTS
06

Phased Scope

Phase 1
Agent Builder
  • Drafts & publish
  • Instruction editor
  • Knowledge management
  • Skill configuration
Phase 2
Advanced features
  • Co-pilot for agent building
  • Analytics
  • Conversational skill builder
Phase 3
Observability & Simulation
  • Agent performance tracking
  • Session-level inspection
  • Simulation testing
07

Solution

I. Layout Exploration

My first instinct was the familiar pattern: a block library on the left, configuration in the middle, preview on the right. Users drag what they need, drop it in, fill it out. Clean on paper. But the moment I put it in front of people, it felt like a tool from the 2000s. The cognitive load of scanning a library, deciding which block applies, figuring out where it goes, it was all friction that had nothing to do with building a good agent.

Block library
About
Tone & Behaviour
Instructions
Knowledge
Skills
Preview

I scrapped it. Instead of a library you browse, I wanted a surface that builds itself around you. The copilot would be the entry point. You talk to it, describe what you want the agent to do, and it assembles the blocks. No library to scan, no decision about which block fits where. The structure appears as you define intent. The bento layout that emerged from this let users see Instructions, Knowledge, Skills, Tone & Behaviour, and Workflows simultaneously, with the copilot always at hand.

Instructions
Knowledge
Skills
Workflows
Tone & Behaviour
Copilot + Test

II. Concept

Three concept directions: Omni present Copilot, Inline nudges, and Summary view approach
  • Omni present Copilot: An always-on AI assistant occupying the full builder surface, guiding users through configuration conversationally. The copilot owns the structure; users confirm rather than decide.
  • Inline nudges: Contextual AI suggestions appear directly alongside each configuration block, prompting users to fill gaps or resolve conflicts as they go.
  • Summary view approach: Users first see a high-level overview of the agent being built, with the copilot surfacing as a contextual panel they can pull in when needed.

III. Legends

Agent Builder is a single-page builder. Everything you need to configure an agent lives on one surface, with no switching between tabs or hunting through menus. Here's what each piece does:

IV. Entry Point & Default State

Entry Point. Agent Builder lives in Settings under Agents & Automations, a new section that consolidates Agents, Skills, Workflows, and Templates previously scattered across the platform. Since agent building is an admin responsibility, anchoring it in Settings keeps it intentional and separated from day-to-day work.

Entry point — Agents & Automations in Settings

Empty State. The first time a user arrives, they're greeted with a clear statement of intent, "Build. Test. Deploy. Observe.", and a single + Create agent button. Below that, four ready-made templates surface the most common use cases out of the box: Oncall Agent, Customer Support Agent, HR Agent, and Product Management Agent. Each maps to a mainstream business function and can be deployed immediately or customised. No blank-canvas anxiety.

Empty state — Build. Test. Deploy. Observe.

Agent List. Once agents exist, templates move to a secondary Browse templates action and the list takes centre stage. Agents are filterable by All, Published, and Drafts. Each card shows the agent name, a short description, and, depending on state, either the owner avatar with a "Draft" label, or run count and average run time for published agents. If something is misconfigured, an error indicator surfaces directly on the card.

Agent list with published and draft states

V. Agent Initiation using Copilot

Building an agent shouldn't feel like setting up a system. It should feel like explaining a task to a colleague.

Today, getting started is harder than it needs to be. Writing good instructions and prompts takes effort, and not everyone knows how to do it well. Even experienced users often end up using ChatGPT or Claude to draft things first, then bring them back. That's a clear sign the workflow is broken.

There's also too much overhead. Users have to go through different knowledge sources and skills, figure out what's relevant, and connect everything correctly. Most of this work isn't about building a better agent; it's just setup.

Copilot changes that. You start by describing what you want to achieve, and it takes care of the rest. It pulls in the right knowledge, suggests the right skills, drafts the instructions, and asks follow-up questions where needed.

The focus stays on the goal, not the process.

View the prototype Opens in Figma

VI. Adding Instructions

The instructions editor is where the agent's behaviour is defined in natural language. The key innovation is inline referencing using #. Users can type # to reference knowledge sources, skills, or channels directly within their instructions, creating a connected configuration graph.

For example, an instruction might read: "Offer customers real-time visibility into their orders through the #Order Tracking API. Operate on #PLuG and #Slack channels. When encountering complex issues, create a ticket using #Ticket Creation." References are auto-suggested as users type, ensuring accuracy.

Instructions collapsed state Instructions expanded state Instructions with inline referencing
Instructions

type #, ↑↓ navigate, enter to select

VII. Adding Knowledge

Knowledge is what an agent reads, reasons over, and retrieves when forming a response. Without it, even a perfectly configured agent is guessing. With the right knowledge attached, an agent can answer a customer asking "Where is my order?" by pulling from live ticket data, or help an onboarding manager by referencing the exact internal HR policy document, not a generic LLM hallucination.

Knowledge sources are additive. An agent can draw from many at once, and each source shows its type, item count, sync status, and last updater so admins always know what the agent is working with.

Knowledge section empty state Knowledge section with sources added Adding a new knowledge source

There are primarily four ways to add static knowledge to an agent:

1. Upload a file. The most direct path. Admins can drag and drop PDFs, Word docs, CSVs, or text files directly into the knowledge panel. Works well for internal documents that don't live anywhere else, like an onboarding handbook, a product spec, or a pricing sheet. The file is chunked and indexed on upload, and the agent can start using it immediately.

Add knowledge — upload a file

2. Public website. A URL-based scrape that pulls content from any publicly accessible webpage or sitemap. Useful for product documentation sites, help centres, or marketing pages. A support agent pointed at docs.yourproduct.com always references the latest published documentation, with no manual copy-pasting required.

Add knowledge — public website

3. DevRev objects. Because Agent Builder lives inside DevRev, agents can natively pull from the entire object graph: tickets, articles, accounts, opportunities, conversations, and more. A support agent backed by live ticket data can contextualise responses against similar past resolutions. This is knowledge that updates in real time, not a static snapshot.

Add knowledge — DevRev objects

4. Third-party integrations. Via AirSync, agents can connect to external tools like Google Drive, Notion, Confluence, or Zendesk as knowledge sources. Once authenticated, the integration continuously syncs relevant content, so the agent's knowledge stays current without any manual intervention.

Add knowledge — third-party integrations

I paid special attention to edge cases that could erode trust:

Reconnection nudge flow — a wide multi-step sequence showing: (1) a knowledge source row with a warning badge indicating an expired token; (2) a nudge banner prompting the admin to re-authenticate; (3) the re-auth modal with a 'Reconnect' CTA; and (4) the restored connected state with a green sync indicator
scroll
Permission boundaries in Agent Builder knowledge layer — a warning state when a team member's access level does not permit viewing a connected knowledge source, with a clear explanation and guidance on how to request access
Third-party integration authentication flow — a wide multi-step sequence showing: (1) the integration picker listing Zendesk, Google Drive, Notion and Confluence; (2) the OAuth permission prompt for a user without admin rights with a 'Request access' path; (3) the OAuth consent screen for an admin; and (4) the post-auth state with the integration connected and a folder/space selector
scroll

VIII. Adding Skills

Skills define the agent's functional scope: what it can actually do. They include default system actions, workflow integrations, and external API connections. Each skill has a type (Action or Workflow), status, and owner.

Skill list Add new skill

Adding a skill follows a two-step progressive flow:

DevRev — Choose type DevRev — Choose skill DevRev — Configure in depth
Third-party — Choose type Third-party — Choose skill
Custom skill

The skill marketplace surfaces all available capabilities in a browsable grid. DevRev native skills, external integrations like Salesforce, Confluence, Slack, and Zendesk, and custom skills are all accessible from one modal. Integrations that need authentication are clearly flagged, preventing failed configurations.

Skills fail in ways that aren't obvious at configuration time. Tokens expire, endpoints change, permissions get revoked. I designed an error surface that makes these failures visible and actionable, without requiring the admin to go hunting:

Card-level error signal Inline bento card listing failing skills List view of failing skills In-depth view of a single skill error with the exact field highlighted

Skill errors aren't rare edge cases. They're part of the normal operational lifecycle of a live agent. Surfacing them at the overview level, with a direct path to resolution, keeps agents healthy without requiring engineering involvement every time a token lapses or an integration breaks.

IX. Publish & Versioning

Agent configuration follows a single, linear timeline: no branching, no ambiguity. The versioning model has exactly three states:

The Version History panel shows each version with its publish date, author, and status, giving teams full auditability over their agent's evolution.

Draft state Publish Live History Expanded history Archived
09

Impact

Agent Builder shipped across DevRev's enterprise customer base and is now core infrastructure for teams running AI agents in production.

$7.3M
in deal value unlocked, including Paytm, Bolt, and Velocity Global
28
organisations actively building with Agent Builder
500+
agents powered by the platform
10

Reflection

This project shaped how I think about designing tools for AI configuration, a space that is evolving rapidly and where design patterns are still being established.

If I were to revisit this, I'd invest more deeply in the simulation layer: letting teams test their agents against historical conversations before going live, reducing the gap between configuration confidence and real-world performance.

see also
Quick Work Creation
DevRev Quick Work Creation
Smart Knowledge Base
DevRev Smart Knowledge Base
The Homework
Teachmint The Homework
Petmate
Personal Project Petmate