feat(mcp): add MCP library to globally manage MCP servers and their respective tools #209

ashleymavericks · 2026-01-15T21:13:39Z

Summary

This PR adds a comprehensive MCP (Model Context Protocol) Library that allows users to globally manage MCP servers and expose their tools to AI agents. The implementation includes:

Core Features

MCP Library / Custom MCPs Component

Worker component (mcp.custom) that fetches enabled MCP servers from the backend and registers their tools with the Tool Registry
Frontend UI for browsing, configuring, and managing custom MCP servers
Support for multiple transport types: HTTP, stdio, SSE, and WebSocket
Encrypted header storage for HTTP-based MCP servers with secret references
Docker-based stdio server spawning with dynamic port allocation

MCP Groups (Curated Server Collections)

AWS MCP Group - Pre-configured collection of AWS-related MCP servers (CloudTrail, CloudWatch, IAM, S3, Lambda, DynamoDB, etc.)
Dynamic server discovery from group templates
Group-specific Docker images for efficient containerization
Credential mapping and environment variable injection
UI for importing and managing group templates

Secret References

Users can now select secrets for MCP server headers and arguments
Secret reference format: {{secret:SECRET_ID}}
Backend resolution of secret references at runtime
Frontend secret picker for easy selection

Tool Registry Integration

All MCP tools are automatically registered and available to AI agents
Tool metadata includes server name, description, and input schema
Health check functionality for monitoring server status

UI/UX Improvements

Navigation

Renamed "MCP Library" to "MCP Servers" in navigation
Added collapsible "Settings" section to sidebar
Group import functionality with auto-discovery

Component Updates

Workflow nodes now display associated MCP servers
MCP Library ToolSelector component for ConfigPanel
Compact group cards with removal functionality

Technical Implementation

Backend

Endpoints: /api/v1/mcp-servers (CRUD), /enabled (filtered list), /:id/resolve (secret resolution)
Secrets integration: SecretResolver service for resolving {{secret:...}} references
Encrypted storage: Headers and sensitive data encrypted at rest
Health checks: Background health monitoring with status tracking

Worker

Component ID: mcp.custom (formerly core.mcp.library)
Docker runtime: Automatic container spawning for stdio servers
Tool registration: Internal API integration for tool discovery
Retry policies: Configurable retry logic for failed connections

Frontend

Pages: MCP Library page with server list, add/edit forms, health status
Components: Secret picker, header editor, server cards, group importer
Store: MCP server state management with React Query

Breaking Changes / Refactoring

Renamed component from core.mcp.library to mcp.custom
Removed legacy MCP HTTP provider component
Removed MCP tool merge component (functionality consolidated into MCP Library)
MCP Group servers filtered out from Custom MCPs component to avoid duplication

Testing

✅ bun test - 228 tests pass (0 failures)
✅ bun lint - All linting checks pass
✅ bun typecheck - No TypeScript errors
✅ MCP Library integration tests with mocked Docker runtime
✅ Secret resolution tests (19 tests covering all scenarios)

Documentation

Added MCP Library component design documentation
Updated AGENTS.md with MCP integration details
Contract definitions for mcp.tool and credential contracts

chatgpt-codex-connector · 2026-01-15T21:13:43Z

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

…onality Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

…orm handling Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

- Introduced 'enabled' field in the MCP server tools schema to manage tool states. - Implemented toggle functionality for enabling/disabling tools via a new API endpoint. - Updated service and repository layers to handle tool state changes. - Enhanced frontend to display tool counts and allow toggling of tool states directly from the UI. Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

…us display Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

…UX implementation Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

- bun.lock: accept both sides and regenerate - worker/tsconfig.tsbuildinfo: delete file - worker/package.json: accept both dependencies (@modelcontextprotocol/sdk from HEAD, @ai-sdk/mcp from main) - openapi.json: accept both sides (merge endpoints) Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Reset ai-agent.ts to main version (MCP Library integration to be redone via Tool Registry) - Fixed AppLayout.tsx import (Sidebar -> sidebar-state) - Fixed ConfigPanel.tsx (added useReactFlow import, removed unused Edge type) - Fixed useMcpHealthPolling.ts (exported types from store, added proper return type) - All typecheck errors resolved The MCP Library feature will be integrated following the new architecture: - MCP Library servers registered in Tool Registry during workflow execution - Agent discovers all tools via MCP Gateway (no agent-side logic needed) Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Clean design for MCP Library as a tool provider component: - Uses same 'tools' port pattern as tool-mode nodes - Agent connects to MCP Library → tools port → MCP Gateway - No agent-side changes needed - AWS services moved to library pattern Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Phase 2: Implement core.mcp.library component Component features: - Multi-select servers from MCP Library backend API - Spawns Docker containers for stdio MCP servers - Registers tools in Tool Registry for agent discovery - Uses 'tools' output port (contract: mcp.tool) compatible with AI Agent Files: - worker/src/components/core/mcp-library.ts - worker/src/components/core/mcp-library-utils.ts Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Phase 3: Frontend UI Integration Components added: - McpLibraryConfig.tsx: Multi-select server selector with health status - ParameterField.tsx: Updated to support custom editor for core.mcp.library Features: - Server selection with checkboxes - Health status indicators - Tool count display per server - Integration with existing mcpServerStore - Selection summary with total tools Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Add MCP Library component import to worker/src/components/index.ts - Fix ConfigPanel to show parameters for tool mode components - Add allowAny meta flag with reason to tools output port - Parameters now show for MCP servers and other tool mode components Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

These components are now superseded by the MCP Library component which provides a more flexible and comprehensive way to manage MCP servers. Removed files: - worker/src/components/ai/mcp-http-provider.ts - worker/src/components/ai/mcp-tool-merge.ts Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Create McpServersDisplay component in separate file for clean architecture - Show selected MCP servers in workflow node preview when using MCP Library - Compact display showing server count with preview badges - Uses MCP server store to fetch server names and health status - Only displays when servers are selected to avoid clutter Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

This reverts commit e848570. Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Add McpGroupConfig component for dynamic group server configuration - Add McpGroupServersDisplay component showing server chips in workflow nodes - Update ParameterField to use McpGroupConfig for MCP group parameters - Update WorkflowNode to display selected MCP servers as chips above separator - Update aws-mcp-group component with all 10 AWS MCP servers - Remove deprecated aws-cloudtrail-mcp and aws-cloudwatch-mcp components - Each server chip shows health status, name, and tool count Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Change output from 'endpoints' to 'tools' - Use connectionType: { kind: 'contract', name: 'mcp.tool' } - Return empty object (tools are registered, not returned as data) - This allows AWS MCP Group to connect to AI agents like ai-agent and opencode Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Remove unused HelpCircle import from McpGroupConfig - Remove unused force parameter from fetchServers - Fix logoUrl null to undefined conversion in McpLibraryPage Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Group Secrets, API Keys, and MCP Library under a collapsible Settings section - Reduce sidebar navigation clutter by consolidating configuration items - Add smooth expand/collapse animation with chevron indicator - Settings items show with smaller icons when expanded Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Change display name from "MCP Library" to "MCP Servers" in Settings section - This better reflects what the page contains Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Change collapsible section name from "Settings" to "Manage" - This better reflects the action-oriented nature of the items Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Rename workflow component from "MCP Library" to "Custom MCPs" - Distinguishes from bundled MCP Group components (like AWS MCPs) - Page title remains "MCP Servers" for clarity - Update all comments and UI text accordingly Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Update component label to "Custom MCPs" - Update docs and UI descriptions - Distinguishes from bundled MCP Group components Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Filter out servers with groupId set (these are from bundled groups like AWS MCPs) - Custom MCPs now only shows individual/custom MCP servers - Group servers are only accessible via their respective group components Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Remove core.mcp.server component (legacy individual MCP server component) - Custom MCPs now handles individual servers from the library - MCP Group components handle bundled server groups (AWS, etc.) - Simplifies component architecture Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Add secret picker UI for MCP server headers and args configuration - Implement SecretResolver service for runtime secret resolution - Add support for {{secret:SECRET_ID}} references in headers and args - Add getResolvedConfig endpoint for worker to fetch resolved configuration - Update worker to use resolved configs when connecting to MCP servers - Add SecretResolver test suite with 19 passing tests - Fix all TypeScript errors across backend, frontend, and worker - Fix ESLint issues (escaped quotes, unused variables) Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Mock startMcpDockerServer to avoid actual Docker container spawning - Add missing createdAt/updatedAt fields to mock server objects - Save and restore original fetch to avoid interfering with other tests - Reduce test file from 592 to 187 lines while maintaining coverage All 228 tests now pass (0 failures). Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Remove IMPLEMENTATION_PLAN.md (will find better place for this) - Remove MCP_LIBRARY_DESIGN_REVIEW.md (will find better place for this) - Remove MCP_ARCHITECTURE_MERGE_PLAN.md (will find better place for this) - Remove MCP_LIBRARY_COMPONENT_DESIGN.md (will find better place for this) These files should be documented elsewhere rather than in the main repo. Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Since we moved to the gateway proxy approach where all MCP servers run in Docker containers and are accessed via the MCP Gateway, we no longer need direct MCP SDK client code in the worker. Removed files: - worker/src/temporal/activities/mcp-library.activity.ts (233 lines) - worker/src/services/mcp-client.service.ts (333 lines) - worker/src/services/index.ts (2 lines) The new architecture: 1. MCP servers are configured in the backend 2. Servers run in Docker containers via stdio proxy 3. Worker component (mcp.custom) fetches enabled servers and registers tools 4. AI Agent talks to MCP Gateway, not directly to servers All 522 tests still pass. Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Convert mcp-servers and mcp-groups DTOs from manual decorators to Zod schemas - Add static create() methods for database record mapping - Provide both const exports and type aliases for backward compatibility - Fix MCP Library integration tests by mocking mcp-library-utils to avoid Docker calls Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Regenerated openapi.json with updated MCP DTOs using nestjs-zod - All DTOs now properly reflected in OpenAPI specification Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

- Regenerate backend-client.ts from updated OpenAPI spec - Add .prettierignore and .eslintignore to exclude auto-generated files - All 522 tests passing with refactored DTOs Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

ashleymavericks requested a review from betterclever January 15, 2026 21:19

ashleymavericks added 7 commits January 16, 2026 09:47

feat(mcp): integrate MCP Library functionality

0361250

Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

feat(config-panel): add McpLibraryToolSelector component to ConfigPanel

fa767e6

Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

feat(mcp): implement server connection testing and JSON import functi…

45d652e

…onality Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

refactor(mcp-library): update JSON import functionality and improve f…

56c81bd

…orm handling Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

feat(mcp-library): enhance health check functionality and server stat…

72a96a7

…us display Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

feat(mcp): add MCP server management endpoints and encrypted headers …

b74de62

…UX implementation Signed-off-by: Anurag Singh <singhanurag024@gmail.com>

ashleymavericks force-pushed the mcp-library branch from acdd919 to b74de62 Compare January 16, 2026 04:17

betterclever mentioned this pull request Jan 22, 2026

feat(temporal): implement tool mode orchestration and MCP server support #214

Closed

betterclever and others added 19 commits February 2, 2026 15:12

Update bun.lock after merge

a637ea5

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

feat: reimagine MCP library page

e848570

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

Revert "feat: reimagine MCP library page"

3ccf5c9

This reverts commit e848570. Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

fix: MCP group UI and tool discovery

80cd7a6

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

fix: include mcp server group ids

c781f81

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

feat: import group templates with auto discovery

2f1d2ea

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

feat: compact group cards and add group removal

99bdc6e

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

fix: use logo dev for group icons and register aws group

dece3a1

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

feat: merge group import into groups header

8db6fa3

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

feat: add import menu info and imported states

aa95982

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

chore: rename groups header

ede5206

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

betterclever and others added 9 commits February 3, 2026 17:54

fix: delete group servers on group removal

5794925

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

refactor: rename MCP Library to MCP Servers in navigation

cebb87c

- Change display name from "MCP Library" to "MCP Servers" in Settings section - This better reflects what the page contains Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

refactor: rename Settings section to Manage in sidebar

b1664d9

- Change collapsible section name from "Settings" to "Manage" - This better reflects the action-oriented nature of the items Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

betterclever force-pushed the mcp-library branch from a14d959 to 48fe39a Compare February 3, 2026 13:40

betterclever and others added 11 commits February 3, 2026 19:25

chore: regenerate OpenAPI spec after DTO refactoring

c93a498

- Regenerated openapi.json with updated MCP DTOs using nestjs-zod - All DTOs now properly reflected in OpenAPI specification Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

fix typecheck

78de3de

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

remove the unneeded docs

be08ee1

Signed-off-by: betterclever <paliwal.pranjal83@gmail.com>

betterclever force-pushed the mcp-library branch from 48fe39a to be08ee1 Compare February 3, 2026 13:56

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(mcp): add MCP library to globally manage MCP servers and their respective tools #209

feat(mcp): add MCP library to globally manage MCP servers and their respective tools #209

ashleymavericks commented Jan 15, 2026 •

edited by betterclever

Loading

Uh oh!

chatgpt-codex-connector bot commented Jan 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

feat(mcp): add MCP library to globally manage MCP servers and their respective tools #209

Are you sure you want to change the base?

feat(mcp): add MCP library to globally manage MCP servers and their respective tools #209

Conversation

ashleymavericks commented Jan 15, 2026 • edited by betterclever Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Core Features

MCP Library / Custom MCPs Component

MCP Groups (Curated Server Collections)

Secret References

Tool Registry Integration

UI/UX Improvements

Navigation

Component Updates

Technical Implementation

Backend

Worker

Frontend

Breaking Changes / Refactoring

Testing

Documentation

Uh oh!

chatgpt-codex-connector bot commented Jan 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ashleymavericks commented Jan 15, 2026 •

edited by betterclever

Loading