OverseeX

About the Project

OverseeX is an AI agent testing and monitoring SaaS platform built as a TypeScript monorepo with three Next.js portals, a public marketing site, a developer docs hub, and an admin dashboard, backed by a FastAPI Python backend with PostgreSQL, MongoDB, and Redis, all Dockerised on Hostinger VPS with Nginx. The platform ships first-party SDKs to both the npm registry (`@overseex/sdk` for JavaScript/TypeScript) and PyPI (`overseex` for Python), with integrations for LangChain, LangGraph, CrewAI, AutoGen, and all major LLM providers. DodoPayments powers usage-based subscription billing across Free, Starter ($19), Pro ($79), Team ($349), and Enterprise tiers. With 2,000+ developers on platform, OverseeX auto-generates test suites from real agent interactions, provides intelligent API mocking for Stripe/OpenAI/SendGrid, and delivers 24/7 health monitoring with webhook and Slack alerts.

How It Works

1. 1

   The three-portal monorepo (web, docs, admin) runs on Hostinger VPS, Docker Compose orchestrates Next.js containers, the FastAPI inference and API service, Celery workers for async trace processing, Redis as the task broker and cache, PostgreSQL for relational subscription and user data, and MongoDB for flexible agent trace and telemetry storage, all behind an Nginx reverse proxy.

2. 2

   Developers instrument their AI agents by installing the `@overseex/sdk` npm package or the `overseex` PyPI package with a single `npm install overseex` / `pip install overseex` command; the SDK intercepts LLM calls, tool invocations, and agent handoffs, streaming structured trace events to the FastAPI ingest endpoint via webhook.

3. 3

   The auto-test generation engine watches recorded agent interactions stored in MongoDB, runs a coverage analysis across all possible execution paths (243+ in a typical agent), and generates a comprehensive Playwright + Jest test suite, reducing test creation from 10 hours to 10 minutes, served for download through the admin dashboard.

4. 4

   The intelligent mock layer intercepts outbound calls to expensive APIs (OpenAI, Stripe, SendGrid) and returns statistically realistic, context-aware responses from a pre-built response corpus, eliminating API costs during CI test runs and saving teams $10k+ monthly.

5. 5

   DodoPayments handles all subscription billing with server-side webhook handlers that update entitlement state in PostgreSQL in real time; API key management and webhook configuration (agent health alerts, anomaly notifications, regression detections) are managed through the Shadcn UI admin dashboard with full audit logging.

Tech Stack