Lampline
Once a voice agent is imported or built, Lampline connects it to a phone line, sends an AI caller to grade real calls, and keeps it all on your own server. Start by importing a Dialogflow CX or CX Agent Studio export along with a report of anything to check, or build fresh in a drag-and-drop builder that mixes LLM steps with scripted pages for exact lines and form fields. Next, pick one of 20 model providers, including Claude, OpenAI, Gemini, Bedrock, Groq, and DeepSeek, or run Ollama with local speech and no API keys. Test by chat or microphone while each step lights up, and let agents call HTTP and MCP tools and save records in collections of their own. Then connect callers through Twilio, Telnyx, or any SIP trunk, PBX, or session border controller via jambonz, with transfers to a person that carry the call's details as SIP headers. Finally, evals phone the agent over a real line, where an AI Test Caller brings background noise, accents, and interruptions, grades each transcript check by check, and reports typical and p95 response times as callers hear them. Each agent stays a folder of YAML and Markdown that you can review in git and lint or test with the vk CLI. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
LangWatch
Every call your AI agents make becomes a searchable trace in LangWatch, and the same platform tests and scores those agents before a new prompt or model reaches users. The Trace Explorer filters by origin, user, model, cost, and evaluator, reads each run as a waterfall, flame graph, topology, or sequence diagram, and takes traces from the Python, TypeScript, and Go SDKs or any OpenTelemetry source. Agent Testing sends simulated users, in text or beta voice calls, through your agent while a judge passes or fails every criterion with its reasoning, adds multi-turn red teaming, and compares two agents side by side. The Experiments workbench scores prompts and agents on datasets with LLM judges, exact match, and RAG checks, then compares runs on cost, latency, and pass rate, while online evaluations monitor live traffic and guardrails block unsafe replies. Prompts keep version history and staging or production tags, Workflows wire prompts, Python code, and HTTP calls on a visual canvas, and annotation queues route traces to human reviewers. Alerts fire when a graph crosses a threshold, automations post to Slack, email, or webhooks, and scheduled reports go out by email or Slack. Claude Code, Codex, Copilot, Gemini CLI, and opencode report session cost, pull request cost, and terminal replays, and an MCP server exposes trace search and prompt management to coding assistants. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.