Root Signals

Root Signals is a startup specializing in GenAI measurement using LLM-as-a-judge techniques. The company offers a cloud platform that helps developers find large language models (LLMs) with high output quality and ensures these models maintain their reliability over time. Root Signals' platform includes a dashboard where developers can compare the accuracy of different LLMs for their projects by entering sample prompts as benchmark tests. The system automatically identifies the LLM that provides the most accurate answers and displays related metrics like inference costs.

After selecting an LLM, developers can use over 50 "evaluators" provided by Root Signals to monitor the model's reliability in production. These evaluators are software workflows that detect hallucinations by tracking answer accuracy and relevance metrics. Users can also create custom evaluators tailored to their specific requirements. Root Signals' approach, called “EvalOps,” aims to make GenAI applications quantifiable, reliable, auditable, and reusable.