Getting started in 30 seconds
Scorable
Scorable is the automated LLM Evaluation Engineer agent for co-managing Root Signals platform with you.
From the App
To get started, sign up and login to Root Signals app. Select an evaluator under Evaluators tab and Execute. You will get a score between 0 and 1 and the justification for the score.
Programmatically
Create your Root Signals API key under Settings > Developer.
In Python
pip install root-signalsQuick test
Root Signals provides over 30 evaluators or judges, which you can use to score any text based on a wealth of metrics. You can attach evaluators to an existing application with just a few lines of code.
from root import RootSignals
# Just a quick test?
# You can get a temporary API key from https://app.rootsignals.ai/demo-user
client = RootSignals(api_key="my-developer-key")
client.evaluators.Politeness(
response="You can find the instructions from our Careers page."
)
# {score=0.7, justification='The response is st...', execution_log_id=...}In Typescript
npm install @root-signals/typescript-sdk
# or
yarn add @root-signals/typescript-sdk
# or
pnpm add @root-signals/typescript-sdkand execute:
import { RootSignals } from '@root-signals/typescript-sdk';
// Connect to Root Signals API
const client = new RootSignals({
apiKey: process.env.ROOTSIGNALS_API_KEY!
});
// Run any of our ready-made evaluators
const result = await client.evaluators.executeByName('Helpfulness', {
response: "You can find the instructions from our Careers page."
});Via REST API
You can execute evaluators in your favourite framework and tech stack via our REST API:
Root Signals MCP Server (for Agents)
Our Model Context Protocol (MCP) equips your AI agents with evaluation capabilities.
Last updated