A snow-capped mountain under a field of stars, a trail of lamps climbing its flank to a glowing summit.

Benchmark

Caesar® against industry harnesses, industry-tuned general AI, generic LLMs and industry AI tools. Same tasks, same grading, every industry.

The comparison

Five ways to put AI to work. One benchmark.

Every institution picks one of these routes, often without comparing them. We run the same tasks through all five, in each industry, and score them the same way.

01 · HAQQ

Caesar®

A sovereign engine. It prepares the task on your infrastructure, routes it to the models you permit and checks the answer.

You decide what reaches a frontier model.
02

Industry harnesses

Agent frameworks built around frontier models for one domain: prompts, tools and retrieval wired together.

Limited to the models their vendor offers.
03

Industry-tuned general AI

A general model fine-tuned or packaged for a sector by its lab or a reseller.

Strong at the sector, generic in the rest.
04

Generic LLMs

The newest frontier and open-weight models, used directly through chat or API.

Prompts go to the provider unless you host open weights yourself.
05

Industry AI tools

Point products for one workflow in one sector, such as research, review or claims.

Built for one workflow; the rest needs other tools.

Quality per dollar × reliability

Reliable Quality per Dollar For Every Task, no matter the Industry.

Each dot is one of the newest models, scored on a public benchmark. Further right means fewer wrong answers when a model is unsure. Higher up means more quality for each dollar, ranked among the systems shown.

  • Caesar®
  • Anthropic
  • OpenAI
  • Google
  • xAI
  • Open-weight

Higher up ranks each system’s quality per dollar among those shown: 100 is the best, 0 the lowest. Dashed lines mark the median of the models.

See the numbers
ModelQualityCost per taskQuality per $Quality per $ indexReliability proxy
Caesar®

How to read it

Quality per dollar is the quality score divided by the cost per task, counting every billable token: input, output and reasoning. At the same quality, a run that costs 10% less scores 11% higher. The chart ranks it as a percentile among the systems shown: 100 is the best, 0 the lowest, ties share a rank. The table keeps the index, where 100% is Caesar®. Compare dots within a view, not across views. Models without a published hallucination rate are in the table only.

Reliability is 100 minus the hallucination rate. Artificial Analysis counts wrong answers out of all the answers that are not correct, so a model that declines to answer scores well. It is a general proxy, not a measure of reliability in the industry you picked.

Caesar® sets the 100% mark of the quality-per-dollar index. Its reliability proxy is 88.75%. The dashed lines mark the median of the models, Caesar® left out, and split the chart into four quadrants.

Sources: Vals.ai task benchmarks (updated 7 and 8 Oct 2026) for quality and cost per task; Artificial Analysis Intelligence Index and hallucination analyses (June to September 2026) for the general reference and reliability. Gemini 4 Argon’s general-reference cost reflects a 50% launch discount; Vals.ai uses its standard price. Three hallucination rates are not from a current, matched test: Claude Fable 5.1 (launch analysis, older suite), Claude Sonnet 5.5 (pre-release deployment) and MiniMax-M3 (Artificial Analysis, June 2026).

By design

What each route gives you before the first score.

A benchmark measures answers. These are the properties that decide whether you can use those answers at all.

PropertyCaesar®Industry harnessesIndustry-tuned general AIGeneric LLMsIndustry AI tools
You decide what reaches a frontier model.YesDependsDependsOpen-weight onlyDepends
Choose and switch modelsYesPartlyNoOne at a timeNo
Works across industriesYesOne domainOne sectorYesOne workflow
Every claim citedYesPartlyPartlyNoPartly
Audit record of every callYesPartlyNoNoPartly
Uses your own records and proceduresYesYesPartlyNoPartly
On-premise deploymentYesDependsDependsOpen-weight onlyRarely

Typical properties of each route as offered today. Individual products vary.

Caesar® evaluation method

How every industry run works.

The same protocol in every sector, so a score in finance means what a score in law means.

Real tasks

Each industry gets a task suite written with practitioners: research, document comparison, drafting and review.

Same inputs for all five

Every route receives the same documents and instructions. Each runs as its vendor recommends.

Blind grading

Rubrics plus expert reviewers who do not know which route produced the answer. Every cited source is checked.

Losses published

We publish every result, including the benchmarks Caesar® does not lead, with cost and time per task.

What we measure

Quality per dollar

We divide each answer’s quality by what it costs to produce.

Reliability

We measure how often an answer is wrong or cites something that does not support it.

Justinian® evidence, measured separately

Justinian® set the bar in law.

Caesar® is the generation after Justinian® and takes the engine beyond law. These results are Justinian®’s own, not Caesar®’s. In law, Justinian® scores above all ten systems it was tested against, frontier models and CoCounsel included.

Measured83.2Overall score across the benchmark’s five domains. The best frontier model scored 79.5.
Measured23 / 25Benchmarks where Justinian® is the best or joint-best score.
Measured5 / 5Domains where Justinian® has the highest average: legal, tax, journalism, general, safety.
Measured10Systems compared: frontier models, open-weight models and a legal AI tool.

Source: the Justinian® benchmark, haqq.ai/justinian. Justinian® does not lead on Harvey LAB or Long Context, and we publish those results too.

Get answers on how we measure Caesar®.

How does HAQQ evaluate Caesar®?

Against every way to put AI to work: industry harnesses, industry-tuned general AI, generic LLMs and industry AI tools. The same protocol runs in every sector: real tasks written with practitioners, the same inputs for every route, blind grading, and every result published, including the ones Caesar® does not lead.

How is Caesar® related to Justinian®?

Justinian® is Generation 1, the legal generation: it powers HAQQ’s legal products. Caesar® is Generation 2: the same architectural foundation, extended beyond law to the records, procedures and work of other sovereign industries.

How is Caesar® different from the AI assistant that comes with our office software?

An assistant inside one vendor’s suite works with that vendor’s models and cloud. Caesar® is model-independent and sits in front of every model you approve: you decide where each request is processed, Caesar® anonymizes what must not leave, routes each task to the best approved model, cites its sources and records every call for audit. It works alongside the tools you already use.

Does using frontier models mean paying frontier prices on every call?

No. Caesar® prepares the task and retrieves the relevant material before asking a model to reason, and locally hosted services handle the agreed document and context work. Each task goes to the best model you approve, so frontier quality doesn’t mean a frontier price on every call.

How does Caesar® keep wrong answers to a minimum?

It retrieves the relevant material before a model reasons, compares answers across models before merging them, and cites every claim so a reviewer can check it against its source.

Does every answer cite its sources?

Yes. Every claim is cited, with references a reviewer can open to check the answer against the material.

Can we run a pilot or proof of concept before we buy?

Yes. A first deployment starts with one task, a representative set of records and a reviewer who knows the work, judged on agreed acceptance criteria: quality, time and cost.

Can we see Caesar® working before we commit?

Yes. Book a 30-minute call to see how a deployment would run for you. Then judge Caesar® on your own work: agree a task, a representative set of records and a reviewer who knows the work, and measure time and cost alongside quality.

Bring your requirements. Let’s work through them.

We’ll start with your data boundary, the workflow you want to deploy and the controls your team needs to evaluate.

Bring the problem. We’ll shape the use case with you.

You don’t need a defined AI use case to start. We work through it with your team, then the architecture, infrastructure, security review and deployment path your environment requires.

Discuss your AI deployment

Prefer email? Write to our team

Discuss your AI deployment.

Tell us what you want to achieve and the constraints you work under.

What can we help with?

We use these details only to reply to your request.