A simulated tribunal that rules without explaining is a coin toss with a gavel. We describe how Simulation records each ruling, how we checked 600 of them against practitioners, and where it still disagrees.
Zero retention means we cannot read the contracts our model reviews. So how do we know it is improving? A method built on synthetic drafts, in-tenant scoring and a panel of lawyers who disagree.
Our in-house model: what it was trained on, what it was not, how it was evaluated against the models we previously routed to, and where it still falls short.
Accept rate rewards timid redlines. Here is the four-part measure we use instead, the sample behind it, and the places where it still misleads us.
