Why we bet on a small model for contracts
Latency, residency, reproducibility and the sealed laptop: the four constraints that made a 7-billion-parameter model the right size for clause-level work, and what we gave up.
Latency, residency, reproducibility and the sealed laptop: the four constraints that made a 7-billion-parameter model the right size for clause-level work, and what we gave up.
Inline review either keeps pace with drafting or it interrupts it. We set a hard budget of half a second at the 95th percentile, and most of our architecture follows from it.
A flag without a reason cannot be checked, cannot be disagreed with and cannot be defended later. The audit argument for citations is stronger than the usability argument, and it is the one that matters.
A year ago we had just over a hundred accounts. Now there are 340 in 28 countries. Some of what we expected to happen did. Much of it didn’t, and that is the more useful list.