Measure first, then improve.
We build a representative set of examples, including awkward ones, with the expected result for each. That baseline lets us compare models and approaches objectively and catch regressions later.
It also reveals whether a problem is really the model, or poor retrieval, unclear instructions or missing data. We fix the part that is actually failing.
- Representative test sets with expected results
- Model comparison on quality, latency and cost
- Regression checks on every change
| Test case | Expected | Result |
|---|---|---|
| Clean PDF invoice | Extract | Pass |
| Photographed delivery note | Extract | Pass |
| Two orders in one email | Split | Pass |
| Missing account number | Flag | Pass |
| Foreign currency total | Convert | Fix |