Accuracy registry
Verification & the open eval suite
Language models can't do deterministic financial math. This is the open benchmark that measures it — and the registry of exactly what Pascaline has verified.
The open eval benchmark
The Pascaline Deterministic Tax Eval Suite is a public set of defining U.S. tax, estate, and benefit scenarios — each paired with its correct, statute-cited answer, produced by the same pure engine Pascaline serves. Run it against any calculation tool or language model to measure real accuracy on the cases that matter: the cliffs, phase-outs, and edge cases that are easy to get plausibly — and expensively — wrong.
- Download: eval-suite.json — 12 cases, CC‑BY‑4.0.
- Run it against the live API, or any endpoint that returns the same
{ "result": … }shape:
npx tsx scripts/evals/run.ts --base https://pascaline.io # → 12/12 passed (100%). Point --base at any tool or model proxy to compare.
Each case is a POST to its endpoint with a JSON request; the target's result is compared field-by-field to the cited ground truth. Pascaline scores 100% by construction — the informative number is how a general model scores on the same suite.
Covered scenarios
| Scenario | API | Why it's hard | Cites |
| Massachusetts full cliff — $12M estate | state-estate-tax | MA taxes the ENTIRE estate once it exceeds the threshold, not just the excess. The single most common six-figure error in estate-tax tools. | 1 |
| Oregon cliff — $1.1M estate | state-estate-tax | Oregon's $1M threshold is a cliff in Pascaline's model; the tax on a $1.1M estate is far larger than a naive 'tax the excess' calculation. | 1 |
| New York 105% cliff — $8M estate | state-estate-tax | NY phases out the exemption between 100% and 105% of the threshold; above 105% the whole estate is taxed. A 3-zone cliff almost no tool models. | 1 |
| Zeroed-out GRAT — $2M, 5yr, §7520 4.6% | grat-grut | The GRAT annuity that produces a ~$0 taxable gift depends on the §7520 rate and the Rev. Proc. 2019-44 annuity factor. Rate pinned to the spec's worked example. | 3 |
| CLAT charitable deduction — $1M, 10yr | grat-grut | The charitable deduction is the annuity times the term-certain factor at the §7520 rate; remainder passes to heirs. | 3 |
| Non-spouse 10-year rule with RMDs | inherited-ira-rmd | A non-spouse beneficiary of a decedent who had reached their required beginning date must take annual RMDs AND empty the account by year 10 (SECURE Act). | 2 |
| ISO exercise-and-hold AMT | iso-amt | Exercising 50,000 ISOs at $1 with an $8 FMV creates a $350k AMT preference item; the tentative minimum tax vs regular tax delta is the AMT owed. | 4 |
| PTET SALT-cap workaround — CA S-corp | ptet-salt | A pass-through entity tax election converts non-deductible personal SALT into a deductible entity expense; the net federal benefit accounts for the QBI interaction. | 3 |
| §199A QBI with W-2/UBIA limits — MFJ $600k | qbi-199a | Above the MFJ threshold the deduction is capped by the greater of 50% of W-2 wages or 25% of wages plus 2.5% of qualified property, computed per business. | 2 |
| §1202 QSBS gain-exclusion eligibility | qsbs | Exclusion depends on original-issue C-corp stock, the $50M gross-assets test at issuance, an active qualified trade, and the holding period. | 2 |
| Social Security PIA at full retirement age | ss-pia | The primary insurance amount applies the bend-point formula to 35 years of wage-indexed earnings; claiming age then adjusts the benefit. | 5 |
| SSDI benefit with workers'-comp offset | ssdi | SSDI plus workers' compensation cannot exceed 80% of average current earnings; the excess reduces the SSDI benefit (the reverse-offset states differ). | 8 |
A flagship seed across the estate, premium, and retirement suites; it extends to all 32 APIs as scenarios are added.
Accuracy registry — all 32 APIs
Every API, its primary route, and its current verification tier. See how we verify for the beta→verified process — a number reaches verified only once a human confirms its defining scenarios against primary sources.
| API | Suite | Route | Tier |
| State Estate & Inheritance Tax | Estate Planning Suite | /estate/calculate-state-tax | beta |
| Federal Estate Tax & Portability | Estate Planning Suite | /estate/calculate-federal-tax | beta |
| Inherited IRA RMD Schedule | Estate Planning Suite | /inherited-ira/schedule | beta |
| Gift Tax Annual Exclusion Optimizer | Estate Planning Suite | /gift-tax/optimize-annual-gifts | beta |
| GRAT / CLAT / SLAT Trust Calculator | Estate Planning Suite | /estate/calculate-grat | beta |
| QTIP / QDOT Marital Trust Optimizer | Estate Planning Suite | /estate/optimize-qtip-election | beta |
| Social Security Filing Strategy | Premium Tax Suite | /ss/optimize-filing-strategy | beta |
| Social Security PIA Estimator | Premium Tax Suite | /social-security/estimate | beta |
| ISO Exercise AMT Calculator | Premium Tax Suite | /equity/calculate-tax | beta |
| QSBS §1202 Exclusion | Premium Tax Suite | /qsbs/check | beta |
| PTET / SALT Cap Optimizer | Premium Tax Suite | /ptet/calculate-benefit | beta |
| §199A QBI Deduction | Premium Tax Suite | /qbi/calculate-deduction | beta |
| Foreign Tax Credit Limitation | Premium Tax Suite | /international/calculate-ftc | beta |
| R&D Tax Credit (§41) | Premium Tax Suite | /tax-credit/calculate-rd-credit | beta |
| Form 8606 / Backdoor Roth | Retirement & International Suite | /ira/form-8606 | beta |
| Pension Lump Sum vs Annuity | Retirement & International Suite | /pension/lump-sum-comparison | beta |
| SSDI Benefit Estimator | Retirement & International Suite | /ssdi/estimate-benefit | beta |
| CPP + OAS (Canada) | Retirement & International Suite | /canada/retirement-benefit | beta |
| Australian Superannuation | Retirement & International Suite | /australia/superannuation/contributions | beta |
| ADA Compliance Requirements | Compliance & Data Suite | /ada/requirements | beta |
| Child Support Calculation | Compliance & Data Suite | /child-support/calculate | beta |
| Multi-State Employment Law | Compliance & Data Suite | /employment-law/lookup | beta |
| FAFSA Student Aid Index | Compliance & Data Suite | /fafsa/sai | beta |
| Immigration Points & Eligibility | Compliance & Data Suite | /immigration/calculate | beta |
| Professional Credential Verification | Compliance & Data Suite | /credentials/verify | beta |
| FDA Enforcement & Warning Letters | Compliance & Data Suite | /fda/enforcement/search | beta |
| SaaS Terms of Service Compliance | Compliance & Data Suite | /tos/check-compliance | beta |
| Supplier Diversity Certification | Compliance & Data Suite | /supplier-diversity/certifications | beta |
| Platform Content Policy Compliance | Compliance & Data Suite | /content-policy/check | beta |
| Flight Delay Compensation | Compliance & Data Suite | /flight/check-compensation | beta |
| Patent Expiration & Maintenance | Compliance & Data Suite | /patent/status | beta |
| Generic Drug Entry Date | Compliance & Data Suite | /pharma/generic-entry | beta |