This repo contains test suite evaluation metric for 11 text-to-SQL tasks. Compared to other current metrics, test suite calculates a tighter upper-bound for semantic accuracy efficiently. It is ...
This library is experimental now. The APIs are subject to change (especially those marked with @ExperimentalEvscApi). Based on the requests-per-second numbers above ...