Skip to content

WikiSQL Leaderboard Model and Outputs

Latest
Compare
Choose a tag to compare
@lyuqin lyuqin released this 27 Apr 07:56
· 4 commits to master since this release
d9f01fe

This contains the HydraNet model file that can reproduce reported number on WikiSQL leaderboard. The model outputs readily for evaluation are also attached.

Model Dev logical form
accuracy
Dev
execution
accuracy
Test
logical form
accuracy
Test
execution
accuracy
Uses execution
HydraNet
+Execution-Guided Decoding
(Lyu 2020)

(Microsoft Dynamics 365 AI)
86.6 92.4 86.5 92.2 Inference
HydraNet (Lyu 2020)
(Microsoft Dynamics 365 AI)
83.6 89.1 83.8 89.2