-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comparison to other AMR Coref Systems #1
Comments
There is also... https:/IreneZihuiLi/VG-AMRCoref which has noticeably better scores. The following is a quick comparison of the 3 different projects available on GitHub (including this one) |
Re Fu et al. and Li et al work: the scores you mention are the scores they report in their work. However, I have tried to reproduce their work and failed. I contacted both authors, and while I had more exchange with Li, they both stopped responding to my correspondence. This is very unfortunate given Fu et al. reports a F1 ave from 34 to 62.4 (28.4 improvement over the baseline) and Li et al. reports a F1ave from 62.4 to 73.5 (11.1 improvement over the baseline), which is now the new baseline. For all practical purposes, |
The only other system that I'm aware of is https:/Sean-Blank/AMRcoref as described in the paper "End-to-End AMR Coreference Resolution". The scores in the paper are relatively similar to this project's scores.
The text was updated successfully, but these errors were encountered: