Show HN: VerusCite, a tool to check for hallucinations in academic articles

2 points by apwheele 2 days ago · 0 comments · 1 min read

Hello HackerNews --

I have created an application that verifies citations. Main motivation is to make checking for hallucinated citations in academic papers simpler/faster.

Can sign up for the tool at <https://veruscite-data.com/>, and can see the benchmark for metrics and some description of the methodology at <https://github.com/apwheele/veruscite-data>.

If you want to check out the approximate UI without signing up (at least the output), can see some examples:

https://veruscite-data.com/share/WWcj0furPRsDa8wlYKQSER1zQYp...

https://veruscite-data.com/share/xnHTxfP6bp7p3ZKdQegWuNvyQtX...

https://veruscite-data.com/share/3Pu3dwCfc-ixPgtHutVFXgMU7FY...

There are many minor errors in citation lists (maybe on the order of 5%). So even if you were not worried about hallucinations, it is useful for editors. If you sign up I have attempted to make the UI as easy as possible for a human to review the output and make changes (there are definitely errors, see the github for estimates of error rates).

So let me know what you think HN!

No comments yet.