r/MachineLearning • • 7h ago

Project Papers with Code is now open-source [P]

Papers with Code is now open-source with an Apache 2.0-license.

The goal is to collaboratively create the best paper interface with the community!

Over the past couple of months, I've been working with my buddies Claude and Codex on creating a website that tracks trending AI research, benchmarks and state-of-the-art (SOTA). It's a revival of the original Papers with Code website, which Meta acquired and later shut down.

The website is pretty straightforward:
- Python FastAPI backend
- React frontend

The app itself is hosted on a Hetzner Virtual Private Server (VPS). The code is also hosted there as a single monorepo.

The frontend mostly calls various API endpoints to visualize papers. The API itself is also publicly available, as is an accompanying MCP server.

I've been getting cool feature requests lately, so rather than just working on it myself, I thought it would make a lot more sense to share the codebase openly so anyone can contribute.

Code: https://github.com/huggingface/paperswithcode

14 Upvotes

2 comments sorted by

4

u/skadoodlee 4h ago edited 4h ago

Good to see efforts trying to bring it back. I missed it, even though it was far from perfect.

I think it would be nice to focus on finding the highest value benchmarks/datasets per task, besides just finding papers with the highest score. Could provide some real value there. The most famous benchmarks might not be the best one or most aligned with the task. Therefore papers achieving SOTA on certain benchmarks are often not the highest value findings. Also would be interesting checking if methodology can be critiqued for benchmaxing approaches during indexing.

And has it been backfilled in any way of is it only being forward filled each day from ArXiv? Missing quite some works.