SWE Coding Benchmarks & RL Environments [$45-75/hr]
Role Responsibilities
- Writing realistic engineering tasks on full-stack web apps: the kind of problem a real team has in its backlog, on codebases that grow as each task builds on the last
- Writing the tests that decide whether a solution is correct
- Going beyond the UI: new services and APIs, a backend in another language (Go, Rust, Java), gRPC, rate limiting drawing on systems you've actually built
- Sharing what you've seen work in other projects and flagging what should change in ours
The apps are TypeScript (React, Node, SQLite, Playwright). Use AI tools as much as you like to write code and tests.
Good Candidature
- Solid professional software engineering experience, backend and frontend
- You've built and debugged real systems, and you care about testing them well
- Clear written communication, and comfort working independently from written docs
- 10 - 20+ hours a week