We're hiring experienced software engineers in Argentina, Brazil, Chile, Colombia and Peru for a remote contract evaluating AI coding models for frontier AI labs.
What you'll do - Set up real open-source repositories (Git, Docker) and get them running
- Triage real GitHub issues and check test coverage and quality
- Run and modify code to see how well AI models fix bugs
- Help pick repositories and issues that are hard for AI You need - 3+ years of professional software engineering
- Strong Python, JavaScript/TypeScript, Java, Go, Rust, C# or C++
- Comfort with Git, Docker and running real projects locally
- Good written English Full time (40 hours a week), with 4 hours overlapping US Pacific time Pay and length USD 25 per approved task (a task takes about 45 to 60 minutes) Fully remote contract, starts next week, 2 to 4 weeks with more likely