We're hiring experienced software engineers in Argentina, Brazil, Chile, Colombia and Peru for a remote contract evaluating AI coding models for frontier AI labs.
What you'll do
- Set up real open-source repositories (Git, Docker) and get them running
- Triage real GitHub issues and check test coverage and quality
- Run and modify code to see how well AI models fix bugs
- Help pick repositories and issues that are hard for AI
You need
- 3+ years of professional software engineering
- Strong Python, JavaScript/TypeScript, Java, Go, Rust, C# or C++
- Comfort with Git, Docker and running real projects locally
- Good written English
Full time (40 hours a week), with 4 hours overlapping US Pacific time
Pay and length USD 25 per approved task (a task takes about 45 to 60 minutes)
Fully remote contract, starts next week, 2 to 4 weeks with more likely