- Analyze and triage Git Hub issues across trending open-source libraries
- Set up and configure code repositories, including Dockerization and environment setup
- Evaluate unit test coverage and quality of the codebases
- Modify and run codebases locally to test performance in bug-fixing scenarios
- Collaborate with researchers to identify and design challenging repositories
- Review code performance and provide ratings based on AI standards
- Document findings and suggest improvements for AI-generated code
Requirements
- Minimum 3 years of experience in software engineering
- Strong proficiency in Python and familiar with related technologies
- Experience with Git, Docker, and software pipeline setup
- Ability to navigate and understand complex codebases effectively
- Comfort in running and modifying real-world projects locally
- Familiarity with evaluating or contributing to open-source projects
- Experience in LLM research projects is a plus