Position: Reviewer and rate AI-generated code - PythonType: ContractCompensation: $22/hr - $25/hrLocation: RemoteCommitment: 30 - 40 hours/weekRole Responsibilities- Analyze and triage GitHub issues across trending open-source libraries- Set up and configure code repositories, including Dockerization and environment setup- Evaluate unit test coverage and quality of the codebases- Modify and run codebases locally to test performance in bug-fixing scenarios- Collaborate with researchers to identify and design challenging repositories- Review code performance and provide ratings based on AI standards- Document findings and suggest improvements for AI-generated codeRequirements- Minimum 3 years of experience in software engineering- Strong proficiency in Python and familiar with related technologies- Experience with Git, Docker, and software pipeline setup- Ability to navigate and understand complex codebases effectively- Comfort in running and modifying real-world projects locally- Familiarity with evaluating or contributing to open-source projects- Experience in LLM research projects is a plus