This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications.
In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions.
The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required.
Requirements
Key Responsibilities
- AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices.
- Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment.
- Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems.
- Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations.
- Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies.
- Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards.
- Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance.
- Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings.
- Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible.
Required Qualifications
- At least one year of professional experience as a software engineer at a well-established technology company.
- At least part of the relevant professional experience should have been gained within the past three years.
- Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming.
- Practical experience writing, debugging, testing, and reviewing code.
- Familiarity with software development practices, including version control, code reviews, testing, and debugging.
- Ability to assess code for correctness, performance, readability, and maintainability.
- Foundational understanding of software architecture and system design principles.
- Strong analytical and problem-solving skills.
- Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly.
- Ability to work independently and deliver accurate, high-quality technical assessments.
Must-Have Skills
- Software Engineering Fundamentals
- Programming and Coding
- Data Structures and Algorithms
- Code Review and Quality Assessment
- Debugging and Troubleshooting
- Automated Testing and Test Case Development
- Problem-Solving and Logical Reasoning
- Technical Documentation and Written Communication
Good-to-Have Skills
- Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languages
- Object-Oriented Programming and Design Patterns
- API Development and Backend Engineering
- Software Architecture and System Design
- Performance Optimization and Profiling
- Git and Version Control
- Unit Testing and Integration Testing
- CI/CD and Software Development Workflows
- AI-Generated Code Evaluation
- Familiarity with AI coding assistants and model benchmarking
Preferred Qualifications
- Professional software engineering experience at a recognized technology company.
- Experience developing and maintaining production-quality applications, services, or APIs.
- Familiarity with reviewing complex codebases and identifying implementation weaknesses.
- Experience designing coding exercises, technical assessments, or automated evaluation tests.
- Candidates based in English-speaking countries are preferred.
- Ability to communicate technical findings in clear, structured, and concise English.
New Zealand