Skip to main content
OpenTrain AI logo

Senior Software Engineer - LLM Evaluation, Part-Time AI Review - Remote (Worldwide)

OpenTrain AI
1 day ago
Part-time
Remote
Worldwide

• rate not provided

• 100% remote

• Part-time independent contractor

• 20 or more hours a week, you choose when


Use your senior software engineer - llm evaluation experience to review AI-generated software work and explain what is correct, robust, and ready to improve.


AI training uses realistic code examples and expert feedback to improve model quality. You will evaluate practical engineering work rather than solve abstract puzzles.

OpenTrain AI is committed to fair hiring and evaluates applicants on relevant skills and experience.


## What you will do

• Create or refine realistic software-engineering evaluation tasks.

• Review AI-generated code for correctness, architecture, tests, and maintainability.

• Explain defects, trade-offs, and useful corrections in concise feedback.

• Apply sound engineering judgment across varied repositories and workflows.


## Why this is worth your time

• Apply your senior software engineer - llm evaluation judgment to meaningful AI evaluation work.

• Turn specialist knowledge into structured feedback that improves model quality.


## Who this is for

• Worldwide opportunity; professional fluency in English is required.

• The initial engagement lasts one month, with potential extensions based on performance and fit.

• Several years of professional software engineering experience, including at least two continuous years of full-time experience at a top-tier product company.

• Strong full-stack application development and production deployment experience.

• Deep knowledge of software architecture, design, development, debugging, and code quality assessment.

• Ability to provide clear, structured written and oral evaluation rationales.

• Proficiency in one or more of Python, JavaScript, ReactJS, C/C++, Java, Rust, and Go.

• No AI experience needed.

## Pay and details

• rate not provided as an independent contractor.


• 20 or more hours a week, you choose when

## How to apply

1. Apply on OpenTrain with your resume: https://app.opentrain.ai/api/out/cmrnidzrp001l04l56dncz1nl?ch=kubernetesjobs&sub=p_d1692f11a593

2. Complete the application on the hiring platform.

3. If shortlisted, take a short AI interview.


This is that work, done remotely around your current schedule.


## About OpenTrain AI

OpenTrain AI connects experienced professionals with paid, part-time AI training and data-labeling work. Contributors review and improve examples that help AI systems produce useful content.