We are seeking a project team of skilled Software Engineers to work as project consultants in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.
Location
: U.S.-based experts only
Engagement
: Part-time, project-based expert evaluation work
Work Type
: Remote
Contributors will design and evaluate realistic software engineering tasks, including bug resolution, feature implementation, refactoring/migration, and test generation. Work includes both creating complex coding scenarios and reviewing peer submissions for quality and accuracy.
This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).
Responsibilities:
Contributors will:
Design and implement multi-file coding tasks across bug fixing, feature development, refactoring, and testing
Write clear natural-language specifications and reference implementations
Develop and extend unit and integration test suites
Review peer-generated tasks for correctness, clarity, and realism
Identify edge cases, ambiguities, and potential failure modes
Ensure alignment between specifications, code, and expected outputs
Expected Outcomes:
High-quality, production-realistic coding tasks
Complete and correct reference implementations
Robust test coverage and validation artifacts
Structured, actionable peer review feedback
Qualifications:
Advanced professional written proficiency in English
3–5 years of professional software engineering experience
Strong proficiency in Python and JavaScript/TypeScript; working knowledge of Java, C#, or Go
Backend or full‑stack development experience in production systems
Experience with testing frameworks (e.g., pytest, Jest, JUnit, xUnit, Go testing)
Proven ability to debug and navigate large, multi‑file codebases
Experience with code reviews, refactoring, and production migrations
Prior experience with data annotation, evaluation, or structured labeling for AI/ML systems
Experience defining solution trajectories and writing evaluation rubrics
Familiarity with LLM evaluation, prompt design, or benchmarking workflows
ATS Match is available
1) Upload your resume. 2) Open any job and click Check ATS Match to see your fit score.