Member of Technical Staff, Realm Lab (frontier AI research)
micro1Legit · not rated yetPosted 15 days ago
Pay: $100–130/hr
- Who can apply
- Countries not stated in the listing
- Hours
- Hours vary · Freelance
- Where
- Remote, work from home
- Job type
- Expert (SME) review
- Openings
- 1 opening
At a glance: A freelance, remote expert (SME) review job with micro1. It pays $100–130/hr, with hours that vary. The listing doesn't say which countries can apply.
Countries not stated
The posting doesn't say which countries can apply, so check before you apply. What micro1 says in general: Recruits worldwide apart from residents of 21 countries and regions, among them China, Russia, Ukraine, Iran, Venezuela and Ethiopia; some listings accept applicants from the US, UK or Canada only
We may earn a referral fee if you are hired. How we make money
Apply link: aitrainerhq.com/go/job/1w87qpnlvi (opens in a new tab)
What happens after you click Apply
- You leave AI Trainer HQ and go to micro1’s own site.
- Pick a role, apply and answer the screening questions attached to it
- Sit the AI interview with Zara, spoken and recorded, about 20–40 minutes
- Complete a technical assessment if the role has one, then a hiring-manager review
- Take the offer, sign your Deel contract and clear the KYC identity check
How this pay compares
This job pays more than 90% of the 178 other science (PhD) jobs on the board that state pay; 8% pay more.
- This job
- $115/hrMiddle of $100–130/hr
- Median on micro1
- $69/hrFrom 320 other paid jobs
- Median in science (PhD)
- $65/hrFrom 178 other paid jobs
Requirements
- Qualifications
- LLM Evaluation & Benchmark Design
- Python & ML Engineering
- Reinforcement Learning & Agentic Systems
- Model Failure Analysis & Research Methodology
- Languages
- English
- Equipment
- Computer with a reliable internet connection
About this job
Job Title: Member of Technical Staff, Realm Lab (frontier AI research)
Job Type: Full time
Location: Remote
The Role
We're hiring a Member of Technical Staff (MTS) to join Realm Lab and drive research initiatives focused on evaluating and improving frontier AI systems.
This is a hands-on technical role at the intersection of machine learning, data research, and evaluation engineering. You'll work closely with researchers and domain experts to develop benchmarks, reinforcement learning environments, and high-quality datasets that advance model capabilities and performance.
What You'll Do
• Own research and evaluation initiatives end-to-end, from task design and dataset development to benchmark validation and performance analysis.
• Design and validate capability evaluations, RL environments, and benchmark suites for computer use, agentic workflows, and emerging model capabilities.
• Develop high-quality datasets, task specifications, evaluation rubrics, and methodologies to improve post-training data quality and model assessment.
• Analyze model behavior through failure analysis, error taxonomies, and capability gap identification to inform research directions.
• Collaborate with researchers and domain experts to design experiments, calibrate evaluation quality, and improve model performance.
• Build reproducible evaluation pipelines and feedback loops to support iterative model development.
• Contribute to benchmarks, research papers, technical reports, and open research artifacts.
What We're Looking For
• Strong technical background in computer science, machine learning, AI, or a related field.
• Hands-on experience designing ML evaluations, benchmark suites, research datasets, or experimental frameworks.
• Proficiency in Python and experience building data pipelines, evaluation tools, or ML research infrastructure.
• Understanding of LLMs, foundation models, post-training techniques, and evaluation methodologies.
• Ability to translate complex real-world workflows into structured tasks, measurable criteria, and research experiments.
• Strong analytical skills in model failure analysis, experimental design, and evaluation quality.
• Ability to work independently and collaborate effectively with researchers, engineers, and domain experts.
Preferred Qualifications
• Experience with reinforcement learning environments, reward modeling, simulators, or feedback-driven training systems.
• Experience evaluating computer use agents, tool use, browser automation, or multi-step agentic workflows.
• Familiarity with multimodal reasoning, long-context evaluation, instruction following, or deep research benchmarks.
• Experience with human-in-the-loop evaluations, expert-generated datasets, or post-training data.
• Contributions to AI research publications, open-source benchmarks, or evaluation frameworks.
Compensation & Benefits Notice
The national pay range for this full-time position is base salary of $240,000 –$350,000. All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, dependent on role and subject to company policies. micro1 provides a comprehensive benefits package, including up to 100% reimbursement for health-insurance premiums, paid time off, a 401(K) plan with a company match, and additional benefits designed to support a high-performing, remote-first workforce.
Listing history
- First seen on our board
- (14 days ago)
- Posted by micro1
- (15 days ago)
- Last checked
- Source
- micro1
We check every live job against its source at least every 24 hours. How we check jobs