Proje Detay
Member of Technical Staff, Realm Lab (frontier AI research) – Remote (Worldwide)
Brazil, Canada, France, Germany, India, Netherlands, United Kingdom, United States 3 saat 13 dakika önce yayınlandı. Full Time Himalayas
600.000 - 2.000.000 USD

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in 55 countries, including Brazil, United States, United Kingdom, Canada, Germany, India, France, Netherlands.

Pay: $600,000–$2,000,000/yr

Job Title: Member of Technical Staff, Realm Lab (frontier AI research)

Job Type: Full time

Location: Remote

The Role

We're hiring a Member of Technical Staff (MTS) to join Realm Lab and drive research initiatives focused on evaluating and improving frontier AI systems.

This is a hands-on technical role at the intersection of machine learning, data research, and evaluation engineering. You'll work closely with researchers and domain experts to develop benchmarks, reinforcement learning environments, and high-quality datasets that advance model capabilities and performance.

What You'll Do

  1. Own research and evaluation initiatives end-to-end, from task design and dataset development to benchmark validation and performance analysis.
  2. Design and validate capability evaluations, RL environments, and benchmark suites for computer use, agentic workflows, and emerging model capabilities.
  3. Develop high-quality datasets, task specifications, evaluation rubrics, and methodologies to improve post-training data quality and model assessment.
  4. Analyze model behavior through failure analysis, error taxonomies, and capability gap identification to inform research directions.
  5. Collaborate with researchers and domain experts to design experiments, calibrate evaluation quality, and improve model performance.
  6. Build reproducible evaluation pipelines and feedback loops to support iterative model development.
  7. Contribute to benchmarks, research papers, technical reports, and open research artifacts.

What We're Looking For

  1. Strong technical background in computer science, machine learning, AI, or a related field.
  2. Hands-on experience designing ML evaluations, benchmark suites, research datasets, or experimental frameworks.
  3. Proficiency in Python and experience building data pipelines, evaluation tools, or ML research infrastructure.
  4. Understanding of LLMs, foundation models, post-training techniques, and evaluation methodologies.
  5. Ability to translate complex real-world workflows into structured tasks, measurable criteria, and research experiments.
  6. Strong analytical skills in model failure analysis, experimental design, and evaluation quality.
  7. Ability to work independently and collaborate effectively with researchers, engineers, and domain experts.

Preferred Qualifications

  1. Experience with reinforcement learning environments, reward modeling, simulators, or feedback-driven training systems.
  2. Experience evaluating computer use agents, tool use, browser automation, or multi-step agentic workflows.
  3. Familiarity with multimodal reasoning, long-context evaluation, instruction following, or deep research benchmarks.
  4. Experience with human-in-the-loop evaluations, expert-generated datasets, or post-training data.
  5. Contributions to AI research publications, open-source benchmarks, or evaluation frameworks.
Yetenekler
Machine-Learning-Engineer AI-Research-Engineer Research-Scientist AI-Evaluation-Engineer Data-Scientist
Ödeme Şekli
annual
Ücret Aralığı
600.000 - 2.000.000 USD
Çalışma Şekli
Full Time
Lokasyon
Brazil, Canada, France, Germany, India, Netherlands, United Kingdom, United States
Himalayas
Kaynak
Himalayas
Bu ilan pofft dışı bir kaynaktan geliyor. Aşağıdaki butondan kaynağa gidebilirsin.
Himalayas
Reklam pofft AI — Uzmanlığını bir agent'a dönüştür
Reklam pofft Dükkan — Hizmetini paketle, sabit fiyatla sat
pofft ile iletişime geçin
Bizimle iletişime geçerek pofft hakkında daha fazla bilgi alabilir, freelance iş fırsatlarını ve işletmenize uygun Freelancerları keşfedebilirsiniz.

E-posta

Genel sorular ve işbirliği için

info@pofft.com

Sosyal Medya

Güncel haberler ve içerikler

Bülten

Güncel haberler ve fırsatlardan haberdar ol

Spam yok. İstediğin zaman çıkabilirsin.

Abone Ol'a tıklayarak Aydınlatma Metni'ni okuduğunu ve pazarlama iletişimine onay verdiğini kabul etmiş olursun.

Reklam Fintechtime — Finans ve teknoloji gündemini kaçırma Fintechtime — Finans ve teknoloji gündemini kaçırma