AI Research Scientist – Scientific Evaluation (ML/AI)

Lightly AG is a Zurich-based AI company and ETH/HSG spin-off, backed by Y Combinator and top-tier investors. Our machine learning and computer vision technology is trusted by global leaders in autonomous driving, medical imaging, and visual inspection.

We’re looking for experienced ML/AI researchers with a strong publication track record at top-tier conferences (NeurIPS, ICML, ICLR) to support an advanced AI research evaluation project. You'll critically assess scientific papers and research outputs generated by autonomous AI research agents, evaluating their technical correctness, scientific novelty, experimental rigor, and overall research quality against the standards of leading ML/AI conferences.

This is a remote, project-based contractor opportunity with flexible working hours.

Tasks

What you'll be doing

• What you'll be doing

• Critically evaluate AI-generated ML/AI research papers, assessing their scientific contributions, technical correctness, methodology, experimental design, and conclusions

• Assess scientific novelty and significance, determining whether proposed approaches represent meaningful advancements over existing state-of-the-art research

• Evaluate experimental rigor and validity, including baseline comparisons, benchmark selection, evaluation metrics, statistical evidence, and ablation studies

• Identify methodological flaws, unsupported claims, inconsistencies, or misleading results that undermine the scientific validity of proposed contributions

• Assess reproducibility and technical soundness, including whether reported findings are…