Member of Technical Staff - Safety
Reflection
Job description
Our Mission
Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all.
We published our approach in the Open Safety Framework and the Beam Safety Technical Report. You will be responsible for the safety of the model.
About the Role
Conduct safety post-training on Beam: Develop and improve our SFT and RL pipeline, including policy-conditioned reasoning traces, context-aware reward models and mixed-task safety environments.
Build safeguards for open-weight deployment. Develop classifiers that are cheap to run, catch nearly all harmful cases and stay reasonably precise. These include prompted and fine-tuned classifiers and linear probes on model internals, and they cover prompts, reasoning, responses and agent trajectories. Ship them with intervention guidance that inference providers and the open-source community can actually deploy.
Build safety systems for Reflection’s API & AI Factory. Develop, train and run state-of-the-art safeguards for our API and AI Factory deployments, covering both real-time and offline monitoring and enforcement. Combine classifiers, linear probes and lighter-weight detection to find and act on misuse at scale. Turn what we learn in production into better safeguards for the whole ecosystem.
Own systemic risk evaluations. Design, run and evolve capability evaluations for biological, chemical, radiological/nuclear, cyber, harmful manipulation and loss-of-control risks. Base them on clear threat models, and use them to inform OSF risk determinations and launch decisions.
Measure safety across every harm area. Grow Iris Safety Evaluations (ISE) across our > 15 harm categories, from self-harm, cyber, and child safety to fraud and privacy, in single-turn, multi-turn and agentic settings. Track over-refusal on real-world traffic, and verify that safety holds across quantized variants and deployment settings like search and custom system prompts.
Responsible release: Validate that each model meets our risk thresholds on both system risks and safety model behavior before it ships. Work with third-party evaluators and government AI safety institutes on pre-deployment testing, and help write the safety reports and model cards that explain our decisions publicly.
Put advanced capabilities in defenders’ hands. Build defensive cyber & bio tools, such as autonomous penetration testing, and the trusted access programs that get them, and more capable models over time, safely to vetted security teams.
Lead adversarial testing. Run human and automated red teaming across misuse, jailbreaks, prompt injection and alignment failures. Build attacker agents that adapt to the model, so we test against dynamic attacks rather than static datasets, and feed what we find back into training and safeguards.
Run Safety evaluations grounded in the real world. Design and run human uplift studies, from uplift trials to wet-lab studies, and live-deployment evaluations like our partnership with Andon Labs, where Beam runs a real business, to measure what our models can actually do in the real world.
Own the safety policies. The harm policies, red lines and constitution, plus working with safety subject-matter experts on data and grading.
Push the safety & alignment research frontier. Work on problems that matter most for open weights: resistance to abliteration and fine-tuning attacks, safety that holds up inside the model, monitorability, evaluation awareness and agentic security. Publish the results and release open tools the community can build on.
About You
Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, post-training, evaluations, and interpretability.
Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.
Experience with Reinforcement Learning (RLHF) and how it impacts model safety and alignment is a strong plus.
Thrive in a fast-paced, high-agency startup environment with bias toward action.
Willing to make high-stakes decisions regarding model release and safety thresholds.
Mission oriented & passionate about advancing the frontier of intelligence.
What We Offer:
We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models.
We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.
Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
Meals: Lunch and dinner are provided in the office daily.
Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
Team building: We have regular off-sites, happy hours, and team celebrations.
Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization.
Equal Employment Opportunity Statement
Reflection AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), sexual orientation, gender identity or expression, national origin, ancestry, age, marital status, disability, genetic information, veteran or military status, or any other characteristic protected by applicable law. We encourage applicants from all backgrounds to apply.
We provide reasonable accommodations throughout the hiring process for applicants with disabilities, pregnancy-related limitations, or religious needs. If you need an accommodation, contact us at [email protected].
We will consider for employment qualified applicants with arrest and conviction records in accordance with applicable law, including the San Francisco Fair Chance Ordinance and the California Fair Chance Act.
Candidate and Employee Privacy Notice: We collect and process personal data about applicants for the purposes described in our Candidate and Employee Privacy Notice
Quick info
San Francisco · United States
Full Time
Posted 2 hours ago
Still open · checked 16 Nov 2026
Source
Reflection's career page (Ashby)
Apply now
Opens the original posting right away and adds it to your tracker in the background.