Applied AI Engineer, Operations Automation

About the role

We are looking for an experienced Applied AI Engineer to join our Growth team and build operations‑automation systems for Bolt’s global mobility platform. The role focuses on applying machine learning to customer support, document verification and fraud‑detection challenges for over 200 million customers.

Key responsibilities

• Redesign end‑to‑end processes by mining system records, interviewing stakeholders and deciding which steps become software, agents or human checkpoints.
• Define quality standards, turn real cases into test sets and create regression tests for every failure.
• Build robust checks that are hard to game, calibrate LLM judges against human labels and control cost and payouts.
• Run the improvement loop across policies, prompts, tools and models, adding fine‑tuning when needed.
• Own rollout gates, run A/B tests, and feed live results back into test sets.
• Codify successful solutions so other teams can adopt them without further assistance.

Required profile

• Background in software engineering, ML or data science with a shipped system that calls LLMs.
• Experience building evaluation suites for LLM or agent systems and using them to decide releases.
• Hands‑on experience analysing agent traces, designing LLM judges and fixing reward‑hacking cases.
• Ability to design, interpret and explain A/B test results to operations leads.
• Clear written communication in English, with realistic and ceiling estimates in reports.

Required skills

• SQL
• LLM integration and prompt engineering
• Post‑training techniques (RLVR, GRPO, DPO, LoRA)
• Program optimisation frameworks (GEPA, DSPy, TextGrad)
• Reinforcement‑learning environment or gym design with programmatic grading

What we offer

• Professional growth with unique career opportunities and stock options.
• Wellness perks, a 1‑month paid sabbatical after 5 years, and regular company events.
• On‑site work at our Tallinn headquarters alongside operations and engineering teams.
• Expectation to use AI daily to improve productivity while maintaining high output standards.