(Senior) AI Product Engineer (m/w/d)

What You'll Do

You’ll identify open AI opportunities, build them from start to finish, and bring them to real users. As a Senior AI Product Engineer, you’ll work across our three product squads: You’ll single-handedly turn unaddressed topics into products, hand them off once they’re up and running, and serve as a sparring partner for the squad PMs on all AI-related topics. For us, “senior” refers to your approach to work, not your years of experience. You’ll report directly to Product Leadership.

Your Responsibilities

• Independent AI projects (about half of your time)
• You’ll identify high-impact AI opportunities in our legal workflows - in areas where no specific squad is responsible
• Validation happens quickly: discussions with attorneys, Legal Ops, and insurers; prototypes built in days
• You’ll bring the winning solutions into production yourself: routing, chaining, summarization, and agent-based loops
• You’ll hand off mature features to the squad - complete with documentation, evaluations, and a handover plan

Support for the squads (the other half)

• Feasibility, costs, model selection, risks: You’ll answer these questions before every AI feature is launched
• You support the teams in designing evaluations, golden datasets, and guardrails
• You review concepts before they go into the roadmap - including prompt injection and compliance risks (GDPR, Section 203 of the German Criminal Code)
• You advance AI best practices: prompt engineering standards, LLM observability, and agent-based coding workflows

What you bring

Must-have

• Multiple production-ready AI/LLM systems that you’ve shipped to real users and taken responsibility for - no prototypes
• Demonstrable product ownership: from a vague problem to a finished product
• Strong Python skills and a solid foundation in software engineering (Git, testing, CI/CD, code review)
• In-depth experience with LangGraph, LangChain, or similar - including an understanding of what’s happening under the hood
• Proficiency with LLM provider APIs: function/tool calling, structured outputs, streaming
• Evaluations, golden datasets, and guardrails before deployment
• Solid prompt engineering - you know when to use which technique
• Business-level English; German is a major plus due to our legal domain

Soft Skills

• The maturity to work without a squad around you: You set your own priorities and know when to say no
• You can explain a technical trade-off to a lawyer and a legal workflow to an engineer

What we promise

Work Environment & Flexibility

• Office-first: 3 days in the office, 2 days working from home - with flexibility in how you structure your work
• Modern, air-conditioned office with plenty of natural light and a large rooftop terrace overlooking Berlin
• Central location between Gleisdreieck and Potsdamer Platz

Benefits

• Full coverage of the public-transport ticket
• Company pension plan with a 20% employer contribution
• Corporate benefits platform with discounts from many brands
• Dog-friendly office
• Regular company and team events, after-work fun with Switch, PS5, darts, and foosball
• Free drinks, fresh fruit, and granola

Culture & Collaboration

• Agile mindset with open communication - every voice counts
• Feedback is part of our culture - we believe in growing together

Fast application process

• Your application as an AI Product Engineer (Senior) - short and to the point
• Approx. 20-minute introductory conversation with our HR team
• Approx. 60-minute in-person interview with your hiring manager
• Approx. 30-minute discussion with the management team
• A prompt job offer

Your contact: Nadine · HR Manager · karriere@legalhero.de · 030 22957522