Product Engineer
About the Role
This is a Product Engineer role on an AI agent evaluation product, sitting at the intersection of engineering and community. You will ship features for agent builders while creating in public, turning community signal directly into product decisions. Invisible shipping is shipping that doesn't matter, so distribution is part of the job.
What You'll Do
Build and ship product features covering evals, replay, cohorts, and developer experience, with strong judgment about what is sharp versus theater.
Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to surface signal that feeds back into the product.
Wear whatever hat the week demands, whether that is feature work, a marketing motion, or a customer demo, focusing on whatever moves the needle.
Stay close to the target audience of AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
Close the loop between community feedback and what you ship, ensuring no wall exists between build and distribution.
What We're Looking For
3+ years building or shipping production software, with demonstrated experience building or evaluating agents in production environments.
Proficiency in Python for production code.
Hands-on experience with agent frameworks (such as LangGraph, Claude Code, or equivalent).
Experience building or working with evaluation systems for LLM or agent outputs.
Experience with trace data, observability, or debugging agent execution.
Experience shipping developer tools, SDKs, or APIs with attention to DX, including documentation, ergonomics, and demos.
Open-source contributions with measurable adoption or usage by other developers.
Active participation in AI engineering communities on GitHub, X, or similar platforms.
Comfort working in early-stage, high-uncertainty environments where wearing multiple hats is the norm.
Strong design and DX instincts across docs, APIs, and demos.
Compensation & Benefits
Salary range: $125,000 to $190,000 USD annually.
Location
This role is fully remote. The primary office location is Munich, Bavaria, Germany.
Empfohlene Jobs
Steuerfachangestellter / Steuerfachwirt (m/w/d)
dr. roemer & partner. Wir stellen uns vor. In unserer zentral am Englischen Garten gelegenen Kanzlei in München helfen wir sowohl unserer breitgefächerten Mandantschaft als auch unseren Mitarbe…
Strategic Technology Lead - Advanced 3DIC Packaging &...
Huawei Heisenberg Research Center (Munich) is responsible for advanced technology research, architectural development, design and strategic engineering of our products. We are chip platform team i…
Founders Associate Internship - CEO Office (all genders)
You’re not just supporting leadership; you’re amplifying the impact of the CEO and shaping the initiatives that drive Lio’s growth. As a Founders Associate Intern in the CEO Office, you’ll work hands…
Key Account Manager Healthcare (m/w/d)
Bei CANCOM erwartet dich ein innovatives, agiles und nachhaltiges Umfeld: Mehr als 5.300 Mitarbeiter arbeiten tagtäglich daran, mit Hilfe moderner IT-Lösungen die Zusammenarbeit und den Austausch in …
Junior-Bauleiter (w/m/d)
Darauf darfst Du Dich freuen: Neben einer angenehmen, kollegialen Atmosphäre findest Du bei uns ein dynamisches Arbeitsumfeld in einem innovativen Unternehmen. Als Teil unseres hochmotivierten Tea…
COO - GeschäftsführerIn mit Operations & Scaling Verantwortung
GREEN SHIRTS entwickelt nachhaltige, hochwertige und fair produzierte Textilien sowie Merchandisinglösungen für Unternehmen, öffentliche Einrichtungen und Organisationen in der DACH- und EU-Region. Z…
Praktikant Marketing Events (w/m/x)
Unser Team bei der BMW Group verantwortet die Experiential Formate und ermöglicht dir im Rahmen deines Praktikums spannende Einblicke in die Markenstrategie sowie vielfältige Veranstaltungen. Wir g…
Anlagenmechaniker SHK (m/w/d) im Bereich Wärmepumpeninstallation - Region München
Wir suchen ... Dich, wenn Du mit deiner praktischen Erfahrung und Fachkenntnis die Zukunft des klimaneutralen Wohnens aktiv mitgestalten möchtest – und dabei bis zu 6.000 € brutto pro Monat verdie…
Mechatroniker Produktion / Automatisierung (m/w/d) | Raum München
Mechatroniker Produktion / Automatisierung (m/w/d) Standort: Raum München PolyTALENT unterstützt ein technologisch führendes Produktionsunternehmen bei der Suche nach einem erfahrenen Mechatronike…
Founders Associate Internship - Talent & People Strategy (all genders)
As Founders Associate Talent & People Strategy Intern at Lio, you will help build the team and people infrastructure behind one of Europe’s fastest-growing AI companies. Backed by a16z and Y Combi…