Berlin
Remote
Mid Level
Full Time
AIData ScienceProduct Data ScientistMachine LearningPythonSQLStatisticsRemote WorkStock Options
Requirements
- •Proficient in Python and SQL for end-to-end analysis
- •Solid foundation in statistics including sampling, hypothesis testing, and variance
- •Analytical mindset focused on business questions
- •3+ years experience in analyst or data scientist roles with at least one year in a product context
What You'll Do
- •Own and extend offline eval suite across products including datasets, judges, and metrics
- •Build and maintain online quality dashboards with various performance indicators
- •Close the production feedback loop by analyzing failure patterns and proposing fixes
- •Harden evaluation methodology including judge stability and handling non-determinism
- •Translate data and metrics into actionable decisions through regular syncs
Nice to Have
- •Experience in quality analytics for ML systems such as ranking, recommendations, classification
- •Hands-on experience evaluating LLM applications including RAG, agents, tool use, judges
- •Experience building LLM agents through side projects or personal experiments
Benefits
- •Make a genuine impact on the product
- •Opportunities for continuous personal and professional development
- •Flexibility to travel and work remotely or in a hybrid model across Europe
- •Stock options program available to all team members
- •Supportive, modern, friendly, and eco-conscious corporate culture
- •Work & Swim program with a month stay in Cyprus
