Barcelona
Remote
Mid Level
Full Time
AIData ScienceProduct Data ScientistRemotePythonSQLStatisticsMachine LearningLLMQuality Analytics
Requirements
- •Proficient in Python and SQL for end-to-end analysis
- •Solid foundation in statistics including sampling, hypothesis testing, and variance
- •Analytical mindset focused on business questions
- •3+ years experience in analyst or data scientist roles with at least one year in a product context
What You'll Do
- •Own and extend offline eval suite across products including datasets, judges, and metrics
- •Build and maintain online quality dashboards with various performance indicators
- •Close the production feedback loop by analyzing failure patterns and proposing fixes
- •Harden evaluation methodology including judge stability and handling non-determinism
- •Translate data and metrics into actionable decisions through regular syncs
Nice to Have
- •Experience in quality analytics for ML systems such as ranking, recommendations, classification
- •Hands-on experience evaluating LLM applications including RAG, agents, tool use, judges
- •Experience building LLM agents through side projects or personal experiments
Benefits
- •Make a genuine impact on the product
- •Opportunities for continuous personal and professional development
- •Work flexibility with remote or hybrid model across Europe
- •Stock options program available to all team members
- •Supportive and eco-conscious corporate culture
- •Exclusive Work & Swim program in Cyprus
