Finom logo
    F

    Product Data Scientist — AI Evaluation & Quality (Remote)

    Finom
    Barcelona
    Remote
    Mid Level
    Full Time
    AIData ScienceProduct Data ScientistRemotePythonSQLStatisticsMachine LearningLLMQuality Analytics

    Requirements

    • •Proficient in Python and SQL for end-to-end analysis
    • •Solid foundation in statistics including sampling, hypothesis testing, and variance
    • •Analytical mindset focused on business questions
    • •3+ years experience in analyst or data scientist roles with at least one year in a product context

    What You'll Do

    • •Own and extend offline eval suite across products including datasets, judges, and metrics
    • •Build and maintain online quality dashboards with various performance indicators
    • •Close the production feedback loop by analyzing failure patterns and proposing fixes
    • •Harden evaluation methodology including judge stability and handling non-determinism
    • •Translate data and metrics into actionable decisions through regular syncs

    Nice to Have

    • •Experience in quality analytics for ML systems such as ranking, recommendations, classification
    • •Hands-on experience evaluating LLM applications including RAG, agents, tool use, judges
    • •Experience building LLM agents through side projects or personal experiments

    Benefits

    • •Make a genuine impact on the product
    • •Opportunities for continuous personal and professional development
    • •Work flexibility with remote or hybrid model across Europe
    • •Stock options program available to all team members
    • •Supportive and eco-conscious corporate culture
    • •Exclusive Work & Swim program in Cyprus

    About Finom

    Finom provides an online payment solution that integrates business accounts, invoicing, and accounting.

    Amsterdam, Netherlands
    500 - 1000
    Finance