Finom logo
    F

    Product Data Scientist — AI Evaluation & Quality

    Finom
    Estonia
    Remote
    Mid Level
    Full Time
    AIData ScientistProduct Data ScientistMachine LearningPythonSQLStatisticsRemoteHybridStock Options

    Requirements

    • •Proficient in Python and SQL with ability to build end-to-end analysis
    • •Solid foundation in statistics including sampling, hypothesis testing, variance, and understanding noisy metrics
    • •Analytical mindset starting from business questions rather than tools
    • •3+ years in analyst or data scientist roles with at least one year in a product context

    What You'll Do

    • •Own and extend offline eval suite across products including datasets, judges, and metrics
    • •Build and maintain online quality dashboards such as resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency
    • •Close the production feedback loop by mining failure patterns from real traffic and turning them into regression cases
    • •Propose fixes to Product and domain experts
    • •Harden methodology including judge stability and non-determinism handling
    • •Translate numbers into decisions through weekly syncs and clear trade-offs

    Nice to Have

    • •Experience in quality analytics for ML systems such as ranking, recommendations, classification
    • •Hands-on experience evaluating LLM applications including RAG, agents, tool use, judges
    • •Experience building LLM agents through side projects, toy builds, or personal experiments

    Benefits

    • •Make a genuine impact on the product
    • •Opportunities for continuous personal and professional development
    • •Flexibility to travel and work remotely or in a hybrid model across Europe
    • •Stock options program available to all team members
    • •Supportive, modern, friendly, and eco-conscious corporate culture
    • •Work & Swim program with one month stay in a corporate apartment in Cyprus

    About Finom

    Finom provides an online payment solution that integrates business accounts, invoicing, and accounting.

    Amsterdam, Netherlands
    500 - 1000
    Finance