Vilnius
Remote
Senior
Full Time
AIData ScienceRemoteSeniorPythonSQLMachine LearningLLM
Requirements
- •Proficient in Python and SQL with ability to build end-to-end analyses
- •Solid foundation in statistics including sampling, hypothesis testing, variance, and understanding noisy metrics
- •Analytical mindset starting from business questions rather than tools
- •3+ years experience in analyst or data scientist roles, with at least one year in a product context
What You'll Do
- •Own and extend offline evaluation suite across products including datasets, judges, and metrics
- •Build and maintain online quality dashboards tracking resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency
- •Close the production feedback loop by mining failure patterns from real traffic and turning them into regression cases
- •Propose fixes to Product and domain experts based on evaluation results
- •Harden evaluation methodology including judge stability and non-determinism handling
- •Translate evaluation numbers into decisions through weekly syncs and clear trade-offs
Nice to Have
- •Experience in quality analytics for ML systems such as ranking, recommendations, classification
- •Hands-on experience evaluating LLM applications including RAG, agents, tool use, judges
- •Experience building LLM agents through side projects, toy builds, or personal experiments
Benefits
- •Make a genuine impact on the product
- •Opportunities for continuous personal and professional development
- •Work flexibility with remote or hybrid model across Europe
- •Stock options program available to all team members
- •Supportive and caring corporate culture
- •Work & Swim program with one month stay in Cyprus
About Finom
Finom provides an online payment solution that integrates business accounts, invoicing, and accounting.
Amsterdam, Netherlands
500 - 1000
Finance