Lisbon Portugal•TELECOMMUTE•Lisbon, Lisbon, Portugal
Remote
Mid Level
Full Time
remoteautomationAIquality engineeringPlaywrightCI/CDGitHub Actions
Requirements
- •Strong software engineering fundamentals with ability to review, validate and debug code across modern programming languages
- •Strong experience with modern test automation frameworks, preferably Playwright
- •Demonstrated ability to use AI coding agents as primary development partner for code generation, review, debugging, refactoring, and maintenance
- •Comfortable delegating significant portions of implementation work to AI agents while maintaining high engineering and quality standards
- •Experience building and maintaining scalable automation frameworks
- •Experience integrating automated test suites into CI/CD pipelines using GitHub Actions or similar platforms
- •Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows
- •Proven track record of increasing automation coverage, reducing manual effort, and improving software quality outcomes
- •Strong understanding of quality engineering principles, test strategy, risk analysis, and defect prevention
- •Comfortable working as an embedded engineer within cross-functional product squads
- •Strong communication skills with ability to provide concise, actionable updates and collaborate effectively
- •Curiosity, adaptability, and growth mindset toward emerging AI technologies and engineering practices
What You'll Do
- •Design risk-based test strategies for new features and releases
- •Convert test strategies into automated coverage using AI-assisted development workflows
- •Use AI coding agents as primary development environment to generate, scale, and maintain automated test coverage
- •Build and maintain automated test suites using Playwright integrated within GitHub CI/CD pipelines
- •Design and implement agentic testing workflows using AI models and APIs
- •Build reusable frameworks, utilities, shared libraries, and AI-powered tools to increase test authoring velocity
- •Partner with engineers, product managers, and designers to shift quality left and influence requirements and design decisions
- •Continuously improve test suite health by reducing flakiness and increasing execution speed
- •Drive quality upstream by identifying risks early and implementing preventative quality practices
- •Own and improve quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence
- •Enable developers to write, execute, and maintain automated tests as part of their daily workflow
Nice to Have
- •Experience testing AI-powered products, agents, or LLM-based applications
- •Experience designing evaluation frameworks for AI-generated outputs
- •Familiarity with prompt engineering, AI quality assessment, and AI observability
- •Experience with performance, load, or resilience testing
- •Experience with test management platforms integrated with Jira
- •Experience building internal developer platforms, testing tools, or engineering productivity solutions
