Senior QA Automation Engineer – AI Applications  UK

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience
• 5+ years of professional experience in software quality assurance, test automation, or software engineering
• Strong programming skills in Python, with experience in test automation
• Hands-on experience using AI-powered testing tools or AI coding assistants
• Experience with CI/CD tools and processes
• Proficient in automation and UAT test suites/frameworks
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills
• Understanding of software architecture and design patterns
• Ability to work in an Agile development environment

Nice to Haves

• Experience testing AI/ML applications or validating machine learning models
• Experience with data validation tooling or labeling workflows
• Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
• Experience with data pipelines and orchestration tools
• Knowledge of MLOps practices
• Knowledge of ML evaluation methods, metrics, and benchmarking
• Passion for learning new technologies and improving existing systems

What You'll Be Doing

• Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets
• Automate QA workflows using Python and CI/CD
• Create and maintain test harnesses for AI services, applications, and APIs
• Perform API testing for AI services and backend systems
• Define quality strategy and acceptance criteria for AI-powered applications
• Test AI/ML applications and machine learning models
• Evaluate AI/ML model outputs and define structured rubrics
• Build quality gates for CI/CD and deployment pipelines
• Mentor teams on QA automation best practices and code quality
• Participate in code reviews and share findings and ideas

Perks and Benefits

• Salary transparency
• Belonging culture at Autodesk