Aworkado
Lead Quality Engineer – Ai DeliverySales Consulting
Apply now

Lead Quality Engineer – Ai Delivery

  • Location: Romania
  • Workplace: Hybrid
  • Job type: Full Time
  • Posted: Posted

  • Lead quality engineering for enterprise-scale AI and GenAI solutions
  • Hands-on testing of LLM, RAG, and agentic applications
  • Strong automation skills in TypeScript, JavaScript, or Python
  • Hybrid role based in Cluj-Napoca

The Role

We are looking for an experienced Lead Quality Engineer – AI Delivery on behalf of our client, a global organization specializing in insurance, risk management, and professional services, to lead Quality Engineering across multiple AI delivery pods building enterprise-scale AI solutions.

Our client's engineering teams already operate within an established shift-left Secure SDLC, with core engineering, security, code quality, and pipeline controls embedded into delivery. This role builds on that foundation, ensuring each AI solution has an appropriate risk-based quality strategy, with particular focus on GenAI evaluation, end-to-end quality, UAT readiness, and release confidence.

You will work closely with Product Managers, Product Owners, Engineering Leads, Architects, and developers, combining strategic quality leadership with hands-on technical capability.

We will count on you to:

  • Lead Quality Engineering across multiple AI delivery pods and establish consistent, risk-based quality standards.

  • Partner with Product and Engineering to define test strategy, acceptance criteria, UAT approach, quality risks, and release-readiness criteria.

  • Ensure appropriate coverage across functional, integration, end-to-end, non-functional, AI-specific, and business acceptance testing.

  • Define testing and evaluation approaches for LLM, RAG, agentic, and AI-enabled solutions, including grounding, hallucination risk, regression, tool calling, workflow behaviour, and non-deterministic outputs.

  • Establish appropriate AI evaluation datasets, test harnesses, baselines, thresholds, and regression approaches.

  • Guide and, where needed, implement reusable automation across web, APIs, backend services, integrations, asynchronous workflows, and AI components.

  • Ensure products are ready for UAT, with appropriate test evidence, environments, test data, defect status, entry/exit criteria, and known risks.

  • Provide Pod Leads and programme leadership with clear quality metrics, risks, defect trends, AI evaluation results, UAT readiness, and release-readiness reporting.

  • Conduct quality reviews across pods and identify gaps in testing, testability, observability, or quality evidence.

  • Use production incidents, escaped defects, telemetry, and user feedback to continuously improve quality approaches.

  • Coach engineers and delivery teams to strengthen shared ownership of quality across the lifecycle.

What you need to have

  • Proven experience leading Quality Engineering for enterprise-scale AI / GenAI solutions in production.

  • Hands-on experience testing LLM, RAG, agentic, workflow-based, or AI-enabled applications.

  • Strong experience defining end-to-end test strategies, UAT approaches, quality gates, and release-readiness criteria.

  • Experience working across multiple delivery teams or pods in complex enterprise environments.

  • Strong software engineering and automation skills in TypeScript / JavaScript and/or Python.

  • Experience with modern automation frameworks such as Playwright, Cypress, Selenium, Jest, Mocha, or PyTest.

  • Strong experience testing web applications, APIs, backend services, integrations, and distributed systems.

  • Experience with AI evaluation frameworks, regression suites, test harnesses, and representative evaluation datasets.

  • Good understanding of CI/CD, cloud-native systems, observability, and Secure SDLC practices.

  • Strong stakeholder management skills and the ability to translate quality evidence into clear risks, metrics, and recommendations for leadership.

What makes you stand out

  • Experience with LangChain, LangSmith, Mastra, or similar AI engineering and evaluation tooling.

  • Experience testing complex RAG, multi-agent, or tool-calling solutions.

  • Experience with performance, resilience, accessibility, or security testing.

  • Experience using production telemetry and incidents to improve test and evaluation strategies.

  • Ability to balance strong quality controls with pragmatic, fast-moving AI delivery.

Technology context

Typical technologies include:

React, TypeScript, Node.js / NestJS, Python / FastAPI, REST APIs, async workflows, AWS / Azure, GitHub Actions / GitLab CI / Azure DevOps, LLM APIs, RAG, agentic workflows, LangChain, LangSmith, and Mastra.

Contact Malina Rosca Recruitment Specialist – HR

About Sales Consulting

As a leading provider of Human Resources consulting services in Transylvania, we deliver regional coverage and specialized expertise across four core areas: recruitment and selection, personnel leasing, assessment centers and HR consultancy. With a strong and consistent presence on the Romanian market, we continue to consolidate our position through a strategic commitment to continuous improvement and alignment with evolving business needs.

Our success is founded on the professionalism of our services, the multidisciplinary capabilities of our consulting team, and the long-standing partnerships we maintain with clients who rely on our support in navigating complex HR challenges.

We collaborate with organizations across a broad range of industries, including IT&C, automotive, outsourcing, pharmaceutical, banking, FMCG and others, building sustainable, long-term relationships that contribute to their organizational growth.

Guided by the principles of client orientation, teamwork, flexibility, excellence, dedication, and responsibility, we remain focused on delivering measurable value and consistently high-quality services to our partners.

Founded in 1998
Coworkers 130
Turnover 6M
Apply now

About the job

Location

Cluj-Napoca, Romania

Job type

Full Time

Workplace

Hybrid

Experience

Senior

Department

IT

First posted on

Sales ConsultingSales Consulting

#recruitment #consultancy #agency #HR #personnelleasing

Company size

51-200 employees

Founded in

1998

Industry

Human Resources Services

Headquarters

Cluj - Napoca

Social media

Company profileVisit salesconsulting.recruitmentagiler.com

Similar hybrid jobs

View all hybrid jobs
Mid-level
Full Time
Hybrid
Qualysoft
QualysoftPosted
Mid-level
Full Time
Hybrid
RON18-25K
Sectigo
SectigoPosted
Senior
Full Time
Hybrid
Logifuture
LogifuturePosted
Sutherland
SutherlandPosted
Senior
Full Time
Hybrid
Capgemini
CapgeminiPosted
SQLI
SQLIPosted