We are looking for an AI Engineer to join a project focused on building AI-powered solutions that support engineering teams in their daily development and testing activities.
You will work hands-on with LLM-based agents, agentic workflows, AI-assisted development, evaluation frameworks, and guardrails. A major area of the project is test automation, but the solutions you build will also support broader software development workflows.
You will have significant independence in designing and improving AI agents and their skills, while collaborating closely with QA/SDET and engineering teams. An important part of the role is taking a metrics-driven approach to AI quality, using evaluations and measurable results rather than relying only on subjective assessment of LLM outputs.
Your responsibilities:
- Design, develop, and maintain AI agents and subagents supporting engineering and test automation workflows.
- Build and orchestrate multi-stage agent workflows, including building, composing, analyzing, validating, and executing tasks.
- Develop reusable capabilities for agentic tooling, including documentation, helper scripts, templates, and agent skills.
- Build and maintain evaluation frameworks (evals) to measure agent quality, identify regressions, and continuously improve prompts and workflows.
- Design and implement guardrails and AI autonomy policies, including action classification such as allow / ask / deny.
- Work closely with QA/SDET teams to understand testing practices, code conventions, and API testing patterns.
- Support AI-assisted software development and test automation use cases.
- Iteratively improve AI solutions based on measurable results and feedback.
- Contribute to tooling around code generation, code understanding, and engineering knowledge.