DevOps Engineer with AI/ML Evaluation Focus
Agilerobotsse
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
129 open evaluation roles across 42 companies are on ApplySarthi right now, most of them in Hyderabad (10), Bengaluru (5), Delhi NCR (2).
- Lead, Senior or Expert Test & Evaluation Engineer - PAC-3Boeing
- Thesis Work, 30/60 Credits - Digital twins for efficacy evaluation in clinical trialsAstrazeneca
- Senior Software Engineer, Metrics and Evaluation - Autonomous VehiclesNvidia
- Senior Data Analyst - AI Evaluation (Life Sciences).Relx · chennai
- Characterization / Evaluation EngineerAnalogdevices
What evaluation roles keep asking for: Python (43%), Machine learning (25%), LLMs (22%), C++ (18%), Observability (18%), SQL (15%), PyTorch (12%) — counted across their open postings here.
AWS jobs · Ansible jobs · Azure jobs · CI/CD jobs
Agilerobotsse has 17 open roles listed here.
- Technical Lead (m/f/d), Robotics & AI Software
- Senior Machine Learning Engineer (m/f/d) Computer Vision for Robotics
- Senior IT Security Engineer
- Senior Project Manager (all genders)
- Senior IT Infrastructure Engineer (m/f/d)
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for evaluation roles keep coming back to Python, Machine learning, LLMs, C++. Practise those questions before you sit with Agilerobotsse.
Questions you are likely to be asked
- Why do you want to join Agilerobotsse?
- What is your experience with Observability? Tell me one thing you learned the hard way.
- Walk me through a model you built, from the data to how it was used.
- How did you know your model was actually good, and not just good on your test set?
- Tell me about a time the data was messy or wrong. What did you do?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the DevOps Engineer with AI/ML Evaluation Focus at Agilerobotsse interview free →About the Position:
We are looking for an experienced, motivated mid-level professional for a dual role: classic IT DevOps responsibilities combined with the evaluation and support of AI/ML models and vendors. This position is a great fit for someone who wants to combine technical infrastructure expertise with an interest in current AI/ML developments. The role sits in internal IT and is not part of robotics product development. The two areas are not equally plannable: production operations take precedence, and AI/ML evaluation runs as project work around operational load.
Responsibilities :
- CI/CD, Automation & Software Development: Build, maintain, and improve CI/CD pipelines using GitLab CI and Jenkins; automate recurring operational processes; collaborate with development teams on deployment processes; develop small-scale internal software for IT and other internal departments; support software integrations, particularly Entra ID, Active Directory, and SSO.
- Cloud, Infrastructure & Operations: Manage and optimize AWS, Azure, and GCP infrastructure; use Infrastructure as Code (Terraform, Ansible), Docker and Kubernetes on select projects (not a global standard); operate the largely Linux-based landscape (approx. 80–85% Ubuntu), including patch/update management; ensure availability, scalability, security, monitoring, logging and alerting (Prometheus, Grafana, ELK); manage backup/disaster recovery and cloud cost optimization.
- Production Support & AI/ML Evaluation: Manage incidents and troubleshoot production environments (no on-call rota currently planned; if introduced, it will be agreed and compensated separately); evaluate AI/ML models and vendors (e.g. OpenAI, Anthropic, Google, Microsoft Azure AI) for performance, cost, suitability, cost-benefit, and licensing; evaluate open-weight/self-hosted models (e.g. vLLM, Ollama) where data residency, data protection, or cost requirements make external APIs unsuitable.
- AI/ML Testing, Integration & Support: Define objective AI/ML test criteria and benchmarks with the team lead; build and maintain evaluation datasets and re-run them after new model versions to detect regressions; support integration into existing systems/workflows, including RAG and agent tooling; act as first point of contact for technical AI/ML issues, providing first-level support and escalating to the team lead.
- AI Governance, Compliance & Enablement: Document model best practices, limitations, and use cases; track market developments; collaborate with business departments to identify new use cases; support compliance on data protection, security, and AI regulations, particularly the EU AI Act and GDPR (internal deployer-side use, not product conformity); train and enable internal staff on AI/ML tools, contributing to AI literacy under Art. 4 of the EU AI Act and internal AI governance/use guidelines
Your Profile:
- Completed degree in Computer Science, IT, or comparable professional experience
- 2 to 4 years of experience in a DevOps environment
- Hands-on experience with CI/CD tooling; both GitLab CI and Jenkins are in use
- Experience with at least one major public cloud (AWS, Azure, or GCP); all three are in use
- Solid experience operating Linux systems (Ubuntu), as the large majority of systems run on it
- Experience with containerization (Docker); Kubernetes knowledge is a plus, as it is used on a per-project basis
- Solid working knowledge of the core DevOps toolchain: Infrastructure as Code (Terraform, Ansible), scripting (Python, Bash), and monitoring, logging, and alerting (e.g. Prometheus, Grafana, ELK Stack)
- Basic knowledge or hands-on experience working with AI/ML models or APIs (e.g., LLM providers)
- An analytical mindset for objectively evaluating tools and vendors
- Strong communication skills for collaborating with technical and non-technical teams
- Fluent in English, spoken and written
What we offer
- A dynamic high-tech company, combined with financial soundness and world-class investors.
- Join an interdisciplinary, international team with 60+ different nationalities in a collaborative work environment.
- Lots of development opportunities as we continue to grow.
- Challenging tasks and impactful projects alongside experts that enable professional and personal growth.
- Corporate Benefits Program covering health, mobility, and learning for 100€ net per month.
- Modern office facilities with a rooftop terrace overlooking Munich, free drinks & fruits, and regular company events contribute to a good working environment
About us
Agile Robots SE is an international high-tech company based in Munich, Germany with a production site in Kaufbeuren and more than 3500 employees worldwide. Our mission is to bridge the gap between artificial intelligence and robotics by developing systems that combine state-of-the-art force-moment-sensing and world-leading image-processing technology. This unique combination of technologies allows us to provide user-friendly and affordable robotic solutions that enable intelligent precision assembly.
This is made possible by our employees, who bring out the best in each and every day with creativity and enthusiasm. Become part of this team and shape the future of robotics with us!
We are proud of our diversity and welcome your application regardless of gender and sexual identity, nationality, ethnicity, religion, age, or disability.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- Senior Mechanical Engineer - Robotic SystemsAgilerobotsse
- Forward Deployed AI EngineerAgilerobotsse
- C++ Software Engineer (m/f/d) Platform InfrastructureAgilerobotsse
- Software Engineer (m/f/d) Industrial Robot ControlAgilerobotsse
- (Senior) Technical Program Manager (m/f/d)Agilerobotsse
- (Senior) Electronics Engineer (m/f/d)Agilerobotsse
- Mechatronics and Hardware Test Engineer (m/f/d)Agilerobotsse
- Intern (m/f/d) Software Test AutomationAgilerobotsse
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹99 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on arbeitnow · posted 2026-10-14. ApplySarthi collects openings and links to application pages; the role is advertised by Agilerobotsse, not by us.