Solution Architect - LangGraph & Agentic AI

We are looking for an experienced Solution Architect with hands-on experience designing and deploying LangGraph-based AI solutions to lead the architecture of enterprise agentic AI platforms and applications. You will work with business and technology stakeholders to identify high-value AI opportunities and translate them into secure, scalable, and production-ready architectures. The role combines AI architecture, enterprise integration, cloud engineering, agentic AI, security, governance, and stakeholder leadership . You will be expected to understand LangGraph at a practical level and be able to challenge architectural decisions, guide engineering teams, and ensure that AI solutions can operate reliably at enterprise scale. Requirements AI Solution Architecture Lead the architecture and design of enterprise AI agent and agentic workflow solutions . Design LangGraph-based architectures for single-agent and multi-agent applications. Translate business requirements, processes, SLAs, security requirements, and technical constraints into solution architectures. Evaluate architectural alternatives and document key technical decisions and trade-offs. Define reusable architecture patterns for agentic AI solutions. Enterprise Agent Architecture Design architectures incorporating: LLMs LangGraph RAG Enterprise data APIs and business systems Workflow engines Human approval processes Observability Security and governance Define appropriate boundaries between AI reasoning and deterministic business logic. Design state management, persistence, recovery, and long-running agent workflows. Determine when to use single-agent, multi-agent, or conventional application architectures. Cloud and Platform Architecture Design scalable AI application architectures on AWS, Azure, or GCP . Define compute, networking, storage, API, security, and platform requirements. Design architectures suitable for enterprise-scale production workloads. Evaluate cloud services and AI platform capabilities based on performance, security, scalability, and cost. Work with platform engineering and DevOps teams to establish deployment standards. Integration Architecture Design integration between AI agents and enterprise applications, APIs, databases, and SaaS platforms. Define secure mechanisms for agent tool access and business-system interactions. Design authentication, authorisation, secrets management, and access-control approaches. Ensure AI-driven actions are traceable, auditable, and appropriately governed. AI Security and Governance Establish security and governance principles for enterprise AI agents. Address risks including: Prompt injection Data leakage Unauthorised tool usage Excessive agent permissions Inaccurate or unsafe actions Sensitive-data exposure Define appropriate human-in-the-loop controls. Ensure solutions comply with organisational security, privacy, regulatory, and responsible-AI requirements. AI Evaluation and Observability Define architecture for AI application monitoring and observability. Establish approaches for evaluating agent accuracy, reliability, latency, cost, and task completion. Define appropriate logging, tracing, metrics, and alerting. Establish operational processes for monitoring and continuously improving production agents. Stakeholder and Technical Leadership Work directly with senior business and technology stakeholders to define AI strategies and roadmaps. Lead architecture workshops and technical design sessions. Communicate complex AI concepts and architectural trade-offs to technical and non-technical audiences. Provide technical direction to AI engineers, developers, data teams, and platform engineers. Review solution designs and ensure alignment with enterprise architecture standards. Mentor engineering teams and promote reusable AI architecture patterns. Required Experience Significant experience in solution architecture, software architecture, AI architecture, or a related role . Hands-on experience designing and deploying LangGraph-based AI applications or agentic workflows . Strong understanding of LLM application architectures. Experience with enterprise AI/ML solutions in production. Strong understanding of RAG, tool calling, agent orchestration, and human-in-the-loop patterns. Strong experience with at least one major cloud platform: AWS, Azure, or GCP . Strong understanding of enterprise integration patterns and APIs. Experience with security, governance, observability, and operational requirements for production systems. Strong technical understanding of Python and modern software engineering practices. Desirable Experience LangChain / LangSmith Multi-agent architectures Enterprise RAG platforms Vector databases Kubernetes Event-driven architectures Microservices Infrastructure as Code CI/CD MLOps / LLMOps AI security Responsible AI Large-scale enterprise transformation Experience working directly with senior client stakeholders Find more English Speaking Jobs in Germany on Arbeitnow