Solution Architect - Generative AI (m/f/d)

Job Highlights

• AI Solution Architecture & Design
• Define & refine the architecture of enterprise-grade AI applications, ensuring scalability, security and maintainability
• Guide the design of RAG-based pipelines, AI agents and API-driven AI solutions
• Optimize prompt engineering and LLM interactions to improve response accuracy & relevance
• Ensure LLM security best practices, data privacy, operability and compliance within enterprise IT standards
• Use Case Evaluation & Technical Feasibility
• Assess incoming AI use cases from a technical feasibility & define clear technical requirements
• Work with stakeholders to set realistic expectations regarding AI capabilities, risks & limitations
• Technical Product Ownership & Development Collaboration
• Work as technical product owner, ensuring development team has clear guidance and well-defined objectives
• Maintain technical backlog, defining priorities, architectural guidelines & implementation roadmaps
• Coordinate with platform team for smooth AI deployment & lifecycle management
• Technology Trends & Innovation
• Monitor emerging AI technologies, frameworks & best practices
• Conduct & build PoCs & pilot projects to evaluate new technologies
• Collaboration with Data, Technology & Security Teams
• Work closely with AI engineers, data scientists & other solution architects to align on best practices
• Act as a bridge to other technology teams, ensuring smooth integration into enterprise applications
• Work with security teams to establish risk mitigation strategies for AI deployments

Requirements

• Experience working within Microsoft Azure AI services & SAP AI Core
• Familiarity with enterpise AI governance, security & risk management
• Knowledge of testing strategies for AI solutions, including performance & load testing
• Experience in secure AI architecture, including LLMs, LLM frameworks like LangChain, security concepts like JWT
• Strong hands on knowledge of Python
• Strong understanding of vector databases (Azure AI Search, FAISS) and their role in GenAI applications
• Expertise in software architecture
• Knowledge of REST APIs, system integration & enterprise IT environments
• Basic understanding of data modeling, ensuring AI solutions align with enterprise data structures
• Agile mindset with experience in product ownership, backlog management & structured AI delivery