A dynamic team with plenty of freedom to pursue your own career plans and development goals in an attractive industry awaits you.

Software tester for AI-based systems (m/f/d)

(Focus: Testing AI systems, e.g., LLMs, ML models, agent systems)

Are you seeking new challenges and a long-term opportunity?

Would you like to develop professionally and personally while contributing your energy to a dedicated team?

If so, we invite you to join us!

AVABIS is an IT consulting company. Our focus is on software development and software testing. Our primary clients consists of market leaders across the automotive, e-commerce, healthcare, telecommunications, and transportation & logistics industries.

Headquartered in Dortmund with an office in Berlin and project sites throughout Germany, we remain consistently accessible and close to our clients. We also manage a software lab dedicated to supporting our clients in the development and deployment of innovative, modern solutions.

We offer you

An interesting working environment with a modern corporate culture and very flat hierarchies.

As well as

• Reliability and loyalty with mutual trust
• An overtime account and 1:1 time off in lieu
• Flexible working from home (depending on role and project)
• Very good further training measures
• A company pension scheme
• Private railcard use, company car or bicycle (depending on the job)
• Regular group and company events
• And last but not least: Good money for good work

At AVABIS, you can also expect access to an exciting growth market.

Your tasks

As a software tester (m/f/d) with a focus on testing AI-based systems, you will take on challenging tasks such as

• Quality assurance for generative AI systems – from agent architectures to LLM-based workflows
• Development of test strategies for non-deterministic systems – bias, hallucinations, robustness, explainability
• Execution of adversarial testing – jailbreaking, prompt injection, security and data protection testing
• Automation of AI-based tests with modern tools for model monitoring, regression testing and drift detection
• Collaboration with data scientists, developers and product teams to ensure testability of AI systems
• Evaluation of new AI testing tools and best practices -Your expertise shapes the testing process

Your profile

Personality & mindset

• Innovative spirit – you enjoy developing new test methods for AI
• Analytical acuity – you recognize patterns, weaknesses and new risk scenarios in AI models
• Curiosity & willingness to learn – AI testing develops quickly, you stay up to date

Methodical skills

• Exploratory & heuristic testing – classic test concepts are not enough, you think ahead
• AI security analysis – you know common attack patterns on LLMs and develop defense tests
• Experience with AI metrics – you can evaluate AI performance: fairness, explainability, robustness

Technical know-how & tools

• Experience with test automation & CI/CD for AI models
• Experience with frameworks for LLM testing (e.g. DeepChecks, AI Fairness 360, LangTest)
• Optional: Knowledge of MLOps & model monitoring (e.g. Weights & Biases, MLflow)

Very good command of German and English

Your prospects

You can expect interesting and challenging projects with us.

Your prospects with us lie above all in your professional development. Step by step, you will reach new levels of competence with us, be it through suitable certification, high-quality online courses, literature or other individual methods. By taking the individual strengths of each person into account in the best possible way and promoting them through targeted development, everyone can unleash their own potential. Our virtual AVABIS Campus is also available for know-how transfer.

Does that sound interesting to you? Then we look forward to receiving your application!

bewerbung@avabis.de

Your contacts in HR management will be happy to help you.