Senior Software Engineer Secure AI Infrastructure // Edgeless Systems
Senior Software Engineer Secure AI Infrastructure // Edgeless Systems
Senior Software Engineer Secure AI Infrastructure // Edgeless Systems
Senior Software Engineer Secure AI Infrastructure // Edgeless Systems
Edgeless Systems
Internet, IT
Berlin
- Art der Anstellung: Vollzeit
- 70.000 € – 99.000 € (von XING geschätzt)
- Hybrid
- Zu den Ersten gehören
Senior Software Engineer Secure AI Infrastructure // Edgeless Systems
Über diesen Job
Our product
Privatemode AI is our secure alternative to ChatGPT. It enables AI workflows with sensitive data by keeping all data encrypted—even during processing—using confidential computing. You can access it via a user-friendly app or a fully OpenAI-compatible API.
See for yourself: Most of our code is available on GitHub.
Our tech stack
- API: Go, Kubernetes
- RAG: Python, Qdrant
- Model hosting: Python, vLLM
- Scaling: pipeline/tensor parallelism, optimization for Nvidia H100 and B200
- Portal and app: TypeScript, React, Electron
Your mission
As part of our team, you’ll work on the Privatemode platform across frontend, backend, and model hosting. Tasks include:
- Extending our OpenAI-compatible API and confidential processing stack
- Building RAG features, embedding pipelines, and agent functionality
- Hosting and optimizing the performance of cutting-edge open-source LLMs
- Scaling models using parallelism and efficient GPU orchestration
- CI/CD automation and documentation
- Prototyping and iterating on new features
As a Senior Software Engineer, you also help less experienced team members with their personal development.
Your profile
We are looking for team members who…
- have outstanding technical capabilities
- are experienced in a relevant subset of the technologies outlined above
- are excited about the challenges of a fast-paced, innovative startup environment
- are experienced in professional agile software-development practices
- are inherently motivated to deliver high-quality work
Why Edgeless Systems?
- Competitive compensation (€80k-€120k + stock options)
- Opportunity to learn and grow within an outstanding team
- Flexible working arrangements—remote or in our offices in Bochum and Berlin
- Exciting tasks in a dynamic environment