Senior Software Engineer (Backend/LLM Infrastructure)

Senior Software Engineer (Backend/LLM Infrastructure)

Senior Software Engineer (Backend/LLM Infrastructure)

Senior Software Engineer (Backend/LLM Infrastructure)

Routine Labs

Sonstige Dienstleistungen

Berlin

  • Art der Beschäftigung: Vollzeit
  • 63.000 € – 77.000 € (von XING geschätzt)
  • Vor Ort

Senior Software Engineer (Backend/LLM Infrastructure)

Passt der Job zu Dir?

Mit einem XING Profil siehst Du gleich, welche Deiner Fähigkeiten und Wünsche konkret zum Job passen. Damit Du Dich nicht nur im Home-Office wie zuhause fühlst.

Jetzt anmelden und herausfinden

Über diesen Job

At Routine Labs, we are building Europe's first secure, auditable, and EU-compliant automation infrastructure for legacy systems. We're taking a practical approach to improving how engineers work with AI systems. Combining LLMs with familiar software engineering methods to make it easier for people to build, modify and maintain software automations. Our platform lowers the effort required to turn natural-language instructions into deterministic, testable code that can interface with and automate legacy systems.

We’re hiring a Senior Software Engineer (Backend/LLM Infrastructure) to build and operate the backend services and LLM pipelines that make this automation fast, reliable, and production-ready.

Tasks

  • Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
  • Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
  • Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
  • Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
  • Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
  • Participate in on-call rotations, incident response, and continuous improvement of production systems.

Requirements

  • 4–6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
  • Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
  • Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.
    Solid SQL, Redis, and background job experience.
  • Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
  • Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.

Join the team shaping the technical foundation of a company redefining how legacy software gets automated.

We value diverse perspectives and welcome candidates of all genders, identities and backgrounds.

Gehalts-Prognose

Ähnliche Jobs

Senior Backend Engineer / Developer

acemate.ai

Berlin + 0 weitere

53.000 €79.000 €

Senior Backend Engineer / Developer

Berlin + 0 weitere

acemate.ai

53.000 €79.000 €

Senior Software Engineer / Developer

acemate.ai

Berlin + 0 weitere

52.000 €77.500 €

Senior Software Engineer / Developer

Berlin + 0 weitere

acemate.ai

52.000 €77.500 €

Senior Backend Engineer (m/f/d) - Search Engine - onsite in Hamburg or Berlin

ABOUT YOU Holding SE

Berlin + 0 weitere

55.000 €68.000 €

Senior Backend Engineer (m/f/d) - Search Engine - onsite in Hamburg or Berlin

Berlin + 0 weitere

ABOUT YOU Holding SE

55.000 €68.000 €

Backend Engineer (m/f/d) - Search Engine - onsite in Hamburg or Berlin

ABOUT YOU Holding SE

Berlin + 0 weitere

48.000 €61.000 €

Backend Engineer (m/f/d) - Search Engine - onsite in Hamburg or Berlin

Berlin + 0 weitere

ABOUT YOU Holding SE

48.000 €61.000 €

Backend Engineer (m/f/d) - Recommendation - onsite in Hamburg or Berlin

ABOUT YOU Holding SE

Berlin + 0 weitere

49.500 €60.000 €

Backend Engineer (m/f/d) - Recommendation - onsite in Hamburg or Berlin

Berlin + 0 weitere

ABOUT YOU Holding SE

49.500 €60.000 €

Senior Backend Engineer (f/m/x) – Operations and Client Services

Deutsche Bank AG

Berlin + 0 weitere

60.000 €77.500 €

Senior Backend Engineer (f/m/x) – Operations and Client Services

Berlin + 0 weitere

Deutsche Bank AG

60.000 €77.500 €

Senior Backend Engineer - Golang

Staffbase GmbH

Berlin + 0 weitere

61.000 €77.000 €

Senior Backend Engineer - Golang

Berlin + 0 weitere

Staffbase GmbH

61.000 €77.000 €

Senior Backend Engineer (m/f/d) - Product Sorting - onsite in Hamburg or Berlin

ABOUT YOU Holding SE

Berlin + 0 weitere

55.000 €73.000 €

Senior Backend Engineer (m/f/d) - Product Sorting - onsite in Hamburg or Berlin

Berlin + 0 weitere

ABOUT YOU Holding SE

55.000 €73.000 €

Backend Engineer - Customer Risk Lifecycle

N26 GmbH

Berlin + 0 weitere

58.500 €80.000 €

Neu · 

Backend Engineer - Customer Risk Lifecycle

Berlin + 0 weitere

N26 GmbH

58.500 €80.000 €

Neu ·