Ähnliche Jobs

Forward Deployment Engineer

IndustrialMind.ai

München + 0 weitere

Forward Deployment Engineer

München + 0 weitere

IndustrialMind.ai

Softwarearchitekt*in und Softwareentwickler*in (all genders) im Bereich BigData

LexCom Informationssysteme GmbH

München + 0 weitere

Softwarearchitekt*in und Softwareentwickler*in (all genders) im Bereich BigData

München + 0 weitere

LexCom Informationssysteme GmbH

Externes Job-Angebot. Von einem Partner.

Senior Softwarearchitekt (m/w/d) AI & Machine Learning

univativ

München + 0 weitere

Externes Job-Angebot. Von einem Partner.

Senior Softwarearchitekt (m/w/d) AI & Machine Learning

München + 0 weitere

univativ

Forward Deployment Engineer

München + 0 weitere

IndustrialMind.ai

Forward Deployment Engineer

München + 0 weitere

IndustrialMind.ai

Softwarearchitekt*in und Softwareentwickler*in (all genders) im Bereich BigData

München + 0 weitere

LexCom Informationssysteme GmbH

Softwarearchitekt*in und Softwareentwickler*in (all genders) im Bereich BigData

München + 0 weitere

LexCom Informationssysteme GmbH

Externes Job-Angebot. Von einem Partner.

Senior Softwarearchitekt (m/w/d) AI & Machine Learning

München + 0 weitere

univativ

Externes Job-Angebot. Von einem Partner.

Senior Softwarearchitekt (m/w/d) AI & Machine Learning

München + 0 weitere

univativ

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Certivity

Internet, IT

München

    Art der Beschäftigung: Vollzeit
    71.000 € – 110.000 € (von XING geschätzt)Vor OrtAktiv auf der Suche

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Über diesen Job

About the Job

We build and operate large-scale web crawling and extraction systems that turn unstructured, dynamic websites into clean, structured and correct data. You'll own crawlers end-to-end: discovery, resilient fetching against real anti-bot defenses, and turning HTML/PDF into trustworthy structured output.

What you will do


  • Build and scale crawlers that handle dynamic, large-scale sites, and keep them running as those sites change and fight back.
  • Stay ahead of anti-bot measures: TLS/browser fingerprinting, proxies, session and rate-limit strategy, and change detection.
  • Turn raw HTML and PDF into clean, correct structured data (including LLM-assisted extraction), where silently wrong output is worse than a crash.
  • Design and operate pipelines for ingestion, deduplication, versioning and enrichment.
  • Ship and run containerized apps in the cloud, with CI/CD.
  • Shape our technical architecture and engineering culture.

Our Tech Stack

Python, Docker, GCP (Cloud Run jobs), Azure Blob Storage, MongoDB. Go services and a React frontend on the periphery. You don't need all of it on day one, but you do need to ramp up fast.

Your profile

  • 3+ years of professional software development (5+ for the senior track).
  • Strong Python: real production code, async.
  • Hands-on web scraping at scale, including firsthand experience with anti-bot defenses and the failure modes of large-scale collection.
  • A data-correctness mindset: you care that extracted data is right, not just that the job finished.
  • Docker, at least one major cloud (GCP, Azure or AWS), Git and comfort on the CLI.
  • A clear communicator who works well in a small, fast-moving team.

Nice to have:

  • LLM-assisted extraction or other work with LLMs, ML pipelines or data labeling workflows.
  • Go or Java/Spring Boot.
  • Frontend (React), or eagerness to pick it up.
  • Terraform, Kubernetes and modern DevOps tooling.

Why us?

  • A vibrant in-office culture in Munich, with the option to work from home up to 60% of the time.
  • Flexible working hours.
  • 30 vacation days per year (including 4 "company rest days" over Christmas).
  • 30 days of "workation" per year, within the EU and selected countries.
  • High autonomy and flat hierarchies.
  • EGYM Wellpass for unlimited access to fitness courses and gyms.
  • Udemy access for online courses.
  • Company pension scheme (bAV) with our partner Ginkgo

Closing

Certivity is an equal opportunities employer. We are committed to equal employment opportunities regardless of race, religion, sexual orientation, age, marital status, disability, or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning your sexual orientation.

Gehalts-Prognose

Ähnliche Jobs

(Senior) AI Engineer - Kotlin, Java, TypeScript (m/w/d)

KA Resources

München + 0 weitere

(Senior) AI Engineer - Kotlin, Java, TypeScript (m/w/d)

München + 0 weitere

KA Resources

(Senior) AI Engineer - Kotlin, Java, TypeScript (m/w/d)

KA Resources Recruitment SLU

München + 0 weitere

(Senior) AI Engineer - Kotlin, Java, TypeScript (m/w/d)

München + 0 weitere

KA Resources Recruitment SLU

Senior Python Backend Engineer (m/w/d)

Peak One GmbH

München + 0 weitere

Senior Python Backend Engineer (m/w/d)

München + 0 weitere

Peak One GmbH

Senior AI Engineer (f/m/d)

Instaffo GmbH

München + 0 weitere

Senior AI Engineer (f/m/d)

München + 0 weitere

Instaffo GmbH

Senior Fullstack Engineer (LLMs & AI Agents)

Tappz GmbH

München + 0 weitere

Senior Fullstack Engineer (LLMs & AI Agents)

München + 0 weitere

Tappz GmbH

Senior Software Engineer – Document Ingestion & Extraction (m/f/d)

Certivity

München + 0 weitere

Senior Software Engineer – Document Ingestion & Extraction (m/f/d)

München + 0 weitere

Certivity

Senior Python Backend Engineer - AI Service Operations (all gender)

ALTEN Consulting Services GmbH Nürnberg

München + 0 weitere

Senior Python Backend Engineer - AI Service Operations (all gender)

München + 0 weitere

ALTEN Consulting Services GmbH Nürnberg

AI Software Development Engineer - Neuromorphic Computing (m/f/d) (Fixed-Term)

Intel Deutschland GmbH

München + 0 weitere

AI Software Development Engineer - Neuromorphic Computing (m/f/d) (Fixed-Term)

München + 0 weitere

Intel Deutschland GmbH

Machine Learning Engineer - MLOps & Platform Engineering (M/F/D)

Loyalty Partner GmbH

München + 0 weitere

Machine Learning Engineer - MLOps & Platform Engineering (M/F/D)

München + 0 weitere

Loyalty Partner GmbH