Cloud Data Engineer (m/f/d) – Azure Databricks

remote type

Hybrid

time type

Vollzeit

posted on

Vor 16 Tagen ausgeschrieben

job requisition id

JR100439

Within BayWa r.e.’s Operations Business, we maintain and operate an asset fleet of more than 10GW of Wind & PV installations globally. We service these assets with 800+ technical and commercial colleagues, organized in local country organizations in our different markets. Our focus is to optimize the performance and longevity of each asset while ensuring the safety of our people, for both our internal and external customers.

Within Operations Business Segment, BayWa r.e. Data Services GmbH is expanding its offerings in the fields of data acquisition, SCADA services, 24/7 monitoring and data utilization as a foundation for safe operations and optimized asset performance, as well as for providing employees and customers with the best data base for adopting digital solutions.

About the role

As a Cloud Data Engineer (m/f/d) – Azure Databricks you will be contributing to operate , optimize , and further development our Lakehouse data platform for operational data of renewable energy powerplants. The ideal candidate is passionate about large data processing with strong focus on quality, time series, cloud and modern data platform architecture .

This position can be located in one of our German offices in Munich, Mainz, Hamburg or Freiburg.

What You Will Do

• You will be responsible for designing, developing and maintaining scalable solar and wind park data pipeline s in our Microsoft Azure Cloud and Databricks data platform.

• You will d evelop and maintain robust data model providing data to machine learning and data analytics experts base d on our Lake House architecture

• You will oversee unifying batch and streaming data pipeline ensuring data consistency across various source and target systems

• You will implement data quality framework , validation processes, test suite s and monitoring solution to maintain high quality standard across code, data and workflows .

• You will leverage a full suite of tool and platform including Azure, Databricks, Delta Lake, DevOps with a strong focus on t ime s eries data.

What you’ll need to succeed

• You have around 5 years of professional experience in data engineering, with a strong foundation in data architecture, cloud data platforms, and specifically Azure and Databricks.

• Y ou’ve a strong track record on building and maintaining large datasets, code first data pipelines, data models and multi - layers data infrastructure .

• You’ve proven expertise working with the Lake House architecture, the Delta format and related big data analytics format.

• You are proficient in Python , SQL and Spar k .

• You have a strong expertise on software engineering best practices, Dev O ps operations , CI/ CD and test-driving development .

• You have g ood communication skills in English .

What’s in it for you?

• Being part of a highly motivated ever-growing and multicultural team that drives forward the energy revolution

• Innovative and fast-changing market and working environment

• Mobile working

• Flexible working hours

• Modern office atmosphere

• Company restaurant / Barista bar

• Discounted Conditions Fitness

• Discounted Online Shopping

If you are interested in further career opportunities within our Solar Trade business, please click here: BayWa r.e. I Stellenangebote (baywa-re.com)

Wir bei BayWa r.e . sind Weltmeister im Bereich der erneuerbaren Energien.

Gemeinsam werfen wir einen neuen Blick darauf, wie Strom erzeugt, gespeichert und genutzt wird, um den Herausforderungen des Klimawandels zu begegnen.

Mit über 5 GW an umgesetzten Energieprojekten und 10,5 GW an erneuerbarer Energie unter unserer Leitung sind wir weltweit erfolgreich.

Mach mit und hilf uns, die Welt zu verändern.

Erfahre mehr über den Arbeitsalltag bei BayWa r.e.