Navigation überspringen

Vimal Dharmalingam

Angestellt, Data Engineer, Airnow
London, Vereinigtes Königreich

Fähigkeiten und Kenntnisse

AWS
Python
Data Warehouse
SQL
ETL
Apache Spark
Big Data
GCP
Machine Learning
AI
Data Science
DevOps
Docker
Kubernetes
Engineering
Consulting
Technology
Business Intelligence
MySQL
Database
POWERBI

Werdegang

Berufserfahrung von Vimal Dharmalingam

  • Bis heute 2 Jahre und 10 Monate, seit Aug. 2022

    Data Engineer

    Airnow

    . Experience summary, Design and Implementation of Data Lake for cost efficiency and optimizing performance of Data lake resources • Handling and responsible for Petabytes Level Data lake • Responsible for all clients/ Stackholders, to maintaining the data pipelines • Write Dataflow pipeline using inbuilt spaghetti framework template for data ingestion from pub Pub-Sub to Big Query • Good Experience in GCP data architecture (working with GCP support team to build the robust solution for Petabyte data

  • 2 Jahre und 1 Monat, Aug. 2020 - Aug. 2022

    Data Engineer

    Swire Shipping pte Ltd

    • Creating Data Lake to hold ingested raw data from streaming device • Leading/Guiding Data team which is responsible for Digital Business Analytics platform and Cloud Data migration projects • Create Big Query tables for holding various state of data using ETL processes • Providing solution for data security including Data Lineage and Data Governance and MDM Data Extraction from (20 plus) unstructured/Structured sources to integrate into GCP/AWS Data lake using Pub/Sub Subscriptions and Kafka streaming

  • 8 Monate, Aug. 2019 - März 2020

    Data Engineer

    Govtech Agency Singapore

    • Design and Implementation of Data Lake Data Archival for cost efficiency and optimizing performance of Data lake • Data integration between different databases like SQL, Oracle, Redshift to create aggregates tables and Analytics solutions for a business stockholder • Deploying Cloud Functions using python languages to transform raw data into desired format & event driven tasks • Dataflow and Cloud Composer to build analytics pipeline in Google Cloud • Reporting: Using POWERBI for data visualization

  • 1 Jahr und 1 Monat, Juli 2018 - Juli 2019

    Data Science Engineer

    HOng Leong bank Berhad Malaysia

    • Worked as a python and SQL Data Engineer • PL/SQL Development and Implementation • Involved in writing complex Oracle SQL Queries to implement business requirements • Responsible for writing store procedure, functions, packages, trigger, collections • Report Scheduler delivers reports directly to management in various report formats • They can be scheduled to arrive daily, weekly, monthly, quarterly, or annually

XING – Das Jobs-Netzwerk

  • Über eine Million Jobs

    Entdecke mit XING genau den Job, der wirklich zu Dir passt.

  • Persönliche Job-Angebote

    Lass Dich finden von Arbeitgebern und über 20.000 Recruiter·innen.

  • 22 Mio. Mitglieder

    Knüpf neue Kontakte und erhalte Impulse für ein besseres Job-Leben.

  • Kostenlos profitieren

    Schon als Basis-Mitglied kannst Du Deine Job-Suche deutlich optimieren.

21 Mio. XING Mitglieder, von A bis Z