Md Kamrul Hasan

- Deploying and maintaining different data project with GCP stack(using Google Kuberenetes Engine), Terraform, CI/CD with Jenkins close collaboration with DevOps team. - Building and Maintaining the DataOps & MLOps platform for Oetker Digital Data & Insight Team. - Writing efficient, scalable data pipelines using Airflow, Spark, DBT, Python, GE and Java. - Taking ownership of the different data product. - Writing clean, efficient code with industry best practice and regular code review with peers.

- Helped to make Data Modelling for the Warehouse(Redshift), Glue, S3 - Extended and Completed the ETL workflow with AWS Managed Airflow, GE, Jinja, Python, SQL - Ensured data quality, accuracy, and performance in all processes - Support with Views to build a dashboard in AWS QuickSight.

- Working mostly as a Data Engineer - Building ETL pipeline for various machine generated data using AWS S3, RDS, Databricks, Spark and Airflow. - Creating Data processing pipeline using Databricks, Scala and Python. - Implementing ML/DL algorithms using Databricks MLflow, Spark UDF to analyse data and reporting with PowerBI. - Using Git for Version Control integrated with Databricks

- Building ETL for Google Analytics API, Amazon MWS, and Advertising API, and BBG Web Shops. - Maintaining the existing Projects and working on new migration projects in Azure. - Creating & Maintaining the existing ETL (Python Django ORM, Airflow, Postgres, REST)

- Research & Developing metrics for the medical machine learning domain. - Developing graph-based AI/ML applications with GoLang, Python, Rest API. - Creating & manipulating Synthetic Data using GAN, ML. - Developing Clustering, Prediction, Recommendations with Machine Learning Models - Writing complex SQL query, MS SQL server store procedures & ETL Pipeline using PySpark, Jupyter, Airflow, Vilua Data Warehouse. - Creating & Visualizing Clustering-based automaton/graph with Dashboard, R-Shiny App.

- Working in Human-centred Computing(HCC) Lab in research and Development area - Designing Cognitive Artificial Intelligence Model with Neural Network with Java and Python - ETL Process for batch data collected from Amazon MTurk using PySpark, SQL and Google Cloud Platform BigQuery - Creating, Cleaning different Dataset using MTurk and Pandas, Sci-kit. - Training and evaluating the model

- Distributed Computing with Deep Learning, Machine Learning - Deploying Deep Learning Model with Apache Flink and Kuberernets - Dataset Manipulation, Designing and Training Deep Learning Model with Python and Java (Tensorflow and Keras, DeepLearning4j) - Designing library for Apache Flink for Deep Learning with Java

Maintenance of the existing server(FreeNas OS) -keep the website update and add new features to website(Typo 3)  Updating the security of current server and setting up new server, Solved various hardware related problem. Developed Open Source Data management System with Ckan, Researched and updated all required materials needed for Institution and employees.

Embedded System Programming, Robot manipulation and programming(C++,Python) Object Recognition with Computer Vision(C++,Python) - Gazebo, Blender, OpenCV , Caffe Completed a range of simultaneous job tasks to support professor’s academic, research and operational needs.

Computer Vision