Dmitry Foshin

Designed and architected scalable data solutions to support new products and deployment in 30 markets, ensuring feasibility and technical alignment using Azure tech stack, Databricks, Spark, Synapse. Developed and maintained ETL pipelines using Python object-oriented programming, Databricks, ADF, Data Lake, Azure SQL DB, Event Hub, Azure Functions, Service Bus, Synapse, Azure DevOps, SFTP services, API. Conducted code review sessions with 4 vendor development teams to uphold code quality.

Led migration of data products from SQL Server to Microsoft Fabric along with data modelling and CICD. Built a Python package to improve and scale data engineering work within Synapse workspaces​. Maintained the backend database for global website locations page along with translations to 6 languages​.

Migrated the SSIS brand tracker solution to Synapse workspace along with data modelling. Refactored, ensured quality assurance, and maintained a critical pipeline that managed 60 tables and around 1 TB of data, resulting in more efficient data management and processing (Python, Databricks, Airflow, Cosmos DB).

Building and supporting global supply chain analytics platform. Designed and maintained ETL pipelines in Azure environment using Azure Data Factory, Data Lake, Data Flows, Databricks, Logic Apps, Azure SQL DB, Stored procedures, Visual Studio, Azure DevOps. Optimized the data pipelines: developed normalization of data model to star schema for better performance; partitioning for SAP data ingestion; reorganization of triggers.

Data engineering. Designed and created ETL procedures and data transformations in Databricks using PySpark and SQL, AWS, Athena engine, Airflow, CI/CD with GitLab. Visualization. Developed dashboards in Metabase and Periscope. Managed a team of 1 data engineer and 2 BI engineers. Successful migration from Periscope to Metabase. Anti-Money laundering process optimization. Created automated analytical dashboards for Operations, Compliance, Finance as well as for reporting to the Central Bank of Philippines.

Designed and created ETL procedures in Azure environment. Extracted data using Logic Apps, transformed with Data Bricks (Python, PySpark), automated data flows using Data Factory, prepared functional data marts using SQL database, CI/CD with Azure DevOps. Developed dashboards in Tableau and MS Power BI, developed functional and technical BI solution design recommendations and specifications, performed business analysis and solution prototyping. Managed a team of 1 data engineer and 2 BI developers.