Karan Naidu

Driving data & AI strategy across 4 Godrej BUs. Architected the unified Azure Medallion platform, saving > €50k annually. This involved optimizing 100+ Azure Data Factory pipelines, implementing cost-effective Azure Databricks models, and consolidating ADF instances (20 to 10), while establishing robust CI/CD processes and solving complex network issues. Launched a company-wide, voice & text enabled GPT-based LLM AI solution on internal data, ensuring enterprise-grade security.

Led development of 100+ ETL pipelines with Azure Data Factory & Databricks for a major US utility client. Increased data processing speed by 40% by transforming semi-structured data (XML, JSON, Parquet). Collaborated with 5+ teams on data infrastructure, ensuring scalability & security. Conducted SAP ISU data analysis for 100+ scenarios. Deployed Azure security & monitoring, optimizing costs by 20% and ensuring high data quality for key data platforms.

Engineered migration of 500 TB of data (HDFS to Azure Blob) using Azure Data Factory, achieving 99.7% accuracy. Optimized PySpark code for 30% faster data processing and implemented SCDs. Developed Python automation scripts, reducing manual effort by 40% and increasing data accuracy by 25%. Scripted Azure DevOps CI/CD pipelines with Jenkins for SAP data transformation, cutting manual intervention by 20%. Analyzed 50+ documents with data scientists using MS SQL stack (SSMS, SSAS).

Developed and implemented machine learning and natural language processing models to support the company’s new products, tools, and initiatives. Enhanced data analysis frameworks using text mining, natural language processing, and deep learning techniques to analyze collected data and generate insightful reports.