Gijo Baby

Engineered ELT pipelines in Databricks (PySpark, Spark SQL, Delta Lake) with ADF/ADLS, improving throughput 40%. Built real-time Kafka/Event Hub → DLT pipelines with reliability 99.5%. Designed Delta Lakehouse, boosting reporting 70% and halving duplication. Implemented Unity Catalog governance for 6+ teams and CI/CD with GitHub Actions, cutting release cycles 30%. Led DataOps monitoring (+40% detection) and mentored engineers in ETL, PySpark, and SQL.

Designed and maintained ETL solutions integrating 10+ data sources into Data Warehouse/marts, boosting reporting efficiency 50%. Partnered with business teams to define requirements and ETL specs. Optimized workflows, SQL, and schedulers, reducing processing time 60%. Enabled parallel execution and workload balancing for faster reporting. Led data quality automation with validation frameworks and UNIX scripts, cutting manual effort 50% and improving reliability.

Designed and developed data warehouse solutions, translate business requirements into functional specifications using IBM Datastage, Teradata, Oracle, PL/SQL, Uniz Shell scripting, TWS. Optimized ETL architecture for improved performance and reliability. Tuned DataStage jobs and Teradata BTEQ to enhance system performance.

Leveraged DataStage, Netezza, SQL server, Unix Shell script tools to design, develop, test, and optimize data warehouse solutions and architecture. Developed reusable ETL components, automated DataStage deployments, and ensured efficient system recovery. Translate business requirements into functional specifications.

Gathered business requirements, conducted system analysis, and finalized technical specifications and high-level designs. Led data quality analysis, ETL mapping, design and development using Datastage, Netezza, PL/SQL, Unix shell scripts and supported testing phases, including SIT, UAT, and production deployment.

ETL development, from analysis and design to testing and deployment. Created technical documentations by ensuring business requirements and compliance.