Amarnath Pal

I’m a Data Engineer at Accenture specializing in Big Data and AI. I design and build ETL pipelines using AWS Glue, Lambda, and Athena for BI projects. I use PySpark and SQL for data transformation, optimize storage with S3 and Redshift, ensure data quality and security with IAM and KMS, and collaborate with data scientists to deliver efficient, accurate, and compliant data solutions.

At Nagarro, my role was to create and manage data pipelines for BI projects using AWS Glue, Lambda, and Athena. I used PySpark and SQL to write transformation code, optimized data storage with S3 and Redshift, ensured data quality and security with IAM and KMS, and collaborated with data scientists to deliver accurate, efficient, and compliant data solutions in Big Data and AI environments.