Dinesh kumar M

“Senior Data Engineer | Architected scalable data pipelines & cloud solutions using AWS, Databricks, Snowflake, Kafka/Zookeeper. Optimized ETL/ELT with PySpark & Airflow, automated workflows, managed CI/CD with Git/Terraform, ensured data quality & compliance, led cloud migrations, and built AI-powered chatbots for enhanced data access and user engagement.”

Built AI-driven & Generative AI chatbots (PDF/Markdown) using LangChain & Hugging Face. Engineered AWS Glue ETL pipelines with Python/PySpark, managed scalable cloud resources, optimized performance, ensured security/compliance, and established secure AWS connections with network ACLs, security groups, and gateways for robust enterprise data processing

Engineered cost-effective ETL workflows using AWS (EC2, Lambda, SQS, Cognito, Batch) and optimized API services with Python/Flask/SQLAlchemy. Revamped Python/Django modules, refactored legacy systems, and managed PostgreSQL, Oracle, SQL, and Genaro databases, ensuring reliable, high-performance data processing and seamless system integration.

Designed front-end interfaces and back-end logic for enterprise applications using Genaro tools. Developed stored procedures and database functions in Informix 4GL, ensured seamless system integration and data flow, conducted testing and troubleshooting, and provided ongoing maintenance and updates for reliable application performance.