Pavan Gadiya

- Responsible for delivering Data engineering solutions for Streaming and Cloud data lake platforms for NTT DATA clients. - Responsible for operating, developing, monitoring, configuring, performance tuning & administrating the streaming and data lake platforms based on Kafka, Kubernetes and AWS. - Resolved and rectified incidents based on various alerting and monitoring systems like Grafana, Prometheus etc. and provided root cause analysis.

- Responsible for monitoring, configuring, performance tuning & administrating the enterprise Hadoop environments. - Well versed with Hadoop distribution framework- Hortonworks Data Platform (HDP) & its various components (Apache Kafka, Apache Spark, Apache Hive, Apache HBase, Apache Ranger, Apache Flume, Apache YARN, Apache Oozie etc.). - Responsible for creating data pipelines between various external systems and Hadoop production system.

Experience Summary: - Developing, managing, monitoring & administrating the enterprise Hadoop environments. - Well versed with Hadoop distribution framework - Hortonworks Data Platform (HDP) & it's various components. - Creating the large, shared & multi-tenant Hadoop Clusters for POC, Development, Sandbox and Production environments - Scope and deliver various Big Data solutions - Coordination and close collaboration with other organizational teams

Worked with various Big Data Technologies (Hadoop Ecosystem, Apache Spark, Spark Streaming, Spark SQL, Hive, Impala, MapReduce, and Hadoop Cluster Setup). - Design and developed various Proof of Concepts (POCs) for large scale big data analytics and real-time data analytics to collect, store, process, analyze and reporting of the data. - Application development with Java, Scala, Python and Web languages. - Worked with the Relational databases (RDBMS) and In-Memory databases (IMDB).

- Development and enhancement of various Java/JEE Projects. - Well versed with Java/JEE technologies, JSP, Servlet, JDBC, Struts, JavaScript, XML, HTML and XHTML for end-to-end development. - Developed application with Oracle, PLSQL, MySQL and PostgreSQL. - Involved in requirement analysis, design, development, testing, debugging, client interaction, on-site coordination and deployment.

Distributed Systems & Applications, Middleware,Event Processing, Web Engineering,Peer to Peer & Grid Computing,Operating Systems,Mobile Sensing,Communications Networks,Software Engineering in Industrial Practice,Software Engineering : Design Patterns,Network Security,Database Management,SDN