Bhushan Gawade

Working on fetching file from Oracle GG(Golden Gate) and push that data into Kafka topic. Implementing Spark-Streaming to continuously streams the real-time data from Kafka topic and store into parquet files. Develop spark batch processing jobs to read the parquet files and insert the records into Hbase tables. Finally uses spark to read Hbase tables and creating indexes in Elastic search.

Developed Apache NiFi flow to read data from Hadoop edge node and put it to Kafka topic. • Developed apache spark-streaming code to read data from Kafka topic and push data into Cassandra. • Created a Cassandra table for data computation. • Wrote Spark code to read data from Cassandra tables. • Used spark-SQL, spark-dataset to perform data computation and store final computation result to Cassandra tables. • Schedule spark job through Oozie workflow engine.

• Understanding the Machine Attributes and its data. • Cleanse data and give it a proper structure in Pig • Load the data from Pig relations to Hive table for analysis using HCatalog. • Developed the Sqoop command in order to make the interaction between Hive and Mysql database. • Tested raw data and executed performance scripts.

Electronics and Telecommunication

Electronics and Telecommunication

Science, Mathematics, English