Ing. Amitesh Sahay

- Individual contribution to develop python programs - Create process documents to help internal employee for future reference. - Troubleshoot the on going coding issues. - Automate the movement of the files from central repository to Debian based production servers for Server automation that enables the L1/L2 support personal. Configured CI tools Jenkins and Docker for continues integration and code versioning.

1) Using Spark 1.6.1 & PySpark to provide BigData solutions to our client.2) work with client to understand current/future requirement on the data management, & provide blue print of the data flow, give presentation on the need.3) Use of HiveContext/SQLContext to bring data from RDBMS to Spark env, and apply various PySpark in-built functions to work with the data, and send them to HIVE4) Integration of HIVE/HBase.5) worked on 40 mn data into the Hadoop env, and working to manage 200 mn data in future.

Working as a Sr.Software developer for Hadoop Ecosystem.Work internally with the Sales, and Marketing team to understand the business requirements, and based on that code the MapReduce job in Java to meet the requirements. Also work on Hive, Pig, Sqoop. Implementation of Flume for streaming data. Work on the day today jobs that failed, not running in the hadoop environment. Do, have practical knowledge of HA Hadoop cluster, Excellent understanding of YARN.

 Managed and reviewed Hadoop log files.  creating Unix Hadoop cluster, and maintaining the Servers  Regular health check-up.  fine tuning the Hadoop Unix environment.  monitoring the Hadoop servers through HPOM.  Tested raw data and executed performance scripts.  Shared responsibility for administration of Hadoop, Hive and Pig

Provide application support for AMEX web application on Windows XP platform, troublshooting Internet connection issues on desktop.

computer Science& IT