sirisha chennam

Here we have used Azure functions to create the http triggers, timer triggers for scheduling the scripts. Azure logs to track the web usage. I have developed python scripts, to analyze the logs. how users are using spire website (logins, new users) and for what they are searching. After gathering all this data, we process it to visualize it on the analytics page of spire website. In Aflatoxin, we are automating all the manual process to auto fill the SQL tables. we created the python scripts in data bricks.

Developed python scripts to fetch the data through API’s, web-scraping. Cleansed all the messy nested Json data, converted some of the data from unstructured format to structured format. We have used S3 as the storage space to our data. Developed SQL scripts to handle the data and to create the views. Used ReactJS to create the website for Gridiron exclusively. This website is designed for clients to access the backend data easily. According to their specific search it gives them the backend data.

Developed a power shell script to transfer data from linux server to AWS S3. Built data pipelines using Jenkins tools. Extensively used collibra as a metadata repository. Worked on Airflow DAGs to schedule jobs. Developed python scripts to make custom Airflow DAGs. Developed a Pyspark script to pre-process json data. Power BI for data visualization. Experience in writing Spark applications to test data reliability between aws s3 and hive table data load, once after loaded data from s3 to hive.

Worked for Banking data analysis. Extracted data from Cosmos cloud storage in csv format Used different sqoop scripts to transfer incremental data from RDBMS to HDFS. Involved in converting SQL queries into Hive/Spark SQL quieries. Used different tools for data integration with different databases and Hadoop. Played a major role in converting a traditional RDBMS project into Hadoop project. Developed dashboard using Power BI.