Rashid aziz

• Design system architecture for data pipeline • Data Scraping, Crawling, parsing or other data mining • Develop Scrapers, Crawlers and integrate with model pipeline • Extracting data using multithreading & multiprocessing • Use Django framework for Rest APIs • Handle Linux servers for deploying crawlers and models • Troubleshooting application issues & analyzing production issues • Use code versioning tools like Git • Write Python scripts for data transformations

• Design and Build ETL pipelines • Data Scraping, Crawling, parsing or other data mining • Develop Scrapers, Crawlers and integrate with model pipeline • Develop a Distributed Web Crawler using scrapy framework • Extracting data using multithreading & multiprocessing • Use Django framework for Rest APIs • Processing, cleansing, and verifying the data used for analysis • Work with SQL and NoSQL databases, such as Elasticsearch, MySQL and Redis • Use code versioning tools like Git