a python developer- web&social crawling
as a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sourcess such as news agency,Telegram,..., cleanse it and build APIs on top of it
Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store this data
Work closely with Database Administrators to store data in SQL and NoSQL databases
Develop frameworks for automating and maintaining constant flow of data from multiple sources
Work independently with little supervision to research and test innovative solutions
:Skills and Qualificationsx
Strong coding experience in Python knowledge of Java, Javascripts is a plus
Experience with SQL and NoSQL databases
Experience with micro services, multi-threading and AWS/Azure
Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-Harvest and others