استخدام Data Engineer
شرح موقعیت شغلی
Farabi Brokerage/Soshyant Financial Tech Company is Hiring:
Currently, the company is in the process of launching a Big Data & Machine Learning project and we are looking for talented individuals and IT professionals to join our dynamic team. The team consists of product managers, data engineers and business intelligence developers.
Job Description:
As a Data Engineer you will be responsible to:
• Collaborate with product owner to implement business requirements
• Transfer data via CDC from operational databases to streaming backbone
• Data Cleaning, Enrichment and Transformation by Streaming tools (Kafka Ecosystem)
• Development and improvement of data infrastructure architecture, data quality, data monitoring and access
Requirements:
• At least 3 years of relevant work experience
• Familiar with the NoSQL database and Relational database
• Familiar with CDC concept and Kafka ecosystem (Kafka/ Kafka SQL/ Kafka Stream)
• Familiar with and having experience in BI tools and database
• At least 3 years of programing by Python or Java
Nice to have additional knowledge in:
o Hadoop Map / Reduce
o HDFS
o Spark
o Apache Druid
o Familiar with Linux
o Familiar with the concept and characteristics of Data Lake
o Familiar with Lambda Architecture
مهارتهای مورد نیاز
- NoSQL
- kafka
- Databases
حداقل سابقه کار
- کمتر از سه سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست