استخدام Data Engineer
شرح موقعیت شغلی
Responsibilities
- Design, implement, and maintain scalable data pipelines handling billions of records
- Maintain Big Data Systems and make sure their reliability and maintenances
- Propose new data architecture for new requirements and fine-tune the existing ones
- Work with Business Intelligence Team, Ventures and data scientists team as well as other teams and meet their requirements
- Monitoring data services and resolve issues in case of any incident
- Knows how to write highly efficient data pipelines and troubleshoot them
Requirements
- BS/MS or more in computer engineering/science
- Experience working with Airflow
- Hands on experience in Git, GitLab
- Specialized in Hadoop ecosystem (HDFS, Hive, Spark, DeltaLake,)
- At least 2 years of programming experience in Python
- Experience working with Relational Databases( Oracle, MySQL)
- SQL Knowledge and Experience with database systems
- Good Communication and Teamwork Skills
- Hands on experience in Linux
- experienced with Kafka/Zookeeper is a Bonus
مهارتهای مورد نیاز
- Data engineer
- SQL
- Big Data
- Python
- Gitlab
حداقل سابقه کار
- کمتر از سه سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- معافیت دائم پایان خدمت