استخدام Data Engineer

شرح موقعیت شغلی

• Design, implement, and maintain scalable real time and batch data pipelines handling billions of records
• Maintain Real Time Analytics Systems and Big Data Systems and make sure their reliability and maintenances
• Propose new data architecture for new requirements and fine-tune the existing ones
• Work with Business Intelligence Team, data scientists team as well as other teams and meet their requirements
• Monitoring data services and resolve issues in case of any incident

• Hands on experience in linux, virtualization, docker, and kubernetes
• Hands-on experience with message brokers as kafka, rabbit, etc
• Experience in streaming data: spark, nifi, etc
• Experience working with database: mysql, mongodb, etc
• Experience with data exploration and data visualization: superset, hue, etc
• Experience in programming: python, go, etc
• Experience with monitoring systems: grafana, etc
• Experience working with pipeline: airflow, debezium

مهارت‌های مورد نیاز

• Python
• SQL
• NoSQL
• Big Data

حداقل سابقه کار

• سه تا شش سال

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• معافیت تحصیلی معافیت دائم پایان خدمت

مشاهده آگهی‌های استخدام مشابه