استخدام Data Engineer

شرح موقعیت شغلی

• Design, implement, and maintain scalable real-time and batch data pipelines that handle billions of records.
• Develop and manage real-time analytics systems, ensuring their reliability, performance, and maintenance.
• Propose and refine data architecture to meet evolving business needs.
• Collaborate with Business Intelligence, Ventures, and Data Science teams to ensure their data requirements are met.
• Monitor and troubleshoot data services, resolving any issues that arise.
• Set up real-time analytics solutions tailored to specific services and business demands.
• Ensure highly efficient data pipelines by identifying and fixing performance bottlenecks.
• Design, implement and maintain data infrastructure to ensure steady and undisrupted data flow

• Bachelor's or Master's degree in Computer Engineering/Science or equivalent experience.
• Expertise in designing and maintaining scalable data pipelines and big data systems.
• Proficiency in Hadoop ecosystem (HDFS, Yarn, Hive, Spark).
• Hands-on experience with Kafka and Zookeeper for data streaming and coordination.
• Strong programming skills in Python, Java, Scala, or Go (minimum 2 years of experience).
• Familiarity with monitoring systems such as Grafana, Prometheus, and Exporters.
• Experience working with Linux, virtualization, Docker, and Kubernetes.
• Proven experience in setting up and maintaining real-time analytics and big data systems.
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
• Strong communication skills and the ability to articulate technical concepts to both technical and non-technical stakeholders.

مهارت‌های مورد نیاز

• Data engineer
• Python
• HDFS

حداقل سابقه کار

• سه تا شش سال

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• مهم‌ نیست

ارسال رزومه