استخدام Senior Data Engineer

شرح موقعیت شغلی

• Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines and ETL processes.
• Collaboration: Work closely with data analysts, data scientists, and software engineers to gather data requirements, ensuring data integrity and quality.
• Stream Processing: Utilize frameworks like PySpark for efficient real-time data processing.
• Big Data Handling: Implement and optimize big data frameworks, such as Hadoop, to manage large volumes of data effectively.
• Distributed Systems: Employ message brokers like Kafka for data transportation and processing in distributed environments.
• Database Management: Develop and maintain data models and database schemas to meet business needs.
• Database Technologies: 
  • Experience with both SQL (Click House, SQL Server) and NoSQL databases (MongoDB, Redis) for structured, unstructured, and semi-structured data management. 
  • Proficiency in containerization and orchestration tools like Docker and Kubernetes. 
• Programming & Problem Solving: Apply strong Python or Scala skills and analytical abilities to solve complex data challenges.
• Communication & Collaboration: Demonstrate excellent communication and teamwork skills.

• Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• Experience: Proven track record as a Data Engineer or in a similar role.
• Programming Skills: Proficiency in Python or Scala.
• Frameworks & Tools: 
  • Experience with stream processing frameworks, notably PySpark. 
  • Familiarity with message brokers such as Kafka and RabbitMQ. 
  • Knowledge of SQL databases, specifically Click House and SQL Server. 
  • Experience with NoSQL databases (e.g., MongoDB, Redis) and object storage solutions like Minio. 
  • Proficiency in containerization and orchestration technologies, including Docker and Kubernetes. 
• Analytical Skills: Strong problem-solving abilities and analytical thinking.
• Soft Skills: Excellent communication and collaboration skills.
• Additional Skills: 
  • Some experience with job orchestration tools, such as Apache Airflow. 
  • Familiarity with data integration tools like Microsoft SSIS and Apache Nifi. 

• Weekly social events (Cinema Night and Mafia Night)
• Professional development opportunities
• Free breakfast every day
• Birthday and anniversary gifts and surprises
• Lunch and snack subsidies
• Transportation budget
• On-site medical care
• Comprehensive health insurance
• Parking space
• Seasonal and special charges and discounts from Okala

مهارت‌های مورد نیاز

• Data engineer
• kafka
• Redis

حداقل سابقه کار

• سه تا شش سال

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• معافیت تحصیلی معافیت دائم پایان خدمت

ارسال رزومه