استخدام Senior Data Engineer
شرح موقعیت شغلی
In the Story of Snappfood, we believe in creating value that goes beyond the ordinary. We are wiling to establish innovative tendencies and are eager to have you on our team to help us get through our business challenges with creativity, intelligence, and agility.
We are waiting for you to continue this story.
We are waiting for you to continue this story.
Responsibilities:
• Design, develop, and maintain scalable and reliable data pipelines and ETL processes.
• Collaborate with data analysts, data scientists, and software engineers to gather data requirements and ensure data integrity and quality.
• Utilize stream processing frameworks like PySpark to process real-time data efficiently.
• Implement and optimize big data frameworks like Hadoop to handle large volumes of data.
• Work with message brokers like Kafka and RabbitMQ to transport and process data in a distributed environment.
• Develop and maintain data models and database schemas to support business needs.
• Experience with NoSQL databases for handling unstructured and semi-structured data.
• Experience with SQL databases, including ClickHouse and MySQL, for efficient data storage and retrieval.
• Experience with containerization and orchestration technologies like Docker and Kubernetes.
• Collaborate with data analysts, data scientists, and software engineers to gather data requirements and ensure data integrity and quality.
• Utilize stream processing frameworks like PySpark to process real-time data efficiently.
• Implement and optimize big data frameworks like Hadoop to handle large volumes of data.
• Work with message brokers like Kafka and RabbitMQ to transport and process data in a distributed environment.
• Develop and maintain data models and database schemas to support business needs.
• Experience with NoSQL databases for handling unstructured and semi-structured data.
• Experience with SQL databases, including ClickHouse and MySQL, for efficient data storage and retrieval.
• Experience with containerization and orchestration technologies like Docker and Kubernetes.
Requirements:
• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Proven experience as a Data Engineer or similar role.
• Strong programming skills in Python.
• Strong problem-solving and analytical skills.
• Experience in stream processing frameworks like PySpark.
• Proficiency in big data frameworks like Hadoop.
• Familiarity with message brokers like Kafka and RabbitMQ.
• Knowledge of SQL databases, including ClickHouse and MySQL.
• Experience with NoSQL databases.
• Experience with containerization and orchestration technologies like Docker and Kubernetes.
• Excellent communication and collaboration abilities.
• Proven experience as a Data Engineer or similar role.
• Strong programming skills in Python.
• Strong problem-solving and analytical skills.
• Experience in stream processing frameworks like PySpark.
• Proficiency in big data frameworks like Hadoop.
• Familiarity with message brokers like Kafka and RabbitMQ.
• Knowledge of SQL databases, including ClickHouse and MySQL.
• Experience with NoSQL databases.
• Experience with containerization and orchestration technologies like Docker and Kubernetes.
• Excellent communication and collaboration abilities.
Benefits:
• Vouchers for vacation, Gym, Therapy Sessions
• Complementary Insurance
• Educational platform of advanced courses
• Snappfood’s Discount codes
• Loans
• Complementary Insurance
• Educational platform of advanced courses
• Snappfood’s Discount codes
• Loans
مهارتهای مورد نیاز
- Python
- MySQL
- NoSQL
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست