استخدام Senior Data Engineer
شرح موقعیت شغلی
About this Role
At Azki’s Data Team, we are looking for a skilled problem-solver to help us design, build, and scale reliable data infrastructure that powers analytics, products, and business decisions.
Responsibilities
- Work closely with data team members and cross-functional teams to design and implement scalable data pipelines.
- Build, maintain, and optimize data processing workflows using Kafka, Spark (with Scala/Python), and MySQL/ClickHouse.
- Ensure data quality, integrity, and availability across our data platforms.
- Develop and manage data models and storage solutions that support analytical and product use cases.
- Automate data ingestion, transformation, and delivery processes.
- Monitor and improve the performance of pipelines and queries across ClickHouse, MySQL, and other data systems.
- Collaborate with analysts, data scientists, and product teams to enable self-service analytics through tools such as Metabase and Zeppelin.
- Contribute to the continuous improvement of Azki’s data platform architecture, ensuring scalability, security, and reliability.
Requirements
- At least 5 years of relevant experience in data engineering or data infrastructure.
- Strong SQL skills and hands-on experience with databases such as MySQL and ClickHouse.
- Hands-on experience with streaming and batch processing systems, including Kafka and Spark.
- Proficiency in both Scala and Python for data engineering and pipeline development.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Experience with workflow orchestration tools (e.g., Airflow) and version control systems (e.g., Git/GitLab).
- Strong problem-solving skills with the ability to design and implement robust, scalable data solutions.
- Effective communication and teamwork skills, with the ability to collaborate with cross-functional teams.
- Strong proficiency in Linux environments, including shell scripting, system monitoring, and troubleshooting.
- Hands-on experience with Docker for containerizing and deploying data services.
Nice to Have
- Experience mentoring and supporting team members in their career growth, including close collaboration and pair work to improve project outcomes.
- Familiarity with data visualization and BI tools such as Metabase.
- Knowledge of best practices in data security, governance, and compliance.
مهارتهای مورد نیاز
- Python
- SQL
- Data engineer
حداقل سابقه کار
- بیش از شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست