استخدام Data Engineer
شرح موقعیت شغلی
The Data Engineer, as a member of the Itoll Data team, is responsible for developing and maintaining large-scale data pipelines to enable data and business teams to achieve their business goals through data-driven insights. Emphasizing data quality, aggregating and structuring data, providing appropriate tools for working with large volumes of data with low latency, developing and deploying software and artificial intelligence models, and optimizing data-driven processes are among the goals of the Itoll Data Engineering team.
Main Responsibilities:
- Design, implement, and optimize data structures
- Design, implement, and maintain data pipelines and infra, including ETL development and data quality
- Design, implement, and maintain monitoring structures for various data warehouses
- Collaborate with the data team to achieve data insights and support the business line
- Working with various tools to make pipelines and data jobs smooth like airflow
Required Skills:
- At least two years of programming experience in one of the languages: Python, Scala, Java, or similar
- Familiarity with Python data packages and the ability to communicate with data analyst and data scientist teams
- Familiarity with SQL and database systems(sql/ no sql) such as Clickhouse, MySQL, Postgres,Mongo and similar
- Familiarity with data analysis and visualization tools such as Metabase and Superset
- Familiarity with monitoring tools such as Grafana, Prometheus
- Familiarity with execution management tools such as Airflow
- Familiarity with Kafka and related services
Preferred Skills:
- Basic knowledge of data mining and data science
- Familiarity with tools for working with large volumes of data
- Familiarity with Kubernetes and related tools
- Working with stream and batch data pipeline
- Experience in the DevOps field
مهارتهای مورد نیاز
- Big Data
- Data engineer
- SQL
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست