استخدام Lead Data Engineer
شرح موقعیت شغلی
Description / Tasks:
- Lead the Data Engineering team in the design, development, and maintenance of our data warehouse, data lake, and associated data pipelines.
- Champion the adoption of open-source data tools Make crucial decisions about data architecture and the selection of data processing technologies, driving the continual enhancement of our data engineering systems.
- Foster a culture of collaboration, innovation, and continuous learning within the Data Engineering team, promoting best practices in data engineering.
Requirements / Skills:
- In-depth understanding of Data Language (T-sql, PL/SQL, KQL, ...)
- Experience with open-source data processing tools such as MinIO, Hadoop , Apache Airflow, Apache Spark, and Apache Nifi is highly desirable.
- Comprehensive knowledge of ETL/ELT processes and technologies.
- Proven ability to make informed decisions concerning data architecture and technology selection.
- Demonstrated leadership experience in a data engineering team, with excellent team management skills.
- Robust communication skills, capable of effectively liaising with diverse stakeholders across the organization.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- supporting data transformation, data structures, metadata, dependency and workload management.
- Writing effective and scalable Python codes Produce clean, consistent, logical code based on designs; submit to GitLab repository Generating infrastructure that allows big data to be accessed and analyzed.
- We are looking for a candidate with +4 years of experience in a Data Engineer role.
مهارتهای مورد نیاز
- پایگاه داده
- MySQL
- MongoDB
- Team Leader
- TSQL
حداقل سابقه کار
- بیش از شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست