استخدام Senior Data Warehouse Expert (Short-Term Contract)
شرح موقعیت شغلی
Project Summary: We are seeking a highly skilled and experienced Senior Data Warehouse Engineer to lead the design, development, and implementation of our data warehouse using open-source frameworks and tools. The ideal candidate will have a strong background in data architecture, ETL processes, and data modelling, with a passion for leveraging open-source technologies to drive business intelligence and analytics.
Important notes:
- Candidates are encouraged to apply only if they have at least 5 successful and demonstrable implementations of data warehousing in large businesses and corporations.
- Upon completion, the contractor will be responsible for transferring the project to a full-time employee for ongoing maintenance and further.
Key Responsibilities:
- Design and Architecture:
- Carry out the design and architecture of the data warehouse, ensuring scalability, reliability, and performance.
- Develop and maintain data models, schemas, and metadata using open-source tools.
- Define and implement best practices for data warehousing and ETL processes.
- Implementation and Development:
- Develop and implement the ETL processes to extract, transform, and load data from various sources into the data warehouse.
- Utilize open-source frameworks such as Apache Hadoop, Apache Spark, and Apache Kafka for data processing and integration.
- Develop and maintain data pipelines using tools like Apache Airflow.
- Data Management:
- Ensure data quality, consistency, and integrity across the data warehouse.
- Implement data governance policies and procedures.
- Monitor and optimize data warehouse performance, identifying and resolving bottlenecks.
- Collaboration:
- Work closely with data scientists, business stakeholders to understand data requirements and deliver solutions that meet their needs.
- Mentor and guide junior data engineers, providing technical leadership and fostering a culture of continuous learning and improvement.
- Collaborate with cross-functional teams to integrate data from various sources and support business intelligence initiatives.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
- 7+ years of experience in data warehousing, data engineering, or a related field.
- Strong expertise in open-source frameworks and tools such as Apache Hadoop, Apache Spark, Apache Kafka, and Apache Airflow.
- Proficiency in SQL and experience with database technologies such as PostgreSQL, MySQL, or similar.
- Experience with data modelling, ETL processes, and data integration.
- Knowledge of data governance and data security best practices
مهارتهای مورد نیاز
- ETL
- SQL
- Data
حداقل سابقه کار
- بیش از شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست