استخدام Data Engineering

شرح موقعیت شغلی

• Design, develop, optimize, and maintain data pipelines and processes that adhere to data integration principles and business goals.
• Responsible for designing and implementing solutions for loading both structured and semi-structured data design into multiple target data systems.
• Code and test new or modified data systems to create robust and scalable applications for data analytics.
• Understand complex business requirements and propose end to end and simplified enterprise information architecture solutions.
• Setup analytical infrastructure to facilitate exploration and visualization of datasets.
• Drive delivery of efficient data engineering standards, templates, patterns, and best practices by effectively using agile process methodology to define work, estimate effort, and measure results.
• Develop and implement data design methods, data structures, and modeling standards which work with multiple business intelligence tools.
• Work as an individual contributor as well as part of a team building, maintaining, and troubleshooting data pipelines.  

• Demonstrated experience driving meaningful business outcomes through data engineering.
• Highly Proficient in SQL and a scripting language like Python.
• Hands-on experience with at least one RDBMS (MySQL, MSSQL or Oracle) and also OLAP databases.
• Deep understanding of data service ecosystems including data warehousing, lakes and metadata.
• Experience building or working with metadata-driven ETL / ELT patterns and concepts.
• Critical thinking skills to propose solutions, test, and make them a reality.
• Strong attention to detail.
• Good analytical and quantitative abilities.
• Familiar with Docker, CI/CD, Linux.
• Being familiar with Hadoop, Spark, Kafka, NIFI, Airflow, Metabase, Superset or ELK is a plus. 

مهارت‌های مورد نیاز

• SQL
• Python
• Data engineer
• Logstash

حداقل سابقه کار

• مهم نیست

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• مهم‌ نیست

مشاهده آگهی‌های استخدام مشابه