استخدام Data Engineer

شرح موقعیت شغلی

• Design, optimal develop, and maintain standard data pipelines and according to data integration principles and business goals.
• Designing and implementing solutions for loading both structured and semi-structured data design into multiple target data systems.
• develop and test data systems to create robust and scalable applications for data analytics.
• Understand complex business requirements and propose end-to-end, simplified enterprise information architecture solutions.
• Setup analytical infrastructure to facilitate exploration and visualization of datasets.
• Drive delivery of efficient data engineering standards, templates, patterns, and best practices by effectively using agile process methodology to define work, estimate effort, and measure results.
• Develop and implement data design methods, data structures, and modeling standards which work with multiple business intelligence tools.
• Work as an individual contributor as well as part of a team in building, maintaining, and troubleshooting data pipelines.  

• Demonstrated experience driving meaningful business outcomes through data engineering.
• Highly proficient in SQL and a scripting language like Python.
• Hands-on experience with at least one RDBMS (MySQL, MSSQL or Oracle) and NoSQL databases.
• Deep understanding of data service ecosystems including data warehousing, lakes and metadata.
• Experience building or working with metadata-driven ETL/ELT patterns and concepts.
• Critical thinking skills to propose solutions, test, and make a reality.
• Strong attention to details.
• Good analytical and quantitative abilities.
• Familiar with Docker, CI/CD, Linux.
• Being familiar with OLAP, Hadoop, Spark, Kafka, NIFI, Airflow, Metabase, Superset or ELK is a plus. 

مهارت‌های مورد نیاز

• Python
• SQL
• Big Data
• Data engineer

حداقل سابقه کار

• سه تا شش سال

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• مهم‌ نیست

مشاهده آگهی‌های استخدام مشابه