Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other critical business performance metrics
Work with stakeholders, including the Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
Work with data and analytics experts to strive for greater functionality in our data systems
Build processes supporting data transformation, data structures, metadata, dependency, and workload management · Design and implement ETLs for transforming data
Be an advocate for best practices and continued learning
Monitoring data services and resolving issues in case of any incident
Requirements:
Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
2+ years of experience in a Data Engineer role
Experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
Experience supporting and working with cross-functional teams in a dynamic environment.
Experience with data pipeline and workflow management tools.
Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.
Experience With Kafka and Kafka Connect
Experience With Debezium
Experience With Apache Airflow
A successful history of manipulating, processing, and extracting value from large disconnected datasets
Advanced working SQL knowledge.
The skill of explaining technical concepts to non-technical business leaders
Strong analytic skills related to working with unstructured datasets
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
Working knowledge of SQL Server integration service
Expert in Data Warehouse Design and BI fundamentals.
Capacity to successfully manage a pipeline of duties with minimal supervision.
Comfort working in a dynamic, research-oriented team with concurrent projects
Excellent communication skills, working with various peer groups and different levels of management
Great attention to detail and proven ability to manage multiple priorities simultaneously
detail-oriented, while also seeing and understanding the big picture
comfortable with ambiguity in a fast-paced and ever-changing environment
معرفی شرکت
اسنپفود بزرگترین سرویس آنلاین سفارش غذا در ایرانه که در کنار غذا، سرویسهایی از جمله سفارش نان، پروتئین، شیرینی و میوه رو هم در خودش داره.
همراهی صمیمانه و اعتماد بیش از ۵ میلیون کاربر ما رو بر این داشته که همواره به دنبال خلق پدیدههای تازه و راهی برای خدمترسانی بهتر و باکیفیتتر باشیم.
ما در این مسیر علاقهمند به همکاری با افرادی هستیم که با هوشمندی و سرعت عملشون در عبور از چالشها و مسائل کسبوکار یاریگرمون باشن.