شرح موقعیت شغلی

Responsibilities:

• Collaborate within a team of technologists to produce enterprise-scale solutions for our machine learning needs.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
• Create ETL pipelines for events as needed.
• Design highly available and scalable data platform solutions to enable storage, processing and analysis of large scale structured and unstructured data.
• Build and deliver high-quality data architecture and automated pipelines to support data science and ML use cases.

Qualifications:

• 4+ years of professional experience using Python, Java or Go.
• Strong skills and experience with developing production-grade software.
• Experience with Multi-threading, Collections and concurrent API.
• Experience with distributed stream processing technologies such as Spark, Flink and Kafka Streams.
• Have experience building production data pipelines using Hive/Hadoop. Have hands-on experience with schema design and data modeling.
• Have strong SQL (Spark SQL, Hive) skills and knowledge and familiarity with other distributed data stores such as Elastic-search and Cassandra.
• Experience with data pipeline and workflow management tools: Airflow, Luigi etc.
• Understands source code control tools (GIT is ideal and what we use).

مهارت‌های مورد نیاز

• SQL
• Java
• Python
• Git
• ETL

حداقل سابقه کار

• سه تا شش سال

جنسیت

• مهم نیست

وضعیت نظام وظیفه

• مهم‌ نیست

مشاهده آگهی‌های استخدام مشابه