Alibaba is looking for a Data Engineer in AI department to help us improve and expand our rapidly-growing products.
In Alibaba, we believe we can influence the workplace culture of Iran by promoting Integrity, Authenticity, Commitment to something beyond ourselves and Respectful dialogue, and you can be a part of this building procedure.
Responsibilities:
Collaborate within a team of technologists to produce enterprise-scale solutions for our machine learning needs.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
Create ETL pipelines for events as needed.
Design highly available and scalable data platform solutions to enable storage, processing and analysis of large scale structured and unstructured data.
Build and deliver high-quality data architecture and automated pipelines to support data science and ML use cases.
Qualifications:
4+ years of professional experience using Python, Java or Go.
Strong skills and experience with developing production-grade software.
Experience with Multi-threading, Collections and concurrent API.
Experience with distributed stream processing technologies such as Spark, Flink and Kafka Streams.
Have experience building production data pipelines using Hive/Hadoop. Have hands-on experience with schema design and data modeling.
Have strong SQL (Spark SQL, Hive) skills and knowledge and familiarity with other distributed data stores such as Elastic-search and Cassandra.
Experience with data pipeline and workflow management tools: Airflow, Luigi etc.
Understands source code control tools (GIT is ideal and what we use).
معرفی شرکت
شرکت سفرهای علیبابا، یک جمع بزرگ بیش از 800 نفری از افرادی حرفهای و تاثیرگذار است که در جایگاه رهبر بازار گردشگری ایران، با ارائه همه خدمات سفر بهشکل آنلاین، همسفر مسافران میشود. تلاش همه علیباباییها این است که با توانمندسازی جامعه، دسترسی به تجربه شایسته سفر را برای همه ممکن کنند. اینجا هر روز برای ما «روز اول» است و فرصتی برای رشد و یادگیری. در واقع هیچ سقف و محدودیتی برای خودمان قائل نیستیم و علیبابا را یک کوه بدون قله میبینیم.