آگهی‌های استخدامی

استخدام Data Engineer

فیلیمو | Filimo
تهران، تهران

شرح موقعیت شغلی

Are you a seasoned Data Engineer with a passion for transforming raw data into actionable insights? Do you thrive on creating robust data pipelines and leveraging cutting-edge technologies to support AI algorithms? If so, we have an exciting opportunity for you to join our AI team as a Data Engineer.



 Role and Responsibilities:
As an Open Data Engineer on our AI team, you will be a crucial player in designing, developing, and maintaining data pipelines that convert raw data streams into high-quality datasets suitable for AI-driven applications. Your responsibilities will include:



  • Designing and implementing end-to-end data pipelines to extract, transform, and load (ETL) data from various sources, including but not limited to video interactions, user behaviors, and content metadata.
  • Leveraging distributed solutions like Apache Spark to handle large-scale data processing and transformation efficiently and effectively.
  • Collaborating closely with cross-functional teams, including Data Scientists and Software Engineers, to understand data requirements and ensure smooth integration of data pipelines into AI algorithms.
  • Deploying and maintaining scalable Spark solutions tailored to our specific VOD platform needs.
  • Contributing to the optimization of data pipelines for performance, reliability, and scalability.
  • Integrating diverse technologies within our stack, such as Python, Go, ClickHouse, Redis, RabbitMQ, Grafana, Airflow, and MySQL, to create comprehensive data solutions.
  • Playing a pivotal role in shaping data architecture and strategies for our recommendation systems.
  • Staying updated with industry trends, best practices, and emerging technologies in data engineering and AI domains.
Qualifications and Requirements:



  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a strong track record of building and deploying data pipelines for AI applications.
  • Extensive hands-on experience with distributed data processing frameworks, particularly Apache Spark, for handling large-scale data transformations.
  • Proficiency in programming languages like Python and Go for designing and implementing data solutions.
  • Familiarity with ClickHouse, Redis, RabbitMQ, Grafana, Airflow, and MySQL, as well as their integration into data pipelines.
  • Background in designing and optimizing ETL processes for performance and scalability.
  • Knowledge of video recommendation systems and their underlying algorithms is a strong plus.
  • Strong problem-solving skills and the ability to work in a collaborative team environment.
  • Excellent communication skills to convey complex technical concepts to both technical and non-technical stakeholders.
Why Join Us:



  • Opportunity to work on cutting-edge AI-driven projects in the VOD industry.
  • Collaborative and innovative work environment with cross-functional teams.
  • Chance to make a significant impact on user experiences and engagement.
  • Competitive compensation package and benefits.
  • Professional growth and development opportunities in a rapidly evolving field.
If you're an experienced Data Engineer with a passion for transforming data into insights and want to play a pivotal role in shaping our AI-driven recommendation systems, we encourage you to apply.



Note: Please include your resume and a cover letter detailing your relevant experience and why you're a great fit for this role.


مهارت‌های مورد نیاز

  • Python
  • SQL
  • Big Data
  • Data engineer

حداقل سابقه کار

  • سه تا شش سال

جنسیت

  • مهم نیست

وضعیت نظام وظیفه

  • مهم‌ نیست

نوع همکاری:

تمام وقت

دسته‌بندی شغلی:

وب،‌ برنامه‌نویسی و نرم‌افزار

تاریخ انتشار آگهی:

۱۴۰۲/۱۰/۰۳ (منقضی‌شده)

مشاغل مشابه

مشاهده آگهی‌های استخدام مشابه