استخدام Senior Data Engineer
شرح موقعیت شغلی
Responsibilities:
- Design, build, and maintain AI data infrastructure for scalability, reliability, and performance.
- Collaborate with data scientists, AI researchers, and stakeholders to translate business requirements into technical solutions.
- Monitor and troubleshoot AI pipelines and processing workflows to identify and resolve performance and reliability issues.
Requirements:
- Bachelor's degree or higher in Computer Science, Computer Engineering, or a related field.
- 5+ years of overall experience in data engineering.
- Proven experience in deploying data engineering pipelines into production under high load environments, ensuring scalability, reliability, and performance optimization.
- Proficiency in scripting using Python, Scala, or Java for AI data processing and ETL.
- Strong knowledge of SQL and NoSQL databases, including systems like HBase, Cassandra, and other DBs.
- Experience with distributed computing frameworks like Spark and Hadoop for large-scale data processing.
- Familiarity with containerization platforms like Docker and Kubernetes for deploying and managing AI data infrastructure.
- Familiarity with workflow management tools like Airflow or Kubeflow for designing and scheduling AI pipelines.
- Excellent interpersonal and communication skills for collaborating with data scientists, AI researchers, and stakeholders.
- Ability to monitor and troubleshoot AI pipelines and processing workflows, identifying and resolving performance and reliability issues.
- Familiarity with monitoring systems like Grafana, Prometheus, or ELK stack is a plus.
مهارتهای مورد نیاز
- Data engineer
- ETL
- Java
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- معافیت دائم پایان خدمت