استخدام Senior Data Engineer

We are seeking a highly skilled and experienced Senior Data Engineer and ML Ops Developer to join our team. The ideal candidate will have a strong background in data engineering, machine learning operations, and extensive experience with Kubernetes and Spark clusters.

 Key Responsibilities:
•  Design, build, and maintain scalable and reliable data pipelines.
•  Manage and optimize Spark clusters for high-performance computing.
•  Deploy and maintain Kubernetes clusters for orchestration of containerized applications.
•  Implement continuous integration and deployment (CI/CD) pipelines for machine learning models.
•  Collaborate with data scientists and analysts to deploy machine learning models to production.
•  Ensure data quality and implement monitoring for data pipelines and ML models.
•  Develop and maintain infrastructure as code (IaC) for reproducible and scalable environments.
•  Troubleshoot and resolve issues related to data infrastructure and ML model deployments.

Qualifications:
•  Bachelor's or Master's degree in Computer Science, Mathematics, Engineering, or a related field.
•  At least 4 years of experience in data engineering and ML Ops.
•  Proficiency with big data technologies, including Apache Spark and Hadoop.
•  Strong experience with Kubernetes for container orchestration.
•  Knowledge of ETL processes, data warehousing, and data modeling.
•  Familiarity with machine learning frameworks (TensorFlow, PyTorch) and MLOps tools.
•  Proficient in programming languages such as Python, Scala, or Java.
•  Excellent problem-solving skills and the ability to work in a fast-paced environment.

Preferred Skills:
 •  Experience with data governance, security, and compliance.
 •  Familiarity with monitoring tools like Prometheus and Grafana.