:fill(white):format(jpeg)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/4b674e89-3d89-463c-9c6d-2744f618ed70/main.jpg)
تجارت الکترونیک پارسیان | Parsian E-commerce
استخدام Data Engineer
-
دستهبندی شغلی
-
موقعیت مکانی
-
نوع همکاری
-
حداقل سابقه کار
-
حقوق
شرح موقعیت شغلی
Key Responsibilities
• Design, implement, and optimize data ingestion pipelines using Apache NiFi to handle sources like CSV and RDBMS, converting data to formats such as Parquet.
• Configure and manage a Spark standalone cluster for efficient data processing.
• Set up and maintain MinIO for object storage, including raw and processed buckets.
• Orchestrate end-to-end data workflows using Apache Airflow, integrating with Postgres for metadata storage and triggering NiFi flows and Spark jobs.
• Monitor system performance, logs, and health across nodes using built-in tools and optional monitoring services; ensure high availability and quick issue resolution.
• Work cross-functionally with other stakeholders to align infrastructure with business needs, including documentation and knowledge sharing.
Required Qualifications
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (Master's preferred).
• 5+ years of experience in data engineering, infrastructure, or operations roles, with a focus on building and maintaining data pipelines and systems.
• Proven hands-on experience with Apache NiFi for data ingestion and ETL processes.
• Strong expertise in Apache Spark (standalone or clustered) for distributed data processing.
• Proficiency with object storage solutions like MinIO (or S3-compatible systems) and database management using Postgres and Oracle.
• Experience with workflow orchestration tools such as Apache Airflow.
• Solid understanding of data formats (e.g., Parquet, CSV), data flows, and optimization techniques for performance and scalability.
• Knowledge of monitoring, logging, and troubleshooting in data environments.
• Excellent problem-solving skills, with the ability to handle complex, multi-node architectures.
● Working Hours: Saturday to Wednesday: 07:30AM to 03:45PM
● Flexible Hours: 1 hours of flexibility available
● Benefits: Seasonal gift packages and rewards
● Supplementary insurance
● lunch
● Groceries
● Performance-based bonuses
● Workplace Location: Jordan, Soltani (Sayeh)
• Design, implement, and optimize data ingestion pipelines using Apache NiFi to handle sources like CSV and RDBMS, converting data to formats such as Parquet.
• Configure and manage a Spark standalone cluster for efficient data processing.
• Set up and maintain MinIO for object storage, including raw and processed buckets.
• Orchestrate end-to-end data workflows using Apache Airflow, integrating with Postgres for metadata storage and triggering NiFi flows and Spark jobs.
• Monitor system performance, logs, and health across nodes using built-in tools and optional monitoring services; ensure high availability and quick issue resolution.
• Work cross-functionally with other stakeholders to align infrastructure with business needs, including documentation and knowledge sharing.
Required Qualifications
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (Master's preferred).
• 5+ years of experience in data engineering, infrastructure, or operations roles, with a focus on building and maintaining data pipelines and systems.
• Proven hands-on experience with Apache NiFi for data ingestion and ETL processes.
• Strong expertise in Apache Spark (standalone or clustered) for distributed data processing.
• Proficiency with object storage solutions like MinIO (or S3-compatible systems) and database management using Postgres and Oracle.
• Experience with workflow orchestration tools such as Apache Airflow.
• Solid understanding of data formats (e.g., Parquet, CSV), data flows, and optimization techniques for performance and scalability.
• Knowledge of monitoring, logging, and troubleshooting in data environments.
• Excellent problem-solving skills, with the ability to handle complex, multi-node architectures.
● Working Hours: Saturday to Wednesday: 07:30AM to 03:45PM
● Flexible Hours: 1 hours of flexibility available
● Benefits: Seasonal gift packages and rewards
● Supplementary insurance
● lunch
● Groceries
● Performance-based bonuses
● Workplace Location: Jordan, Soltani (Sayeh)
معرفی شرکت
شرکت تجارت الکترونیک پارسیان وابسته به بانک پارسیان میباشد که در زمینه خدمات نرمافزاری، تجارت الکترونیک، خدمات کارت، درگاه پرداخت و دستگاه کارتخوان فعالیت دارد.
-
مهارتهای مورد نیاز
-
جنسیت
-
وضعیت نظام وظیفه
-
حداقل مدرک تحصیلی
این آگهی منقضی
شده است
مشاغل مشابه
-
:fill(white):format(jpeg)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/1bf2a570-733f-11e6-b89a-06a874001fea_5eb3d2d4-f48c-4aa1-9b4b-f83146763a03/main.jpg)
توسعهدهنده NET. (۱۶ روز پیش)
-
Data Engineer (۶ روز پیش)
-
:fill(white):format(jpeg)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/6e121d7c-9455-11eb-97c0-86000088a815_df696cee-1e5f-4eaf-9e61-7300f4b60028/main.jpg)
مهندس داده (Data Engineer) (۳۰ روز پیش)
-
:fill(transparent):format(png)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/18630698-eedd-4062-b9a6-66d62c46a9cf/main.png)
Senior Data Analyst (۲۲ روز پیش)
-
:fill(white):format(jpeg)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/c1dced80-8a30-4a63-8246-e018e1ddfd1f/main.jpg)
Backend Engineer (۳۸ روز پیش)
-
:fill(transparent):format(png)/https://mstorage2.jobinjacdn.com/other/files/uploads/images/82ac28e8-4527-4916-a968-99cd91e8a0ca/main.png)
DevOps Engineer (۵۱ روز پیش)
چه موردی را میخواهید گزارش کنید؟
از اینجا شروع کنید
این آگهی منقضی شده است
در شغل بهتری استخدام شوید! رایگان!
- جستجو و ارسال رزومه به آگهیهای استخدام بیش از ۱۰۰,۰۰۰ شرکت ایرانی
- رزومهساز رایگان
- دریافت فرصتهای شغلی جدید مرتبط از طریق ایمیل (Job Alert)
- شناخت محیط کار و فرهنگ سازمانی شرکتهای در حال استخدام