استخدام Senior Data Engineer
شرح موقعیت شغلی
We seek a highly skilled and experienced Senior Data Engineer to join our dynamic team.
Key Responsibilities:
Key Responsibilities:
- Develop scalable data architectures and pipelines for processing and storing large volumes of e-commerce data.
- Design and maintain web scraping systems to collect product, pricing, and availability data from various online sources.
- Collaborate with front-end and AI teams to deliver data-driven features such as personalized recommendations and dynamic product listings.
- Ensure high availability and performance of backend systems through continuous monitoring and optimization.
- Implement APIs and services to provide reliable access to product data for both internal teams and end users.
- Lead initiatives to improve data processing efficiency and scalability as the platform grows.
- Stay up-to-date with the latest technologies and tools in data engineering to ensure we maintain a cutting-edge infrastructure.
- Build and maintain robust data security protocols to protect sensitive user and platform data.
- Automate routine data management tasks to improve operational efficiency.
- Collaborate with DevOps to ensure continuous integration and delivery pipelines for data systems.
- Document data processes, tools, and infrastructure to ensure knowledge sharing across teams.
Qualifications:
- Proven experience in data engineering, with a focus on designing scalable data architectures.
- Strong expertise in Python, Java, or similar languages.
- Solid understanding of database systems (SQL, NoSQL), data warehouses, and distributed systems.
- Experience with cloud infrastructure (AWS, GCP, Azure) and serverless architectures.
- Hands-on experience with web scraping, data transformation, and ETL processes.
- Familiarity with API development, microservices architecture, and real-time data processing.
- Strong problem-solving skills and the ability to work in a fast-paced, startup environment.
مهارتهای مورد نیاز
- Data engineer
- Python
- Java
- API
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست