این آگهی منقضی
شده است
Data Engineer (ETL Specialist)
As a data engineer you need to design and build systems for collecting, storing, and analyzing data at scale. Here, we are using modern and lesser-known tools, software and libraries, so you need to be open to learning and flexible enough to catch up.
- Responsibilities:
- Designing and building systems for collecting, storing, and analyzing data at scale
- Acquire datasets that align with business needs
- Collecting data from different data sources, including XML files, JSON files, REST APIs, NBI, etc.
- Develop algorithms to transform data into useful, actionable information
- Build, test, and maintain ETL/ELT pipeline architectures
- Collaborate with management to understand company objectives
- Create new data validation methods and data analysis tools
- Ensure compliance with data governance and security policies
- General Skills:
- Debian based Linux distros
- Git
- Docker
- Docker-Compose
- Coding best practices
- Experienced with code reviews and pull request.
· English language proficiency
- Special Skills:
- Python data wrangling libraries (pandas, numpy, etc.)
- Python multi-tasking paradigms and libraries
- Python ORM specially SQLAlchemy
- PostgreSQL
- Apache Airflow 2
- NoSQL databases (experience with at least one column-based DB is required)
- Additional Skills:
- Experience managing and working with Clickhouse is a big plus.
- Experience with at least one graph database is a plus.
- Experience with a cloud-based data solution (Azure/AWS/Google) is a plus.
شرکت روان ارتباط عصر با بیش از 1300 پرسنل یکی از بزرگترین شرکت های خصوصی کشور در زمینه ای تی و مخابرات می باشد.
عمده فعالیت های این شرکت ارائه خدمات فنی مهندسی به شرکت های بزرگ می باشد.
محصولات این مجموعه عمدتا به کمک فناوری های زیر در حال توسعه می باشند:
- Backend: Golang, C++ and Java
- Frontend: Angular, ES6, Webworker, WebGL and Web-Assembly
- Database: MongoDB, Cassandra, Hadoop, MySQL and etc
- DevOps: Jenkins, Kubernetes, Ansible and etc