استخدام Senior Data Engineer
شرح موقعیت شغلی
The Mohaymen Telecommunications Solutions Team is among the pioneers in the field of telecommunications technologies, utilizing indigenous capacities within the country. We try to remain agile and up-to-date to investigate the existing challenges in the telecommunications industry and find optimal solutions for them.
In the Telecommunications Solutions Team, we seek enthusiastic individuals with creative problem-solving skills, who are committed to developing projects in the best possible way. As a data engineer in this team, you will consistently tackle large-scale data challenges in the industry using modern and efficient tools.
Our Platform
We ingest and process the data of different sysems, including high-frequency, low latency transactional systems that are the core of Telecommunication serving platform.
We design, develop and maintain a complex stack of interdependencies as part of a 24/7 distributed operation, ingesting and processing around 10 million events per second, and providing useful insights to different stakeholders with them.
What You Will Do
In the Telecommunications Solutions Team, we seek enthusiastic individuals with creative problem-solving skills, who are committed to developing projects in the best possible way. As a data engineer in this team, you will consistently tackle large-scale data challenges in the industry using modern and efficient tools.
Our Platform
We ingest and process the data of different sysems, including high-frequency, low latency transactional systems that are the core of Telecommunication serving platform.
We design, develop and maintain a complex stack of interdependencies as part of a 24/7 distributed operation, ingesting and processing around 10 million events per second, and providing useful insights to different stakeholders with them.
What You Will Do
- Help designing and implementing our new data platform, which will ingest more than 200 billion daily events
- Interact with stakeholders (product, business) to define actionable requirements/deliverables, balancing business value with time-to-market
- Define the best engineering approach to our data-related problems, balancing between performance, infrastructure cost, time-to-market and long-term maintenance cost
- Interact with project management to define deliverables and accurate timelines
- Provide 2nd/3rd tier support, in collaboration with business and other technical teams
- Master current tools/technologies, and research new ones to fill gaps in the current functionality/performance/operability
Requirements
- Hands on experience in Linux, Virtualization, Docker, and Kubernetes
- Specialized in Hadoop ecosystem (HDFS, Yarn, Hive, Spark)
- Hands-on experience with Kafka/Zookeeper
- Experienced in Agile / Scrum / DevOps projects
- At least 2 years of programming experience in Python, Java or Scala or Go
- Experience working with one or more of these: Airflow, Debezium, Confluent Schema Registry
- Familiar with monitoring systems (Grafana, Prometheus, Exporters)
- Experience working with OLAP stores like Clickhouse
- SQL Knowledge and Experience with database systems like Clickhouse/Rocksdb/Posgres/Mysql and other DBs
- Experience in streaming technologies like Spark, Nifi
- Good Communication and Teamwork Skills
مهارتهای مورد نیاز
- Data engineer
- SQL
- Python
- SSIS
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست