Data Team plays a key role in driving the business of Snapp. Gathering data from each part of the company, integrating different kinds of information into a well-designed data lake, and also analyzing data and providing management dashboards and KPI metrics are among the daily tasks of the team. To achieve this mission, not only cooperation to other team members including data scientists, DevOps engineers, I experts is a must, but also collaboration to other teams in Snapp is inevitable and it’s the exactly point that made the team as dynamic and active as possible.
About the Role
As a Senior Data Engineer, you will develop and maintain our Data platform and improve existing architecture for incoming projects. Your passion is to work with the latest and greatest technologies that make working with large amounts of data easy. You’re pro-active in keeping yourself up to date and are always searching for new ways to discover new technologies. You also enjoy laying the architectural foundations for the things you’re working on. You combine both thinking of the future and a hands-on, right now attitude. You will work in a team with highly skilled people and enjoy a creative atmosphere where trying things out is encouraged.
Responsibilities
Design and deliver scalable big data systems supporting both streaming and batch modes
Implement and maintain the data-lake ecosystem to unify all diverse data sources.
Build reliable data pipelines and ETLs to deliver data from diverse data sources.
Work closely with stakeholders, including engineering, product, and analytics teams, to fulfill their requirements.
Explore and assess novel technologies to address issues in the big data stack.
Qualifications
BS/MS or more in computer engineering/science or related experience
3.5+ years of industry experience in software development using Python, Java/Scala and SQL
Understanding of distributed systems related to data processing and storage
Knowledge of big data frameworks such as Hadoop, Hive, Kafka, Spark
Experience using data ETLs including Airflow or Nifi
Familiar to Docker deployment, Kubernetes and CI/CD automation based on Gitflow
Preferred Qualifications
Experience with stream processing such as Flink or Spark.
Experience in data pipelines, including Logstash or Filebeat or FluentD.
Practice in NoSQL databases like Cassandra/Hbase/MongoDB and Columnstore DB and Row Store Databases like SQL Server etc.
Knowledge of Ruby/Go Language is plus.
معرفی شرکت
اسنپ محصولی ایرانی است که از تیمی خلاق، جوان و تحصیلکرده قدرت میگیرد و در تلاش است تا صنعت فناوری اطلاعات و ارتباطات را به زندگی روزمره جامعه پیوند بزند.
اهداف بزرگی در سر داریم و بلند پروازیم. قصد داریم اسنپ را به بهترین راهکار برای سفرهای درونشهری ایران تبدیل کنیم و در این راه به کمک افراد خلاق، سختکوش و بلندپرواز احتیاج داریم. اگر چنین خصوصیاتی دارید خوشحال میشویم که رزومه خود را برایمان ارسال کنید.