We are seeking a senior-level Data Engineer (+2 years experience) to help us in organizing our data, creating an end-to-end pipeline, and integrating it with BI and Data Analyst teams. This is a fantastic opportunity to take ownership of a critical role, experiment with new ideas, and make a significant impact on our operations. We are looking for a geeky-freaky mind that loves to play with the system until they quench their thirst. If you love solving problems and making a difference, we would love to hear from you.
Responsibilities
Identify valuable data sources and automate data collection processes and undertake preprocessing of structured and unstructured data.
Setup analytical infrastructure to facilitate exploration and visualization of datasets.
Discover opportunities for data acquisition and develop data set processes for data modeling, mining, and production.
Drive delivery of efficient data engineering standards, templates, patterns, and best practices by effectively using agile process methodology to define work, estimate effort, and measure results.
Develop and implement data design methods, data structures, and modeling standards which work with multiple business intelligence tools.
Work with Business Intelligence Team, data scientists team as well as other teams and meet their requirements.
Requirements
Demonstrated experience of driving meaningful business outcomes through data engineering (most important; we love to have a short report of that!).
Bachelor’s degree or higher in Computer Science, Computer Engineering, Statistics, or a related field (third-year students and above are also welcome). Relevant experience or personal projects will be considered if a degree is not available (see the previous criteria).
2+ years of experience in the data engineering field (including education and personal projects).
Highly Proficient in SQL and a scripting language like Python and Hands-on experience with at least one RDBMS (MySQL)
Familiar with data processing tools such as Hadoop and Kafka
Familiar with orchestration tools such as Airflow
Experience designing and developing ETL and ELT pipelines with relational and non-relational data.
Experience designing and implementing data quality checks and validation processes
Excellent communication skills (medium+ English), with the ability to present and propose ideas and requirements without direct supervision.
Ability to work and utilize data/code/system version control methods and proper documentation is a must.
Agile working methods and open feedback culture (be initiativ
Familiarity with container management and deployment tools such as Docker, and CI/CD process is a plus.
Experience with visualization and dash boarding platforms like Grafana, Kibana, PowerBI, Quicksight is a plus.
(Note: This role is on-site in Karaj, and remote options are not available at this time.)
معرفی شرکت
نهالگشت ایرانیان یک شرکت هلدینگ در صنعت گردشگری است که با شرکتهای زیر مجموعه و ساب برندهای مختلف، در اکثر بخشهای گردشگری فعالیت مینماید. نهالگشت در راستای رفاه حال اعضای باشگاه مشتریان ۴۵,۰۰۰ نفری خود این بخشها را راه اندازی نموده است.